2023-10-14T10:16:20.129 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T10:16:20.130 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217 --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} --verbose --name rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217/orig.config.yaml 2023-10-14T10:16:20.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T10:16:20.267 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217 branch: rishabh-2023oct13 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} email: null first_in_suite: false job_id: '7425217' kernel: client: branch: testing flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-2023oct13 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds - \(MDS_INSUFFICIENT_STANDBY\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_DAMAGE\) - \(FS_DEGRADED\) sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: disabled: true install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJbRN2m1thcVQpCsyuQTL+DCHe2isdRV4ohjSBmxB0doGHf17+4IZ0ht7e0NgjIsgT9FyQkaFgKWHMHohu6xqw= smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP/EQYXPQOGDDCHO62xogl3UH0iFPEqytp/CH5wRYoLQcchSx2clehL0xvQEnNdUUG6t4dD4BqQE0xb7MlREKPE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - exec: mon.a: - ceph config set mgr mgr/crash/warn_recent_interval 0 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_failover teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_18:04:14 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T10:16:20.268 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa; will attempt to use it 2023-10-14T10:16:20.269 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks 2023-10-14T10:16:20.269 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T10:16:20.271 INFO:teuthology.task.internal:Checking packages... 2023-10-14T10:16:20.295 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-14T10:16:20.295 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T10:16:20.296 INFO:teuthology.packaging:ref: None 2023-10-14T10:16:20.296 INFO:teuthology.packaging:tag: None 2023-10-14T10:16:20.296 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-14T10:16:20.296 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T10:16:20.297 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-2023oct13 2023-10-14T10:16:20.448 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-14T10:16:20.448 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T10:16:20.456 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T10:16:20.457 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T10:16:20.511 INFO:teuthology.task.internal:Saving configuration 2023-10-14T10:16:20.529 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T10:16:20.543 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T10:16:20.566 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 10:11:18.781621', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJbRN2m1thcVQpCsyuQTL+DCHe2isdRV4ohjSBmxB0doGHf17+4IZ0ht7e0NgjIsgT9FyQkaFgKWHMHohu6xqw='} 2023-10-14T10:16:20.591 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 10:11:18.780135', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP/EQYXPQOGDDCHO62xogl3UH0iFPEqytp/CH5wRYoLQcchSx2clehL0xvQEnNdUUG6t4dD4BqQE0xb7MlREKPE='} 2023-10-14T10:16:20.591 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T10:16:20.601 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-10-14T10:16:20.601 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-10-14T10:16:20.602 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T10:16:20.687 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6f51151af0>, signals=[15]) 2023-10-14T10:16:20.689 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T10:16:20.697 INFO:teuthology.task.internal:Opening connections... 2023-10-14T10:16:20.697 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:16:20.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:16:20.797 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T10:16:20.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:16:20.882 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T10:16:20.893 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-10-14T10:16:20.911 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-10-14T10:16:20.911 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-10-14T10:16:20.967 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-10-14T10:16:20.967 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2023-10-14T10:16:20.967 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-10-14T10:16:20.968 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-10-14T10:16:20.968 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2023-10-14T10:16:20.968 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2023-10-14T10:16:20.968 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T10:16:20.968 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-10-14T10:16:20.969 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2023-10-14T10:16:20.969 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T10:16:20.969 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-10-14T10:16:20.969 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T10:16:20.970 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T10:16:20.970 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T10:16:20.970 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-10-14T10:16:20.999 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-10-14T10:16:21.016 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-10-14T10:16:21.017 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-10-14T10:16:21.073 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2023-10-14T10:16:21.074 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2023-10-14T10:16:21.074 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2023-10-14T10:16:21.074 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2023-10-14T10:16:21.074 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2023-10-14T10:16:21.075 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2023-10-14T10:16:21.075 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T10:16:21.075 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-10-14T10:16:21.075 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2023-10-14T10:16:21.075 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T10:16:21.076 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2023-10-14T10:16:21.076 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T10:16:21.076 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T10:16:21.076 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T10:16:21.076 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-10-14T10:16:21.099 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T10:16:21.110 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T10:16:21.141 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T10:16:21.142 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2023-10-14T10:16:21.145 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2023-10-14T10:16:21.161 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T10:16:21.169 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T10:16:21.169 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2023-10-14T10:16:21.202 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2023-10-14T10:16:21.311 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T10:16:21.369 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T10:16:21.395 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-14T10:16:21.396 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-10-14T10:16:21.396 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-14T10:16:21.397 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T10:16:21.397 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T10:16:21.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T10:16:21.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-10-14T10:16:21.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T10:16:21.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-10-14T10:16:21.578 DEBUG:teuthology.task.kernel:sha1 for client.0 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:16:21.578 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-14T10:16:21.578 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-14T10:16:21.598 INFO:teuthology.orchestra.run.smithi008.stdout:5.14.0-361.el9.x86_64 2023-10-14T10:16:21.598 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:16:21.599 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-14T10:16:21.599 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum upgrade -y linux-firmware 2023-10-14T10:16:21.658 DEBUG:teuthology.task.kernel:sha1 for client.1 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:16:21.658 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-14T10:16:21.659 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2023-10-14T10:16:21.675 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-361.el9.x86_64 2023-10-14T10:16:21.676 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:16:21.676 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-14T10:16:21.676 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum upgrade -y linux-firmware 2023-10-14T10:16:23.646 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - AppStream 14 MB/s | 6.3 MB 00:00 2023-10-14T10:16:23.893 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS-9 - AppStream 14 MB/s | 6.3 MB 00:00 2023-10-14T10:16:25.097 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2023-10-14T10:16:25.578 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS-9 - BaseOS 3.1 MB/s | 2.0 MB 00:00 2023-10-14T10:16:26.380 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 7.9 MB 00:00 2023-10-14T10:16:26.917 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 7.6 MB/s | 7.9 MB 00:01 2023-10-14T10:16:28.381 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - AppStream 20 MB/s | 18 MB 00:00 2023-10-14T10:16:29.442 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 12 MB/s | 18 MB 00:01 2023-10-14T10:16:32.682 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 5.7 MB 00:00 2023-10-14T10:16:34.317 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 5.7 MB 00:01 2023-10-14T10:16:35.166 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 14 kB 00:01 2023-10-14T10:16:35.635 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 14 kB 00:00 2023-10-14T10:16:36.442 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 16 MB/s | 19 MB 00:01 2023-10-14T10:16:36.703 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 20 MB/s | 19 MB 00:00 2023-10-14T10:16:41.095 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-10-14T10:16:41.109 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2023-10-14T10:16:43.257 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T10:16:43.260 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-14T10:16:43.265 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T10:16:43.266 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T10:16:43.266 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T10:16:43.266 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-10-14T10:16:43.266 INFO:teuthology.orchestra.run.smithi008.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-14T10:16:43.267 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:16:43.267 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T10:16:43.267 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T10:16:43.267 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 1 Package 2023-10-14T10:16:43.267 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:16:43.268 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 326 M 2023-10-14T10:16:43.268 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T10:16:43.273 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-14T10:16:43.273 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-10-14T10:16:43.273 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-14T10:16:43.273 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2023-10-14T10:16:43.274 INFO:teuthology.orchestra.run.smithi092.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-14T10:16:43.274 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:16:43.274 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-14T10:16:43.274 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-10-14T10:16:43.275 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 1 Package 2023-10-14T10:16:43.275 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:16:43.275 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 326 M 2023-10-14T10:16:43.275 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-10-14T10:16:59.001 INFO:teuthology.orchestra.run.smithi008.stdout:linux-firmware-20230926-140.el9.noarch.rpm 21 MB/s | 326 MB 00:15 2023-10-14T10:16:59.002 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T10:16:59.003 INFO:teuthology.orchestra.run.smithi008.stdout:Total 21 MB/s | 326 MB 00:15 2023-10-14T10:16:59.003 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T10:16:59.104 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T10:16:59.105 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T10:16:59.784 INFO:teuthology.orchestra.run.smithi092.stdout:linux-firmware-20230926-140.el9.noarch.rpm 20 MB/s | 326 MB 00:16 2023-10-14T10:16:59.785 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-10-14T10:16:59.786 INFO:teuthology.orchestra.run.smithi092.stdout:Total 20 MB/s | 326 MB 00:16 2023-10-14T10:16:59.787 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-10-14T10:16:59.873 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-10-14T10:16:59.874 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-10-14T10:17:01.260 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T10:17:01.261 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T10:17:01.956 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-10-14T10:17:01.957 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-10-14T10:17:07.094 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T10:17:07.364 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-14T10:17:07.459 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T10:17:07.638 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-10-14T10:17:08.238 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-14T10:17:08.282 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T10:17:08.283 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-14T10:17:08.357 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T10:17:08.678 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T10:17:08.679 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:17:08.679 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-10-14T10:17:08.679 INFO:teuthology.orchestra.run.smithi008.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-14T10:17:08.679 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:17:08.680 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T10:17:08.973 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-14T10:17:08.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:17:09.066 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T10:17:09.067 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-14T10:17:09.141 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-14T10:17:09.141 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-14T10:17:09.145 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi008.front.sepia.ceph.com to complete... 2023-10-14T10:17:09.451 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T10:17:09.451 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:17:09.452 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2023-10-14T10:17:09.452 INFO:teuthology.orchestra.run.smithi092.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-14T10:17:09.452 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:17:09.452 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-14T10:17:09.752 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.1... 2023-10-14T10:17:09.752 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T10:17:09.968 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-14T10:17:09.968 DEBUG:teuthology.orchestra.run.smithi092:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-14T10:17:09.971 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi092.front.sepia.ceph.com to complete... 2023-10-14T10:17:24.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14 10:17:24 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-14T10:17:24.981 INFO:teuthology.orchestra.run.smithi008.stderr:FINISHED --2023-10-14 10:17:24-- 2023-10-14T10:17:24.981 INFO:teuthology.orchestra.run.smithi008.stderr:Total wall clock time: 16s 2023-10-14T10:17:24.982 INFO:teuthology.orchestra.run.smithi008.stderr:Downloaded: 1 files, 306M in 15s (19.8 MB/s) 2023-10-14T10:17:24.983 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-14T10:17:24.983 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-14T10:17:26.917 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying... ######################################## 2023-10-14T10:17:26.973 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing... ######################################## 2023-10-14T10:17:27.057 INFO:teuthology.orchestra.run.smithi008.stdout:Updating / installing... 2023-10-14T10:17:33.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14 10:17:33 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-14T10:17:33.622 INFO:teuthology.orchestra.run.smithi092.stderr:FINISHED --2023-10-14 10:17:33-- 2023-10-14T10:17:33.623 INFO:teuthology.orchestra.run.smithi092.stderr:Total wall clock time: 24s 2023-10-14T10:17:33.623 INFO:teuthology.orchestra.run.smithi092.stderr:Downloaded: 1 files, 306M in 23s (13.1 MB/s) 2023-10-14T10:17:33.624 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.1... 2023-10-14T10:17:33.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-14T10:17:34.483 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-14T10:17:35.460 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying... ######################################## 2023-10-14T10:17:35.520 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing... ######################################## 2023-10-14T10:17:35.600 INFO:teuthology.orchestra.run.smithi092.stdout:Updating / installing... 2023-10-14T10:17:42.677 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-14T10:17:50.117 INFO:teuthology.orchestra.run.smithi008.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-14T10:17:57.619 INFO:teuthology.orchestra.run.smithi092.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-14T10:18:12.096 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-14T10:18:12.097 DEBUG:teuthology.orchestra.run.smithi008:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-14T10:18:12.164 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T10:18:12.164 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-14T10:18:12.165 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T10:18:12.165 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-14T10:18:12.165 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-14T10:18:12.165 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-14T10:18:12.166 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-14T10:18:12.166 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-14T10:18:12.166 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-14T10:18:12.166 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-14T10:18:12.166 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-14T10:18:12.167 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-14T10:18:12.167 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-14T10:18:12.167 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-14T10:18:12.167 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-14T10:18:12.167 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-14T10:18:12.168 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-14T10:18:12.168 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-14T10:18:12.168 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-14T10:18:12.168 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-14T10:18:12.168 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-14T10:18:12.169 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-14T10:18:12.169 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-14T10:18:12.169 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-14T10:18:12.169 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-14T10:18:12.169 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-14T10:18:12.169 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-14T10:18:12.170 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-14T10:18:12.170 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-14T10:18:12.170 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-14T10:18:12.170 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-14T10:18:12.170 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-14T10:18:12.171 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-14T10:18:12.171 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-14T10:18:12.171 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-14T10:18:12.171 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-14T10:18:12.171 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-14T10:18:12.172 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-14T10:18:12.172 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-14T10:18:12.172 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-14T10:18:12.172 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-14T10:18:12.172 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-14T10:18:12.173 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-14T10:18:12.173 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-14T10:18:12.173 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-14T10:18:12.173 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-14T10:18:12.173 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-14T10:18:12.174 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-14T10:18:12.174 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-14T10:18:12.174 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-14T10:18:12.174 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-14T10:18:12.175 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-14T10:18:12.175 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-14T10:18:12.175 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-14T10:18:12.175 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-14T10:18:12.175 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-14T10:18:12.176 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-14T10:18:12.176 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-14T10:18:12.176 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-14T10:18:12.176 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-14T10:18:12.176 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-14T10:18:12.176 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-14T10:18:12.177 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-14T10:18:12.177 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-14T10:18:12.177 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-14T10:18:12.177 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-14T10:18:12.178 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-14T10:18:12.178 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-14T10:18:12.178 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-14T10:18:12.178 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-14T10:18:12.178 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-14T10:18:12.179 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-14T10:18:12.179 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-14T10:18:12.179 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-14T10:18:12.179 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-14T10:18:12.179 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-14T10:18:12.180 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-14T10:18:12.180 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-14T10:18:12.180 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-14T10:18:12.180 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-14T10:18:12.180 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-14T10:18:12.180 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-14T10:18:12.181 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-14T10:18:12.181 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-14T10:18:12.181 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-14T10:18:12.181 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-14T10:18:12.181 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-14T10:18:12.182 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-14T10:18:12.182 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-14T10:18:12.182 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-14T10:18:12.182 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-14T10:18:12.182 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-14T10:18:12.182 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-14T10:18:12.183 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-14T10:18:12.183 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-14T10:18:12.183 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-14T10:18:12.183 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-14T10:18:12.183 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-14T10:18:12.184 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-14T10:18:12.184 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-14T10:18:12.184 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-14T10:18:12.184 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-14T10:18:12.184 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-14T10:18:12.184 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-14T10:18:12.185 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-14T10:18:12.185 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-14T10:18:12.185 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-14T10:18:12.185 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-14T10:18:12.185 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-14T10:18:12.186 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-14T10:18:12.186 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-14T10:18:12.186 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-14T10:18:12.186 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-14T10:18:12.186 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-14T10:18:12.187 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-14T10:18:12.187 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-14T10:18:12.187 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-14T10:18:12.187 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-14T10:18:12.187 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-14T10:18:12.188 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-14T10:18:12.188 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-14T10:18:12.188 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-14T10:18:12.188 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-14T10:18:12.188 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-14T10:18:12.189 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-14T10:18:12.189 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-14T10:18:12.189 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-14T10:18:12.189 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-14T10:18:12.189 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-14T10:18:12.190 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-14T10:18:12.190 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-14T10:18:12.190 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-14T10:18:12.190 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-14T10:18:12.190 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-14T10:18:12.191 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-14T10:18:12.191 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-14T10:18:12.191 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-14T10:18:12.191 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-14T10:18:12.191 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-14T10:18:12.192 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-14T10:18:12.192 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-14T10:18:12.192 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-14T10:18:12.192 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-14T10:18:12.192 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-14T10:18:12.193 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-14T10:18:12.193 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-14T10:18:12.193 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-14T10:18:12.193 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-14T10:18:12.193 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-14T10:18:12.193 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-14T10:18:12.194 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-14T10:18:12.194 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-14T10:18:12.194 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-14T10:18:12.194 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-14T10:18:12.194 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-14T10:18:12.195 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-14T10:18:12.195 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-14T10:18:12.195 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-14T10:18:12.195 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-14T10:18:12.195 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-14T10:18:12.196 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-14T10:18:12.196 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-14T10:18:12.196 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-14T10:18:12.196 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-14T10:18:12.196 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-14T10:18:12.197 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-14T10:18:12.197 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-14T10:18:12.197 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-14T10:18:12.197 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-14T10:18:12.197 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-14T10:18:12.197 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-14T10:18:12.198 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-14T10:18:12.198 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-14T10:18:12.198 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-14T10:18:12.198 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-14T10:18:12.198 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-14T10:18:12.199 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-14T10:18:12.199 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-14T10:18:12.199 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-14T10:18:12.199 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-14T10:18:12.199 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-14T10:18:12.200 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-14T10:18:12.200 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-14T10:18:12.200 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-14T10:18:12.200 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-14T10:18:12.200 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-14T10:18:12.201 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-14T10:18:12.201 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-14T10:18:12.201 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-14T10:18:12.201 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-14T10:18:12.201 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-14T10:18:12.201 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-14T10:18:12.202 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-14T10:18:12.202 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-14T10:18:12.202 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-14T10:18:12.202 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-14T10:18:12.202 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-14T10:18:12.203 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-14T10:18:12.203 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-14T10:18:12.203 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-14T10:18:12.203 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-14T10:18:12.203 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-14T10:18:12.204 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-14T10:18:12.204 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-14T10:18:12.204 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-14T10:18:12.204 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-14T10:18:12.204 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-14T10:18:12.205 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-14T10:18:12.205 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-14T10:18:12.205 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-14T10:18:12.205 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-14T10:18:12.205 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-14T10:18:12.205 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-14T10:18:12.206 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-14T10:18:12.206 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-14T10:18:12.206 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-14T10:18:12.206 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-14T10:18:12.206 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-14T10:18:12.207 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-14T10:18:12.207 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-14T10:18:12.207 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-14T10:18:12.207 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-14T10:18:12.207 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-14T10:18:12.208 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-14T10:18:12.208 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-14T10:18:12.208 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-14T10:18:12.208 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-14T10:18:12.208 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-14T10:18:12.209 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-14T10:18:12.209 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-14T10:18:12.209 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-14T10:18:12.209 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-14T10:18:12.209 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-14T10:18:12.209 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-14T10:18:12.210 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-14T10:18:12.210 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-14T10:18:12.210 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-14T10:18:12.210 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-14T10:18:12.210 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-14T10:18:12.211 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-14T10:18:12.211 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-14T10:18:12.211 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-14T10:18:12.211 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-14T10:18:12.212 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-14T10:18:12.212 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-14T10:18:12.212 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-14T10:18:12.212 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-14T10:18:12.212 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-14T10:18:12.212 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-14T10:18:12.213 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-14T10:18:12.213 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-14T10:18:12.213 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-14T10:18:12.213 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-14T10:18:12.213 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-14T10:18:12.214 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-14T10:18:12.214 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-14T10:18:12.214 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-14T10:18:12.214 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-14T10:18:12.214 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-14T10:18:12.215 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-14T10:18:12.215 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-14T10:18:12.215 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-14T10:18:12.215 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-14T10:18:12.215 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-14T10:18:12.216 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-14T10:18:12.216 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-14T10:18:12.216 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-14T10:18:12.216 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-14T10:18:12.216 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-14T10:18:12.216 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-14T10:18:12.217 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-14T10:18:12.217 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-14T10:18:12.217 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-14T10:18:12.217 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-14T10:18:12.217 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-14T10:18:12.218 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-14T10:18:12.218 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-14T10:18:12.218 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-14T10:18:12.218 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-14T10:18:12.218 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-14T10:18:12.218 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-14T10:18:12.219 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-14T10:18:12.219 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-14T10:18:12.219 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-14T10:18:12.219 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-14T10:18:12.219 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-14T10:18:12.220 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-14T10:18:12.220 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-14T10:18:12.220 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-14T10:18:12.220 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-14T10:18:12.220 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-14T10:18:12.221 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-14T10:18:12.221 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-14T10:18:12.221 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-14T10:18:12.221 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-14T10:18:12.221 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-14T10:18:12.222 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-14T10:18:12.222 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-14T10:18:12.222 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-14T10:18:12.222 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-14T10:18:12.222 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-14T10:18:12.223 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-14T10:18:12.223 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-14T10:18:12.223 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-14T10:18:12.223 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-14T10:18:12.223 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-14T10:18:12.223 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-14T10:18:12.224 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-14T10:18:12.224 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-14T10:18:12.224 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-14T10:18:12.224 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-14T10:18:12.224 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-14T10:18:12.225 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-14T10:18:12.225 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-14T10:18:12.225 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-14T10:18:12.225 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-14T10:18:12.225 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-14T10:18:12.226 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-14T10:18:12.226 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-14T10:18:12.226 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-14T10:18:12.226 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-14T10:18:12.226 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-14T10:18:12.226 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-14T10:18:12.227 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-14T10:18:12.227 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-14T10:18:12.227 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-14T10:18:12.227 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-14T10:18:12.227 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-14T10:18:12.228 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-14T10:18:12.228 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-14T10:18:12.228 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-14T10:18:12.228 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-14T10:18:12.228 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-14T10:18:12.228 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-14T10:18:12.229 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-14T10:18:12.229 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-14T10:18:12.229 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-14T10:18:12.229 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-14T10:18:12.229 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-14T10:18:12.230 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-14T10:18:12.230 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-14T10:18:12.230 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-14T10:18:12.230 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-14T10:18:12.230 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-14T10:18:12.231 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-14T10:18:12.231 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-14T10:18:12.231 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-14T10:18:12.231 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-14T10:18:12.231 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-14T10:18:12.232 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-14T10:18:12.232 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-14T10:18:12.232 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-14T10:18:12.232 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-14T10:18:12.232 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-14T10:18:12.233 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-14T10:18:12.233 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-14T10:18:12.233 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-14T10:18:12.233 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-14T10:18:12.233 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-14T10:18:12.233 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-14T10:18:12.234 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-14T10:18:12.234 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-14T10:18:12.234 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-14T10:18:12.234 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-14T10:18:12.234 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-14T10:18:12.234 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-14T10:18:12.235 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-14T10:18:12.235 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-14T10:18:12.235 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-14T10:18:12.235 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-14T10:18:12.235 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-14T10:18:12.236 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-14T10:18:12.236 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-14T10:18:12.236 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-14T10:18:12.236 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-14T10:18:12.236 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-14T10:18:12.236 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-14T10:18:12.237 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-14T10:18:12.237 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-14T10:18:12.237 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-14T10:18:12.237 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-14T10:18:12.237 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-14T10:18:12.238 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-14T10:18:12.238 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-14T10:18:12.238 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-14T10:18:12.238 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-14T10:18:12.238 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-14T10:18:12.239 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-14T10:18:12.239 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-14T10:18:12.239 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-14T10:18:12.239 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-14T10:18:12.239 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-14T10:18:12.240 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-14T10:18:12.240 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-14T10:18:12.240 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-14T10:18:12.240 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-14T10:18:12.240 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-14T10:18:12.241 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-14T10:18:12.241 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-14T10:18:12.241 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-14T10:18:12.241 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-14T10:18:12.242 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-14T10:18:12.242 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-14T10:18:12.242 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-14T10:18:12.242 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-14T10:18:12.242 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-14T10:18:12.242 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-14T10:18:12.243 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-14T10:18:12.243 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-14T10:18:12.243 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-14T10:18:12.243 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-14T10:18:12.243 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-14T10:18:12.244 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-14T10:18:12.244 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-14T10:18:12.244 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-14T10:18:12.244 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-14T10:18:12.244 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-14T10:18:12.244 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-14T10:18:12.245 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-14T10:18:12.245 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-14T10:18:12.245 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-14T10:18:12.245 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-14T10:18:12.245 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-14T10:18:12.246 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-14T10:18:12.246 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-14T10:18:12.246 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-14T10:18:12.246 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-14T10:18:12.246 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-14T10:18:12.247 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-14T10:18:12.247 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-14T10:18:12.247 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-14T10:18:12.247 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-14T10:18:12.247 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-14T10:18:12.247 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-14T10:18:12.248 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-14T10:18:12.248 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-14T10:18:12.248 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-14T10:18:12.248 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-14T10:18:12.248 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-14T10:18:12.249 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-14T10:18:12.249 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-14T10:18:12.249 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-14T10:18:12.249 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-14T10:18:12.249 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-14T10:18:12.250 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-14T10:18:12.250 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-14T10:18:12.250 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-14T10:18:12.250 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-14T10:18:12.250 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-14T10:18:12.251 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-14T10:18:12.251 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-14T10:18:12.251 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-14T10:18:12.251 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-14T10:18:12.251 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-14T10:18:12.251 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-14T10:18:12.252 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-14T10:18:12.252 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-14T10:18:12.252 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-14T10:18:12.252 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-14T10:18:12.252 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-14T10:18:12.253 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-14T10:18:12.253 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-14T10:18:12.253 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-14T10:18:12.253 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-14T10:18:12.253 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-14T10:18:12.254 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-14T10:18:12.254 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-14T10:18:12.254 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-14T10:18:12.254 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-14T10:18:12.254 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-14T10:18:12.254 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-14T10:18:12.255 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-14T10:18:12.255 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-14T10:18:12.255 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-14T10:18:12.255 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-14T10:18:12.255 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-14T10:18:12.256 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-14T10:18:12.256 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-14T10:18:12.256 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-14T10:18:12.256 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-14T10:18:12.256 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-14T10:18:12.257 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-14T10:18:12.257 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-14T10:18:12.257 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-14T10:18:12.257 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-14T10:18:12.257 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-14T10:18:12.258 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-14T10:18:12.258 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-14T10:18:12.258 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-14T10:18:12.258 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-14T10:18:12.258 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-14T10:18:12.258 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-14T10:18:12.259 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-14T10:18:12.259 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-14T10:18:12.259 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-14T10:18:12.259 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-14T10:18:12.259 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-14T10:18:12.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-14T10:18:12.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-14T10:18:12.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-14T10:18:12.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-14T10:18:12.260 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-14T10:18:12.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-14T10:18:12.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-14T10:18:12.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-14T10:18:12.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-14T10:18:12.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-14T10:18:12.261 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-14T10:18:12.262 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-14T10:18:12.262 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-14T10:18:12.262 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-14T10:18:12.262 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-14T10:18:12.262 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-14T10:18:12.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-14T10:18:12.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-14T10:18:12.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-14T10:18:12.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-14T10:18:12.263 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-14T10:18:12.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-14T10:18:12.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-14T10:18:12.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-14T10:18:12.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-14T10:18:12.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-14T10:18:12.264 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-14T10:18:12.265 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-14T10:18:12.265 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-14T10:18:12.265 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-14T10:18:12.265 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-14T10:18:12.265 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-14T10:18:12.266 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-14T10:18:12.266 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-14T10:18:12.266 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-14T10:18:12.266 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-14T10:18:12.266 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-14T10:18:12.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-14T10:18:12.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-14T10:18:12.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-14T10:18:12.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-14T10:18:12.267 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-14T10:18:12.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-14T10:18:12.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-14T10:18:12.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-14T10:18:12.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-14T10:18:12.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-14T10:18:12.268 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-14T10:18:12.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-14T10:18:12.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-14T10:18:12.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-14T10:18:12.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-14T10:18:12.269 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-14T10:18:12.270 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-14T10:18:12.270 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-14T10:18:12.270 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-14T10:18:12.270 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-14T10:18:12.270 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-14T10:18:12.271 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-14T10:18:12.271 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-14T10:18:12.271 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-14T10:18:12.271 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-14T10:18:12.271 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-14T10:18:12.272 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-14T10:18:12.272 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-14T10:18:12.272 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-14T10:18:12.272 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-14T10:18:12.272 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-14T10:18:12.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-14T10:18:12.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-14T10:18:12.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-14T10:18:12.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-14T10:18:12.273 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-14T10:18:12.274 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-14T10:18:12.274 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-14T10:18:12.274 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-14T10:18:12.274 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-14T10:18:12.274 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-14T10:18:12.275 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-14T10:18:12.275 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-14T10:18:12.275 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-14T10:18:12.275 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-14T10:18:12.275 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-14T10:18:12.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-14T10:18:12.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-14T10:18:12.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-14T10:18:12.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-14T10:18:12.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-14T10:18:12.276 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-14T10:18:12.277 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-14T10:18:12.277 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-14T10:18:12.277 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-14T10:18:12.277 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-14T10:18:12.277 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-14T10:18:12.278 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-14T10:18:12.278 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-14T10:18:12.278 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-14T10:18:12.278 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-14T10:18:12.279 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-14T10:18:12.279 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-14T10:18:12.279 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-14T10:18:12.279 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-14T10:18:12.279 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-14T10:18:12.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-14T10:18:12.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-14T10:18:12.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-14T10:18:12.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-14T10:18:12.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-14T10:18:12.280 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-14T10:18:12.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-14T10:18:12.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-14T10:18:12.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-14T10:18:12.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-14T10:18:12.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-14T10:18:12.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-14T10:18:12.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-14T10:18:12.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-14T10:18:12.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-14T10:18:12.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-14T10:18:12.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-14T10:18:12.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-14T10:18:12.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-14T10:18:12.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-14T10:18:12.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-14T10:18:12.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-14T10:18:12.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-14T10:18:12.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-14T10:18:12.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-14T10:18:12.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-14T10:18:12.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-14T10:18:12.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-14T10:18:12.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-14T10:18:12.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-14T10:18:12.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-14T10:18:12.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-14T10:18:12.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-14T10:18:12.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-14T10:18:12.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-14T10:18:12.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-14T10:18:12.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-14T10:18:12.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-14T10:18:12.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-14T10:18:12.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-14T10:18:12.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-14T10:18:12.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-14T10:18:12.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-14T10:18:12.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-14T10:18:12.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-14T10:18:12.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-14T10:18:12.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-14T10:18:12.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-14T10:18:12.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-14T10:18:12.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-14T10:18:12.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-14T10:18:12.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-14T10:18:12.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-14T10:18:12.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-14T10:18:12.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-14T10:18:12.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-14T10:18:12.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-14T10:18:12.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-14T10:18:12.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-14T10:18:12.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-14T10:18:12.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-14T10:18:12.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-14T10:18:12.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-14T10:18:12.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-14T10:18:12.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-14T10:18:12.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-14T10:18:12.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-14T10:18:12.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-14T10:18:12.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-14T10:18:12.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-14T10:18:12.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-14T10:18:12.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-14T10:18:12.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-14T10:18:12.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-14T10:18:12.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-14T10:18:12.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-14T10:18:12.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-14T10:18:12.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-14T10:18:12.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-14T10:18:12.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-14T10:18:12.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-14T10:18:12.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-14T10:18:12.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-14T10:18:12.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-14T10:18:12.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-14T10:18:12.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-14T10:18:12.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-14T10:18:12.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-14T10:18:12.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-14T10:18:12.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-14T10:18:12.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-14T10:18:12.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-14T10:18:12.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-14T10:18:12.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-14T10:18:12.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-14T10:18:12.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-14T10:18:12.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-14T10:18:12.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-14T10:18:12.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-14T10:18:12.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-14T10:18:12.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-14T10:18:12.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-14T10:18:12.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-14T10:18:12.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-14T10:18:12.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-14T10:18:12.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-14T10:18:12.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-14T10:18:12.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-14T10:18:12.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-14T10:18:12.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-14T10:18:12.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-14T10:18:12.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-14T10:18:12.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-14T10:18:12.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-14T10:18:12.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-14T10:18:12.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-14T10:18:12.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-14T10:18:12.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-14T10:18:12.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-14T10:18:12.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-14T10:18:12.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-14T10:18:12.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-14T10:18:12.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-14T10:18:12.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-14T10:18:12.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-14T10:18:12.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-14T10:18:12.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-14T10:18:12.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-14T10:18:12.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-14T10:18:12.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-14T10:18:12.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-14T10:18:12.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-14T10:18:12.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-14T10:18:12.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-14T10:18:12.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-14T10:18:12.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-14T10:18:12.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-14T10:18:12.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-14T10:18:12.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-14T10:18:12.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-14T10:18:12.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-14T10:18:12.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-14T10:18:12.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-14T10:18:12.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-14T10:18:12.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-14T10:18:12.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-14T10:18:12.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-14T10:18:12.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-14T10:18:12.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-14T10:18:12.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-14T10:18:12.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-14T10:18:12.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-14T10:18:12.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-14T10:18:12.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-14T10:18:12.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-14T10:18:12.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-14T10:18:12.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-14T10:18:12.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-14T10:18:12.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-14T10:18:12.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-14T10:18:12.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-14T10:18:12.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-14T10:18:12.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-14T10:18:12.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-14T10:18:12.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-14T10:18:12.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-14T10:18:12.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-14T10:18:12.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-14T10:18:12.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-14T10:18:12.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-14T10:18:12.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-14T10:18:12.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-14T10:18:12.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-14T10:18:12.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-14T10:18:12.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-14T10:18:12.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-14T10:18:12.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-14T10:18:12.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-14T10:18:12.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-14T10:18:12.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-14T10:18:12.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-14T10:18:12.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-14T10:18:12.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-14T10:18:12.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-14T10:18:12.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-14T10:18:12.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-14T10:18:12.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-14T10:18:12.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-14T10:18:12.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-14T10:18:12.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-14T10:18:12.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-14T10:18:12.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-14T10:18:12.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-14T10:18:12.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-14T10:18:12.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-14T10:18:12.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-14T10:18:12.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-14T10:18:12.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-14T10:18:12.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-14T10:18:12.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-14T10:18:12.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-14T10:18:12.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-14T10:18:12.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-14T10:18:12.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-14T10:18:12.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-14T10:18:12.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-14T10:18:12.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-14T10:18:12.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-14T10:18:12.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-14T10:18:12.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-14T10:18:12.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-14T10:18:12.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-14T10:18:12.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-14T10:18:12.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-14T10:18:12.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-14T10:18:12.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-14T10:18:12.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-14T10:18:12.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-14T10:18:12.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-14T10:18:12.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-14T10:18:12.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-14T10:18:12.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-14T10:18:12.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-14T10:18:12.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-14T10:18:12.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-14T10:18:12.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-14T10:18:12.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-14T10:18:12.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-14T10:18:12.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-14T10:18:12.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-14T10:18:12.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-14T10:18:12.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-14T10:18:12.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-14T10:18:12.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-14T10:18:12.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-14T10:18:12.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-14T10:18:12.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-14T10:18:12.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-14T10:18:12.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-14T10:18:12.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-14T10:18:12.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-14T10:18:12.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-14T10:18:12.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-14T10:18:12.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-14T10:18:12.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-14T10:18:12.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-14T10:18:12.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-14T10:18:12.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-14T10:18:12.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-14T10:18:12.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-14T10:18:12.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-14T10:18:12.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-14T10:18:12.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-14T10:18:12.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-14T10:18:12.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-14T10:18:12.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-14T10:18:12.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-14T10:18:12.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-14T10:18:12.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-14T10:18:12.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-14T10:18:12.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-14T10:18:12.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-14T10:18:12.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-14T10:18:12.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-14T10:18:12.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-14T10:18:12.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-14T10:18:12.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-14T10:18:12.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-14T10:18:12.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-14T10:18:12.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-14T10:18:12.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-14T10:18:12.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-14T10:18:12.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-14T10:18:12.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-14T10:18:12.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-14T10:18:12.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-14T10:18:12.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-14T10:18:12.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-14T10:18:12.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-14T10:18:12.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-14T10:18:12.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-14T10:18:12.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-14T10:18:12.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-14T10:18:12.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-14T10:18:12.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-14T10:18:12.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-14T10:18:12.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-14T10:18:12.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-14T10:18:12.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-14T10:18:12.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-14T10:18:12.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-14T10:18:12.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-14T10:18:12.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-14T10:18:12.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-14T10:18:12.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-14T10:18:12.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-14T10:18:12.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-14T10:18:12.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-14T10:18:12.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-14T10:18:12.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-14T10:18:12.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-14T10:18:12.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-14T10:18:12.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-14T10:18:12.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-14T10:18:12.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-14T10:18:12.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-14T10:18:12.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-14T10:18:12.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-14T10:18:12.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-14T10:18:12.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-14T10:18:12.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-14T10:18:12.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-14T10:18:12.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-14T10:18:12.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-14T10:18:12.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-14T10:18:12.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-14T10:18:12.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-14T10:18:12.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-14T10:18:12.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-14T10:18:12.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-14T10:18:12.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-14T10:18:12.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-14T10:18:12.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-14T10:18:12.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-14T10:18:12.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-14T10:18:12.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-14T10:18:12.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-14T10:18:12.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-14T10:18:12.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-14T10:18:12.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-14T10:18:12.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-14T10:18:12.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-14T10:18:12.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-14T10:18:12.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-14T10:18:12.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-14T10:18:12.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-14T10:18:12.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-14T10:18:12.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-14T10:18:12.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-14T10:18:12.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-14T10:18:12.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-14T10:18:12.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-14T10:18:12.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-14T10:18:12.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-14T10:18:12.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-14T10:18:12.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-14T10:18:12.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-14T10:18:12.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-14T10:18:12.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-14T10:18:12.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-14T10:18:12.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-14T10:18:12.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-14T10:18:12.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-14T10:18:12.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-14T10:18:12.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-14T10:18:12.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-14T10:18:12.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-14T10:18:12.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-14T10:18:12.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-14T10:18:12.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-14T10:18:12.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-14T10:18:12.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-14T10:18:12.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-14T10:18:12.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-14T10:18:12.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-14T10:18:12.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-14T10:18:12.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-14T10:18:12.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-14T10:18:12.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-14T10:18:12.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-14T10:18:12.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-14T10:18:12.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-14T10:18:12.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-14T10:18:12.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-14T10:18:12.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-14T10:18:12.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-14T10:18:12.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-14T10:18:12.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-14T10:18:12.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-14T10:18:12.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-14T10:18:12.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-14T10:18:12.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-14T10:18:12.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-14T10:18:12.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-14T10:18:12.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-14T10:18:12.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-14T10:18:12.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-14T10:18:12.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-14T10:18:12.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-14T10:18:12.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-14T10:18:12.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-14T10:18:12.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-14T10:18:12.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-14T10:18:12.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-14T10:18:12.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-14T10:18:12.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-14T10:18:12.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-14T10:18:12.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-14T10:18:12.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-14T10:18:12.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-14T10:18:12.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-14T10:18:12.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-14T10:18:12.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-14T10:18:12.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-14T10:18:12.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-14T10:18:12.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-14T10:18:12.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-14T10:18:12.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-14T10:18:12.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-14T10:18:12.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-14T10:18:12.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-14T10:18:12.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-14T10:18:12.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-14T10:18:12.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-14T10:18:12.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-14T10:18:12.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-14T10:18:12.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-14T10:18:12.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-14T10:18:12.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-14T10:18:12.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-14T10:18:12.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-14T10:18:12.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-14T10:18:12.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-14T10:18:12.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-14T10:18:12.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-14T10:18:12.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-14T10:18:12.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-14T10:18:12.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-14T10:18:12.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-14T10:18:12.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-14T10:18:12.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-14T10:18:12.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-14T10:18:12.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-14T10:18:12.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-14T10:18:12.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-14T10:18:12.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-14T10:18:12.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-14T10:18:12.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-14T10:18:12.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-14T10:18:12.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-14T10:18:12.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-14T10:18:12.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-14T10:18:12.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-14T10:18:12.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-14T10:18:12.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-14T10:18:12.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-14T10:18:12.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-14T10:18:12.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-14T10:18:12.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-14T10:18:12.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-14T10:18:12.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-14T10:18:12.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-14T10:18:12.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-14T10:18:12.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-14T10:18:12.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-14T10:18:12.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-14T10:18:12.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-14T10:18:12.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-14T10:18:12.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-14T10:18:12.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-14T10:18:12.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-14T10:18:12.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-14T10:18:12.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-14T10:18:12.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-14T10:18:12.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-14T10:18:12.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-14T10:18:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-14T10:18:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-14T10:18:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-14T10:18:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-14T10:18:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-14T10:18:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-14T10:18:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-14T10:18:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-14T10:18:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-14T10:18:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-14T10:18:12.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-14T10:18:12.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-14T10:18:12.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-14T10:18:12.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-14T10:18:12.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-14T10:18:12.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-14T10:18:12.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-14T10:18:12.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-14T10:18:12.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-14T10:18:12.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-14T10:18:12.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-14T10:18:12.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-14T10:18:12.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-14T10:18:12.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-14T10:18:12.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-14T10:18:12.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-14T10:18:12.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-14T10:18:12.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-14T10:18:12.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-14T10:18:12.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-14T10:18:12.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-14T10:18:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-14T10:18:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-14T10:18:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-14T10:18:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-14T10:18:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-14T10:18:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-14T10:18:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-14T10:18:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-14T10:18:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-14T10:18:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-14T10:18:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-14T10:18:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-14T10:18:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-14T10:18:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-14T10:18:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-14T10:18:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-14T10:18:12.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-14T10:18:12.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-14T10:18:12.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-14T10:18:12.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-14T10:18:12.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-14T10:18:12.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-14T10:18:12.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-14T10:18:12.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-14T10:18:12.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-14T10:18:12.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-14T10:18:12.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-14T10:18:12.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-14T10:18:12.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-14T10:18:12.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-14T10:18:12.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-14T10:18:12.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-14T10:18:12.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-14T10:18:12.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-14T10:18:12.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-14T10:18:12.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-14T10:18:12.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-14T10:18:12.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-14T10:18:12.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-14T10:18:12.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-14T10:18:12.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-14T10:18:12.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-14T10:18:12.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-14T10:18:12.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-14T10:18:12.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-14T10:18:12.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-14T10:18:12.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-14T10:18:12.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-14T10:18:12.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-14T10:18:12.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-14T10:18:12.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-14T10:18:12.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-14T10:18:12.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-14T10:18:12.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-14T10:18:12.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-14T10:18:12.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-14T10:18:12.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-14T10:18:12.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-14T10:18:12.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-14T10:18:12.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-14T10:18:12.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-14T10:18:12.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-14T10:18:12.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-14T10:18:12.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-14T10:18:12.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-14T10:18:12.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-14T10:18:12.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-14T10:18:12.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-14T10:18:12.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-14T10:18:12.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-14T10:18:12.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-14T10:18:12.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-14T10:18:12.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-14T10:18:12.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-14T10:18:12.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-14T10:18:12.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-14T10:18:12.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-14T10:18:12.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-14T10:18:12.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-14T10:18:12.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-14T10:18:12.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-14T10:18:12.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-14T10:18:12.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-14T10:18:12.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-14T10:18:12.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-14T10:18:12.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-14T10:18:12.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-14T10:18:12.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-14T10:18:12.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-14T10:18:12.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-14T10:18:12.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-14T10:18:12.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-14T10:18:12.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-14T10:18:12.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-14T10:18:12.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-14T10:18:12.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-14T10:18:12.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-14T10:18:12.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-14T10:18:12.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-14T10:18:12.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-14T10:18:12.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-14T10:18:12.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-14T10:18:12.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-14T10:18:12.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-14T10:18:12.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-14T10:18:12.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-14T10:18:12.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-14T10:18:12.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-14T10:18:12.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-14T10:18:12.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-14T10:18:12.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-14T10:18:12.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-14T10:18:12.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-14T10:18:12.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-14T10:18:12.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-14T10:18:12.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-14T10:18:12.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-14T10:18:12.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-14T10:18:12.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-14T10:18:12.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-14T10:18:12.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-14T10:18:12.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-14T10:18:12.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-14T10:18:12.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-14T10:18:12.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-14T10:18:12.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-14T10:18:12.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-14T10:18:12.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-14T10:18:12.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-14T10:18:12.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-14T10:18:12.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-14T10:18:12.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-14T10:18:12.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-14T10:18:12.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-14T10:18:12.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-14T10:18:12.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-14T10:18:12.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-14T10:18:12.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-14T10:18:12.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-14T10:18:12.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-14T10:18:12.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-14T10:18:12.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-14T10:18:12.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-14T10:18:12.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-14T10:18:12.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-14T10:18:12.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-14T10:18:12.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-14T10:18:12.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-14T10:18:12.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-14T10:18:12.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-14T10:18:12.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-14T10:18:12.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-14T10:18:12.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-14T10:18:12.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-14T10:18:12.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-14T10:18:12.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-14T10:18:12.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-14T10:18:12.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-14T10:18:12.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-14T10:18:12.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-14T10:18:12.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-14T10:18:12.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-14T10:18:12.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-14T10:18:12.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-14T10:18:12.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-14T10:18:12.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-14T10:18:12.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-14T10:18:12.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-14T10:18:12.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-14T10:18:12.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-14T10:18:12.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-14T10:18:12.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-14T10:18:12.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-14T10:18:12.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-14T10:18:12.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-14T10:18:12.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-14T10:18:12.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-14T10:18:12.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-14T10:18:12.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-14T10:18:12.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-14T10:18:12.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-14T10:18:12.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-14T10:18:12.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-14T10:18:12.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-14T10:18:12.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-14T10:18:12.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-14T10:18:12.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-14T10:18:12.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-14T10:18:12.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-14T10:18:12.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-14T10:18:12.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-14T10:18:12.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-14T10:18:12.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-14T10:18:12.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-14T10:18:12.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-14T10:18:12.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-14T10:18:12.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-14T10:18:12.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-14T10:18:12.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-14T10:18:12.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-14T10:18:12.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-14T10:18:12.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-14T10:18:12.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-14T10:18:12.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-14T10:18:12.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-14T10:18:12.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-14T10:18:12.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-14T10:18:12.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-14T10:18:12.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-14T10:18:12.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-14T10:18:12.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-14T10:18:12.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-14T10:18:12.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-14T10:18:12.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-14T10:18:12.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-14T10:18:12.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-14T10:18:12.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-14T10:18:12.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-14T10:18:12.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-14T10:18:12.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-14T10:18:12.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-14T10:18:12.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-14T10:18:12.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-14T10:18:12.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-14T10:18:12.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-14T10:18:12.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-14T10:18:12.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-14T10:18:12.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-14T10:18:12.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-14T10:18:12.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-14T10:18:12.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-14T10:18:12.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-14T10:18:12.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-14T10:18:12.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-14T10:18:12.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-14T10:18:12.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-14T10:18:12.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-14T10:18:12.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-14T10:18:12.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-14T10:18:12.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-14T10:18:12.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-14T10:18:12.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-14T10:18:12.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-14T10:18:12.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-14T10:18:12.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-14T10:18:12.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-14T10:18:12.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-14T10:18:12.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-14T10:18:12.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-14T10:18:12.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-14T10:18:12.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-14T10:18:12.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-14T10:18:12.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-14T10:18:12.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-14T10:18:12.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-14T10:18:12.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-14T10:18:12.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-14T10:18:12.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-14T10:18:12.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-14T10:18:12.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-14T10:18:12.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-14T10:18:12.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-14T10:18:12.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-14T10:18:12.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-14T10:18:12.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-14T10:18:12.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-14T10:18:12.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-14T10:18:12.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-14T10:18:12.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-14T10:18:12.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-14T10:18:12.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-14T10:18:12.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-14T10:18:12.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-14T10:18:12.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-14T10:18:12.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-14T10:18:12.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-14T10:18:12.429 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-14T10:18:12.429 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-14T10:18:12.429 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-14T10:18:12.429 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-14T10:18:12.429 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-14T10:18:12.430 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-14T10:18:12.430 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-14T10:18:12.430 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-14T10:18:12.430 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-14T10:18:12.430 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-14T10:18:12.431 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-14T10:18:12.431 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-14T10:18:12.431 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-14T10:18:12.431 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-14T10:18:12.431 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-14T10:18:12.431 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-14T10:18:12.432 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-14T10:18:12.432 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-14T10:18:12.432 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-14T10:18:12.432 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-14T10:18:12.432 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-14T10:18:12.433 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-14T10:18:12.433 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-14T10:18:12.433 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-14T10:18:12.433 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-14T10:18:12.433 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-14T10:18:12.434 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-14T10:18:12.434 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-14T10:18:12.434 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-14T10:18:12.434 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-14T10:18:12.434 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-14T10:18:12.435 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-14T10:18:12.435 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-14T10:18:12.435 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-14T10:18:12.435 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-14T10:18:12.435 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-14T10:18:12.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-14T10:18:12.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-14T10:18:12.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-14T10:18:12.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-14T10:18:12.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-14T10:18:12.436 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-14T10:18:12.437 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-14T10:18:12.437 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-14T10:18:12.437 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-14T10:18:12.437 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-14T10:18:12.437 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-14T10:18:12.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-14T10:18:12.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-14T10:18:12.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-14T10:18:12.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-14T10:18:12.438 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-14T10:18:12.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-14T10:18:12.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-14T10:18:12.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-14T10:18:12.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-14T10:18:12.439 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-14T10:18:12.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-14T10:18:12.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-14T10:18:12.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-14T10:18:12.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-14T10:18:12.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-14T10:18:12.440 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-14T10:18:12.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-14T10:18:12.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-14T10:18:12.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-14T10:18:12.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-14T10:18:12.441 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-14T10:18:12.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-14T10:18:12.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-14T10:18:12.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-14T10:18:12.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-14T10:18:12.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-14T10:18:12.442 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-14T10:18:12.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-14T10:18:12.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-14T10:18:12.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-14T10:18:12.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-14T10:18:12.443 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-14T10:18:12.444 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-14T10:18:12.444 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-14T10:18:12.444 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-14T10:18:12.444 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-14T10:18:12.444 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-14T10:18:12.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-14T10:18:12.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-14T10:18:12.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-14T10:18:12.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-14T10:18:12.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-14T10:18:12.445 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-14T10:18:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-14T10:18:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-14T10:18:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-14T10:18:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-14T10:18:12.446 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-14T10:18:12.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-14T10:18:12.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-14T10:18:12.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-14T10:18:12.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-14T10:18:12.447 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-14T10:18:12.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-14T10:18:12.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-14T10:18:12.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-14T10:18:12.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-14T10:18:12.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-14T10:18:12.448 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-14T10:18:12.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-14T10:18:12.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-14T10:18:12.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-14T10:18:12.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-14T10:18:12.449 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-14T10:18:12.450 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-14T10:18:12.450 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-14T10:18:12.450 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-14T10:18:12.450 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-14T10:18:12.450 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-14T10:18:12.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-14T10:18:12.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-14T10:18:12.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-14T10:18:12.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-14T10:18:12.451 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-14T10:18:12.452 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-14T10:18:12.452 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-14T10:18:12.452 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-14T10:18:12.452 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-14T10:18:12.452 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-14T10:18:12.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-14T10:18:12.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-14T10:18:12.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-14T10:18:12.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-14T10:18:12.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-14T10:18:12.453 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-14T10:18:12.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-14T10:18:12.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-14T10:18:12.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-14T10:18:12.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-14T10:18:12.454 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-14T10:18:12.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-14T10:18:12.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-14T10:18:12.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-14T10:18:12.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-14T10:18:12.455 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-14T10:18:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-14T10:18:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-14T10:18:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-14T10:18:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-14T10:18:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-14T10:18:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-14T10:18:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-14T10:18:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-14T10:18:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-14T10:18:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-14T10:18:12.457 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-14T10:18:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-14T10:18:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-14T10:18:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-14T10:18:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-14T10:18:12.458 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-14T10:18:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-14T10:18:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-14T10:18:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-14T10:18:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-14T10:18:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-14T10:18:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-14T10:18:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-14T10:18:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-14T10:18:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-14T10:18:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-14T10:18:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-14T10:18:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-14T10:18:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-14T10:18:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-14T10:18:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-14T10:18:12.461 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-14T10:18:12.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-14T10:18:12.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-14T10:18:12.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-14T10:18:12.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-14T10:18:12.462 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-14T10:18:12.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-14T10:18:12.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-14T10:18:12.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-14T10:18:12.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-14T10:18:12.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-14T10:18:12.463 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-14T10:18:12.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-14T10:18:12.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-14T10:18:12.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-14T10:18:12.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-14T10:18:12.464 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-14T10:18:12.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-14T10:18:12.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-14T10:18:12.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-14T10:18:12.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-14T10:18:12.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-14T10:18:12.465 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-14T10:18:12.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-14T10:18:12.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-14T10:18:12.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-14T10:18:12.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-14T10:18:12.466 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-14T10:18:12.467 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-14T10:18:12.467 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-14T10:18:12.467 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-14T10:18:12.467 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-14T10:18:12.467 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-14T10:18:12.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-14T10:18:12.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-14T10:18:12.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-14T10:18:12.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-14T10:18:12.468 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-14T10:18:12.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-14T10:18:12.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-14T10:18:12.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-14T10:18:12.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-14T10:18:12.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-14T10:18:12.469 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-14T10:18:12.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-14T10:18:12.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-14T10:18:12.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-14T10:18:12.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-14T10:18:12.470 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-14T10:18:12.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-14T10:18:12.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-14T10:18:12.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-14T10:18:12.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-14T10:18:12.471 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-14T10:18:12.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-14T10:18:12.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-14T10:18:12.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-14T10:18:12.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-14T10:18:12.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-14T10:18:12.472 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-14T10:18:12.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-14T10:18:12.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-14T10:18:12.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-14T10:18:12.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-14T10:18:12.473 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-14T10:18:12.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-14T10:18:12.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-14T10:18:12.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-14T10:18:12.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-14T10:18:12.474 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-14T10:18:12.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-14T10:18:12.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-14T10:18:12.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-14T10:18:12.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-14T10:18:12.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-14T10:18:12.475 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-14T10:18:12.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-14T10:18:12.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-14T10:18:12.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-14T10:18:12.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-14T10:18:12.476 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-14T10:18:12.477 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-14T10:18:12.477 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-14T10:18:12.477 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-14T10:18:12.477 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-14T10:18:12.477 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-14T10:18:12.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-14T10:18:12.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-14T10:18:12.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-14T10:18:12.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-14T10:18:12.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-14T10:18:12.478 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-14T10:18:12.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-14T10:18:12.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-14T10:18:12.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-14T10:18:12.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-14T10:18:12.479 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-14T10:18:12.480 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-14T10:18:12.480 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-14T10:18:12.480 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-14T10:18:12.480 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-14T10:18:12.480 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-14T10:18:12.481 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-14T10:18:12.481 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-14T10:18:12.481 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-14T10:18:12.481 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-14T10:18:12.481 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-14T10:18:12.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-14T10:18:12.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-14T10:18:12.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-14T10:18:12.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-14T10:18:12.482 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-14T10:18:12.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-14T10:18:12.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-14T10:18:12.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-14T10:18:12.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-14T10:18:12.483 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-14T10:18:12.484 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-14T10:18:12.484 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-14T10:18:12.484 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-14T10:18:12.484 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-14T10:18:12.484 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-14T10:18:12.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-14T10:18:12.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-14T10:18:12.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-14T10:18:12.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-14T10:18:12.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-14T10:18:12.485 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-14T10:18:12.486 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-14T10:18:12.486 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-14T10:18:12.486 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-14T10:18:12.486 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-14T10:18:12.486 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-14T10:18:12.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-14T10:18:12.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-14T10:18:12.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-14T10:18:12.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-14T10:18:12.487 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-14T10:18:12.488 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-14T10:18:12.488 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-14T10:18:12.488 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-14T10:18:12.488 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-14T10:18:12.488 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-14T10:18:12.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-14T10:18:12.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-14T10:18:12.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-14T10:18:12.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-14T10:18:12.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-14T10:18:12.489 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-14T10:18:12.490 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-14T10:18:12.490 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-14T10:18:12.490 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-14T10:18:12.490 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-14T10:18:12.490 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-14T10:18:12.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-14T10:18:12.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-14T10:18:12.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-14T10:18:12.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-14T10:18:12.491 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-14T10:18:12.492 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-14T10:18:12.492 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-14T10:18:12.492 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-14T10:18:12.492 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-14T10:18:12.492 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-14T10:18:12.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-14T10:18:12.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-14T10:18:12.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-14T10:18:12.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-14T10:18:12.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-14T10:18:12.493 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-14T10:18:12.494 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-14T10:18:12.494 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-14T10:18:12.494 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-14T10:18:12.494 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-14T10:18:12.494 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-14T10:18:12.495 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-14T10:18:12.495 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-14T10:18:12.495 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-14T10:18:12.495 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-14T10:18:12.495 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-14T10:18:12.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-14T10:18:12.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-14T10:18:12.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-14T10:18:12.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-14T10:18:12.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-14T10:18:12.496 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-14T10:18:12.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-14T10:18:12.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-14T10:18:12.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-14T10:18:12.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-14T10:18:12.497 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-14T10:18:12.498 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-14T10:18:12.498 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-14T10:18:12.498 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-14T10:18:12.498 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-14T10:18:12.498 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-14T10:18:12.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-14T10:18:12.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-14T10:18:12.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-14T10:18:12.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-14T10:18:12.499 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-14T10:18:12.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-14T10:18:12.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-14T10:18:12.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-14T10:18:12.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-14T10:18:12.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-14T10:18:12.500 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-14T10:18:12.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-14T10:18:12.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-14T10:18:12.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-14T10:18:12.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-14T10:18:12.501 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-14T10:18:12.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-14T10:18:12.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-14T10:18:12.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-14T10:18:12.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-14T10:18:12.502 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-14T10:18:12.503 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-14T10:18:12.503 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-14T10:18:12.503 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-14T10:18:12.503 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-14T10:18:12.503 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-14T10:18:12.504 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-14T10:18:12.504 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-14T10:18:12.504 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-14T10:18:12.504 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-14T10:18:12.504 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-14T10:18:12.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-14T10:18:12.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-14T10:18:12.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-14T10:18:12.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-14T10:18:12.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-14T10:18:12.505 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-14T10:18:12.506 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-14T10:18:12.506 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-14T10:18:12.506 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-14T10:18:12.506 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-14T10:18:12.506 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-14T10:18:12.507 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-14T10:18:12.507 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-14T10:18:12.507 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-14T10:18:12.507 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-14T10:18:12.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-14T10:18:12.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-14T10:18:12.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-14T10:18:12.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-14T10:18:12.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-14T10:18:12.508 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-14T10:18:12.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-14T10:18:12.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-14T10:18:12.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-14T10:18:12.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-14T10:18:12.509 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-14T10:18:12.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-14T10:18:12.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-14T10:18:12.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-14T10:18:12.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-14T10:18:12.510 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-14T10:18:12.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-14T10:18:12.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-14T10:18:12.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-14T10:18:12.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-14T10:18:12.511 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-14T10:18:12.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-14T10:18:12.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-14T10:18:12.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-14T10:18:12.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-14T10:18:12.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-14T10:18:12.512 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-14T10:18:12.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-14T10:18:12.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-14T10:18:12.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-14T10:18:12.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-14T10:18:12.513 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-14T10:18:12.514 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-14T10:18:12.514 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-14T10:18:12.514 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-14T10:18:12.514 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-14T10:18:12.514 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-14T10:18:12.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-14T10:18:12.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-14T10:18:12.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-14T10:18:12.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-14T10:18:12.515 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-14T10:18:12.516 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-14T10:18:12.516 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-14T10:18:12.516 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-14T10:18:12.516 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-14T10:18:12.516 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-14T10:18:12.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-14T10:18:12.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-14T10:18:12.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-14T10:18:12.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-14T10:18:12.517 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-14T10:18:12.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-14T10:18:12.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-14T10:18:12.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-14T10:18:12.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-14T10:18:12.518 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-14T10:18:12.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-14T10:18:12.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-14T10:18:12.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-14T10:18:12.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-14T10:18:12.519 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-14T10:18:12.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-14T10:18:12.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-14T10:18:12.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-14T10:18:12.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-14T10:18:12.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-14T10:18:12.520 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-14T10:18:12.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-14T10:18:12.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-14T10:18:12.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-14T10:18:12.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-14T10:18:12.521 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-14T10:18:12.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-14T10:18:12.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-14T10:18:12.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-14T10:18:12.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-14T10:18:12.522 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-14T10:18:12.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-14T10:18:12.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-14T10:18:12.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-14T10:18:12.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-14T10:18:12.523 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-14T10:18:12.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-14T10:18:12.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-14T10:18:12.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-14T10:18:12.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-14T10:18:12.524 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-14T10:18:12.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-14T10:18:12.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-14T10:18:12.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-14T10:18:12.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-14T10:18:12.525 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-14T10:18:12.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-14T10:18:12.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-14T10:18:12.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-14T10:18:12.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-14T10:18:12.526 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-14T10:18:12.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-14T10:18:12.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-14T10:18:12.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-14T10:18:12.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-14T10:18:12.527 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-14T10:18:12.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-14T10:18:12.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-14T10:18:12.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-14T10:18:12.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-14T10:18:12.528 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-14T10:18:12.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-14T10:18:12.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-14T10:18:12.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-14T10:18:12.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-14T10:18:12.529 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-14T10:18:12.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-14T10:18:12.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-14T10:18:12.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-14T10:18:12.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-14T10:18:12.530 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-14T10:18:12.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-14T10:18:12.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-14T10:18:12.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-14T10:18:12.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-14T10:18:12.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-14T10:18:12.531 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-14T10:18:12.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-14T10:18:12.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-14T10:18:12.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-14T10:18:12.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-14T10:18:12.532 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-14T10:18:12.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-14T10:18:12.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-14T10:18:12.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-14T10:18:12.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-14T10:18:12.533 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-14T10:18:12.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-14T10:18:12.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-14T10:18:12.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-14T10:18:12.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-14T10:18:12.534 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-14T10:18:12.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-14T10:18:12.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-14T10:18:12.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-14T10:18:12.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-14T10:18:12.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-14T10:18:12.535 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-14T10:18:12.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-14T10:18:12.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-14T10:18:12.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-14T10:18:12.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-14T10:18:12.536 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-14T10:18:12.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-14T10:18:12.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-14T10:18:12.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-14T10:18:12.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-14T10:18:12.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-14T10:18:12.537 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-14T10:18:12.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-14T10:18:12.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-14T10:18:12.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-14T10:18:12.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-14T10:18:12.538 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-14T10:18:12.539 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-14T10:18:12.539 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-14T10:18:12.540 DEBUG:teuthology.orchestra.run.smithi008:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-14T10:18:12.563 INFO:teuthology.orchestra.run.smithi008.stdout:postinstall scriptlet (using /bin/sh): 2023-10-14T10:18:12.564 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-14T10:18:12.564 INFO:teuthology.orchestra.run.smithi008.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-14T10:18:12.564 INFO:teuthology.orchestra.run.smithi008.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T10:18:12.564 INFO:teuthology.orchestra.run.smithi008.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T10:18:12.565 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T10:18:12.565 INFO:teuthology.orchestra.run.smithi008.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T10:18:12.565 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-10-14T10:18:12.565 INFO:teuthology.orchestra.run.smithi008.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-14T10:18:12.566 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-14T10:18:12.566 INFO:teuthology.orchestra.run.smithi008.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-14T10:18:12.566 INFO:teuthology.orchestra.run.smithi008.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-14T10:18:12.566 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-14T10:18:12.566 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-10-14T10:18:12.567 INFO:teuthology.orchestra.run.smithi008.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-14T10:18:12.567 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-14T10:18:12.567 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-14T10:18:12.567 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-10-14T10:18:12.568 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2023-10-14T10:18:12.648 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2023-10-14T10:18:12.649 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2023-10-14T10:18:12.649 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.06 2023-10-14T10:18:12.649 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 68.el9 2023-10-14T10:18:12.649 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2023-10-14T10:18:12.650 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-14T10:18:12.650 INFO:teuthology.orchestra.run.smithi008.stdout:Group : Unspecified 2023-10-14T10:18:12.650 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 8264254 2023-10-14T10:18:12.650 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2023-10-14T10:18:12.650 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-14T10:18:12.651 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-14T10:18:12.651 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-14T10:18:12.651 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-14T10:18:12.651 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : builder@centos.org 2023-10-14T10:18:12.651 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : CentOS 2023-10-14T10:18:12.652 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T10:18:12.652 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2023-10-14T10:18:12.652 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2023-10-14T10:18:12.652 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:18:12.652 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T10:18:12.653 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T10:18:12.653 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T10:18:12.653 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2023-10-14T10:18:12.653 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:18:12.653 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T10:18:12.654 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T10:18:12.655 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 6.6.0-rc5-g47672119149b 2023-10-14T10:18:12.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T10:18:13.200 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2023-10-14T10:18:14.628 INFO:teuthology.orchestra.run.smithi008.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-14T10:18:14.656 INFO:teuthology.orchestra.run.smithi008.stderr:done 2023-10-14T10:18:14.658 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-10-14T10:18:14.674 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.pXVXoUdrkH 2023-10-14T10:18:14.674 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pXVXoUdrkH 2023-10-14T10:18:14.749 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.pXVXoUdrkH 2023-10-14T10:18:14.895 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.pXVXoUdrkH is 6KB 2023-10-14T10:18:14.944 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.pXVXoUdrkH 2023-10-14T10:18:14.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T10:18:15.027 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-14T10:18:15.028 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-14T10:18:15.028 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-14T10:18:15.028 INFO:teuthology.orchestra.run.smithi008.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-14T10:18:15.029 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-14T10:18:15.195 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2023-10-14T10:18:18.916 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-14T10:18:18.917 DEBUG:teuthology.orchestra.run.smithi092:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-14T10:18:18.991 INFO:teuthology.orchestra.run.smithi092.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T10:18:18.991 INFO:teuthology.orchestra.run.smithi092.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-14T10:18:18.991 INFO:teuthology.orchestra.run.smithi092.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T10:18:18.992 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-14T10:18:18.992 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-14T10:18:18.993 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-14T10:18:18.993 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-14T10:18:18.993 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-14T10:18:18.993 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-14T10:18:18.993 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-14T10:18:18.994 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-14T10:18:18.994 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-14T10:18:18.994 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-14T10:18:18.994 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-14T10:18:18.994 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-14T10:18:18.995 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-14T10:18:18.995 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-14T10:18:18.995 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-14T10:18:18.995 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-14T10:18:18.995 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-14T10:18:18.995 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-14T10:18:18.996 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-14T10:18:18.996 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-14T10:18:18.996 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-14T10:18:18.996 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-14T10:18:18.996 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-14T10:18:18.997 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-14T10:18:18.997 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-14T10:18:18.997 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-14T10:18:18.997 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-14T10:18:18.997 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-14T10:18:18.998 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-14T10:18:18.998 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-14T10:18:18.998 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-14T10:18:18.998 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-14T10:18:18.998 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-14T10:18:18.999 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-14T10:18:18.999 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-14T10:18:18.999 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-14T10:18:18.999 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-14T10:18:18.999 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-14T10:18:19.000 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-14T10:18:19.000 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-14T10:18:19.000 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-14T10:18:19.000 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-14T10:18:19.000 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-14T10:18:19.000 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-14T10:18:19.001 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-14T10:18:19.001 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-14T10:18:19.001 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-14T10:18:19.001 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-14T10:18:19.001 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-14T10:18:19.002 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-14T10:18:19.002 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-14T10:18:19.002 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-14T10:18:19.003 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-14T10:18:19.003 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-14T10:18:19.003 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-14T10:18:19.003 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-14T10:18:19.004 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-14T10:18:19.004 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-14T10:18:19.004 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-14T10:18:19.004 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-14T10:18:19.004 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-14T10:18:19.005 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-14T10:18:19.005 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-14T10:18:19.005 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-14T10:18:19.005 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-14T10:18:19.005 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-14T10:18:19.006 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-14T10:18:19.006 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-14T10:18:19.006 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-14T10:18:19.006 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-14T10:18:19.006 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-14T10:18:19.007 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-14T10:18:19.007 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-14T10:18:19.007 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-14T10:18:19.007 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-14T10:18:19.007 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-14T10:18:19.007 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-14T10:18:19.008 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-14T10:18:19.008 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-14T10:18:19.008 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-14T10:18:19.008 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-14T10:18:19.008 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-14T10:18:19.009 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-14T10:18:19.009 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-14T10:18:19.009 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-14T10:18:19.009 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-14T10:18:19.009 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-14T10:18:19.010 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-14T10:18:19.010 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-14T10:18:19.010 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-14T10:18:19.010 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-14T10:18:19.010 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-14T10:18:19.011 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-14T10:18:19.011 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-14T10:18:19.011 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-14T10:18:19.011 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-14T10:18:19.011 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-14T10:18:19.012 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-14T10:18:19.012 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-14T10:18:19.012 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-14T10:18:19.012 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-14T10:18:19.012 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-14T10:18:19.013 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-14T10:18:19.013 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-14T10:18:19.013 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-14T10:18:19.014 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-14T10:18:19.014 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-14T10:18:19.014 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-14T10:18:19.014 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-14T10:18:19.015 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-14T10:18:19.015 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-14T10:18:19.015 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-14T10:18:19.015 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-14T10:18:19.015 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-14T10:18:19.016 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-14T10:18:19.016 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-14T10:18:19.016 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-14T10:18:19.016 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-14T10:18:19.017 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-14T10:18:19.017 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-14T10:18:19.017 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-14T10:18:19.017 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-14T10:18:19.017 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-14T10:18:19.018 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-14T10:18:19.018 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-14T10:18:19.018 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-14T10:18:19.018 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-14T10:18:19.019 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-14T10:18:19.019 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-14T10:18:19.019 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-14T10:18:19.019 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-14T10:18:19.019 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-14T10:18:19.019 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-14T10:18:19.020 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-14T10:18:19.020 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-14T10:18:19.021 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-14T10:18:19.021 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-14T10:18:19.021 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-14T10:18:19.022 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-14T10:18:19.022 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-14T10:18:19.022 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-14T10:18:19.022 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-14T10:18:19.023 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-14T10:18:19.023 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-14T10:18:19.023 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-14T10:18:19.023 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-14T10:18:19.023 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-14T10:18:19.024 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-14T10:18:19.024 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-14T10:18:19.024 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-14T10:18:19.024 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-14T10:18:19.024 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-14T10:18:19.025 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-14T10:18:19.025 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-14T10:18:19.025 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-14T10:18:19.025 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-14T10:18:19.025 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-14T10:18:19.025 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-14T10:18:19.026 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-14T10:18:19.026 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-14T10:18:19.026 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-14T10:18:19.026 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-14T10:18:19.026 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-14T10:18:19.027 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-14T10:18:19.027 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-14T10:18:19.027 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-14T10:18:19.027 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-14T10:18:19.027 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-14T10:18:19.028 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-14T10:18:19.028 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-14T10:18:19.028 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-14T10:18:19.028 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-14T10:18:19.028 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-14T10:18:19.029 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-14T10:18:19.029 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-14T10:18:19.029 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-14T10:18:19.029 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-14T10:18:19.029 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-14T10:18:19.029 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-14T10:18:19.030 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-14T10:18:19.030 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-14T10:18:19.030 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-14T10:18:19.030 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-14T10:18:19.030 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-14T10:18:19.031 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-14T10:18:19.031 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-14T10:18:19.031 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-14T10:18:19.031 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-14T10:18:19.032 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-14T10:18:19.032 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-14T10:18:19.032 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-14T10:18:19.032 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-14T10:18:19.032 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-14T10:18:19.033 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-14T10:18:19.033 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-14T10:18:19.033 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-14T10:18:19.033 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-14T10:18:19.033 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-14T10:18:19.034 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-14T10:18:19.034 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-14T10:18:19.034 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-14T10:18:19.034 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-14T10:18:19.034 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-14T10:18:19.034 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-14T10:18:19.035 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-14T10:18:19.035 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-14T10:18:19.035 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-14T10:18:19.035 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-14T10:18:19.035 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-14T10:18:19.036 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-14T10:18:19.036 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-14T10:18:19.036 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-14T10:18:19.036 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-14T10:18:19.036 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-14T10:18:19.037 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-14T10:18:19.037 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-14T10:18:19.037 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-14T10:18:19.037 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-14T10:18:19.037 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-14T10:18:19.037 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-14T10:18:19.038 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-14T10:18:19.038 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-14T10:18:19.038 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-14T10:18:19.038 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-14T10:18:19.038 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-14T10:18:19.039 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-14T10:18:19.039 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-14T10:18:19.039 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-14T10:18:19.039 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-14T10:18:19.039 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-14T10:18:19.040 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-14T10:18:19.040 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-14T10:18:19.040 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-14T10:18:19.040 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-14T10:18:19.040 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-14T10:18:19.041 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-14T10:18:19.041 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-14T10:18:19.041 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-14T10:18:19.041 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-14T10:18:19.041 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-14T10:18:19.042 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-14T10:18:19.042 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-14T10:18:19.042 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-14T10:18:19.042 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-14T10:18:19.042 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-14T10:18:19.043 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-14T10:18:19.043 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-14T10:18:19.043 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-14T10:18:19.043 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-14T10:18:19.043 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-14T10:18:19.044 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-14T10:18:19.044 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-14T10:18:19.044 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-14T10:18:19.044 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-14T10:18:19.044 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-14T10:18:19.045 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-14T10:18:19.045 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-14T10:18:19.045 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-14T10:18:19.045 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-14T10:18:19.046 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-14T10:18:19.046 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-14T10:18:19.046 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-14T10:18:19.046 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-14T10:18:19.047 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-14T10:18:19.047 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-14T10:18:19.047 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-14T10:18:19.047 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-14T10:18:19.048 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-14T10:18:19.048 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-14T10:18:19.048 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-14T10:18:19.048 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-14T10:18:19.048 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-14T10:18:19.049 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-14T10:18:19.049 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-14T10:18:19.049 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-14T10:18:19.049 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-14T10:18:19.049 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-14T10:18:19.050 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-14T10:18:19.050 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-14T10:18:19.050 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-14T10:18:19.050 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-14T10:18:19.051 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-14T10:18:19.051 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-14T10:18:19.051 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-14T10:18:19.051 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-14T10:18:19.051 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-14T10:18:19.052 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-14T10:18:19.052 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-14T10:18:19.052 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-14T10:18:19.052 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-14T10:18:19.052 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-14T10:18:19.053 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-14T10:18:19.053 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-14T10:18:19.053 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-14T10:18:19.053 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-14T10:18:19.053 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-14T10:18:19.054 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-14T10:18:19.054 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-14T10:18:19.054 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-14T10:18:19.054 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-14T10:18:19.054 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-14T10:18:19.054 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-14T10:18:19.055 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-14T10:18:19.055 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-14T10:18:19.055 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-14T10:18:19.055 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-14T10:18:19.055 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-14T10:18:19.056 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-14T10:18:19.056 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-14T10:18:19.056 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-14T10:18:19.056 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-14T10:18:19.056 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-14T10:18:19.057 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-14T10:18:19.057 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-14T10:18:19.057 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-14T10:18:19.057 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-14T10:18:19.057 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-14T10:18:19.058 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-14T10:18:19.058 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-14T10:18:19.058 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-14T10:18:19.058 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-14T10:18:19.058 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-14T10:18:19.058 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-14T10:18:19.059 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-14T10:18:19.059 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-14T10:18:19.059 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-14T10:18:19.059 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-14T10:18:19.059 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-14T10:18:19.060 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-14T10:18:19.060 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-14T10:18:19.061 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-14T10:18:19.061 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-14T10:18:19.061 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-14T10:18:19.061 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-14T10:18:19.061 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-14T10:18:19.062 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-14T10:18:19.062 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-14T10:18:19.062 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-14T10:18:19.062 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-14T10:18:19.062 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-14T10:18:19.063 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-14T10:18:19.063 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-14T10:18:19.063 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-14T10:18:19.063 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-14T10:18:19.063 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-14T10:18:19.064 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-14T10:18:19.064 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-14T10:18:19.064 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-14T10:18:19.064 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-14T10:18:19.064 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-14T10:18:19.064 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-14T10:18:19.065 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-14T10:18:19.065 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-14T10:18:19.065 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-14T10:18:19.065 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-14T10:18:19.065 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-14T10:18:19.066 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-14T10:18:19.066 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-14T10:18:19.066 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-14T10:18:19.066 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-14T10:18:19.066 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-14T10:18:19.067 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-14T10:18:19.067 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-14T10:18:19.067 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-14T10:18:19.067 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-14T10:18:19.067 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-14T10:18:19.068 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-14T10:18:19.068 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-14T10:18:19.068 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-14T10:18:19.068 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-14T10:18:19.068 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-14T10:18:19.069 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-14T10:18:19.069 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-14T10:18:19.069 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-14T10:18:19.069 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-14T10:18:19.069 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-14T10:18:19.070 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-14T10:18:19.070 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-14T10:18:19.070 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-14T10:18:19.070 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-14T10:18:19.070 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-14T10:18:19.071 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-14T10:18:19.071 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-14T10:18:19.071 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-14T10:18:19.071 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-14T10:18:19.072 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-14T10:18:19.072 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-14T10:18:19.072 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-14T10:18:19.072 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-14T10:18:19.072 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-14T10:18:19.073 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-14T10:18:19.073 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-14T10:18:19.073 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-14T10:18:19.073 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-14T10:18:19.073 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-14T10:18:19.074 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-14T10:18:19.074 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-14T10:18:19.074 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-14T10:18:19.074 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-14T10:18:19.074 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-14T10:18:19.075 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-14T10:18:19.075 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-14T10:18:19.075 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-14T10:18:19.075 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-14T10:18:19.075 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-14T10:18:19.076 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-14T10:18:19.076 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-14T10:18:19.076 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-14T10:18:19.076 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-14T10:18:19.076 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-14T10:18:19.076 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-14T10:18:19.077 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-14T10:18:19.077 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-14T10:18:19.077 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-14T10:18:19.077 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-14T10:18:19.077 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-14T10:18:19.078 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-14T10:18:19.078 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-14T10:18:19.078 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-14T10:18:19.078 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-14T10:18:19.078 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-14T10:18:19.079 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-14T10:18:19.079 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-14T10:18:19.079 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-14T10:18:19.079 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-14T10:18:19.079 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-14T10:18:19.079 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-14T10:18:19.080 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-14T10:18:19.081 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-14T10:18:19.081 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-14T10:18:19.081 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-14T10:18:19.081 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-14T10:18:19.081 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-14T10:18:19.082 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-14T10:18:19.082 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-14T10:18:19.082 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-14T10:18:19.082 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-14T10:18:19.082 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-14T10:18:19.083 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-14T10:18:19.083 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-14T10:18:19.083 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-14T10:18:19.083 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-14T10:18:19.083 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-14T10:18:19.084 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-14T10:18:19.084 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-14T10:18:19.084 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-14T10:18:19.084 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-14T10:18:19.084 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-14T10:18:19.084 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-14T10:18:19.085 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-14T10:18:19.085 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-14T10:18:19.085 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-14T10:18:19.085 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-14T10:18:19.085 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-14T10:18:19.086 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-14T10:18:19.086 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-14T10:18:19.086 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-14T10:18:19.086 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-14T10:18:19.086 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-14T10:18:19.087 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-14T10:18:19.087 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-14T10:18:19.087 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-14T10:18:19.087 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-14T10:18:19.087 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-14T10:18:19.087 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-14T10:18:19.088 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-14T10:18:19.088 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-14T10:18:19.088 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-14T10:18:19.088 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-14T10:18:19.088 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-14T10:18:19.089 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-14T10:18:19.089 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-14T10:18:19.089 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-14T10:18:19.089 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-14T10:18:19.089 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-14T10:18:19.090 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-14T10:18:19.090 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-14T10:18:19.090 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-14T10:18:19.090 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-14T10:18:19.090 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-14T10:18:19.091 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-14T10:18:19.091 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-14T10:18:19.091 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-14T10:18:19.091 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-14T10:18:19.091 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-14T10:18:19.091 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-14T10:18:19.092 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-14T10:18:19.092 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-14T10:18:19.092 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-14T10:18:19.092 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-14T10:18:19.092 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-14T10:18:19.093 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-14T10:18:19.093 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-14T10:18:19.093 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-14T10:18:19.093 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-14T10:18:19.093 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-14T10:18:19.094 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-14T10:18:19.094 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-14T10:18:19.094 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-14T10:18:19.094 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-14T10:18:19.094 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-14T10:18:19.095 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-14T10:18:19.095 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-14T10:18:19.095 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-14T10:18:19.095 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-14T10:18:19.095 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-14T10:18:19.096 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-14T10:18:19.096 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-14T10:18:19.096 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-14T10:18:19.096 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-14T10:18:19.096 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-14T10:18:19.096 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-14T10:18:19.097 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-14T10:18:19.097 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-14T10:18:19.097 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-14T10:18:19.097 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-14T10:18:19.098 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-14T10:18:19.098 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-14T10:18:19.098 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-14T10:18:19.098 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-14T10:18:19.099 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-14T10:18:19.099 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-14T10:18:19.099 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-14T10:18:19.099 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-14T10:18:19.099 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-14T10:18:19.100 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-14T10:18:19.100 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-14T10:18:19.100 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-14T10:18:19.100 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-14T10:18:19.101 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-14T10:18:19.101 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-14T10:18:19.101 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-14T10:18:19.101 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-14T10:18:19.101 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-14T10:18:19.102 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-14T10:18:19.102 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-14T10:18:19.102 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-14T10:18:19.102 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-14T10:18:19.102 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-14T10:18:19.103 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-14T10:18:19.103 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-14T10:18:19.103 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-14T10:18:19.103 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-14T10:18:19.103 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-14T10:18:19.103 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-14T10:18:19.104 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-14T10:18:19.104 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-14T10:18:19.104 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-14T10:18:19.104 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-14T10:18:19.104 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-14T10:18:19.105 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-14T10:18:19.105 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-14T10:18:19.105 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-14T10:18:19.105 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-14T10:18:19.105 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-14T10:18:19.106 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-14T10:18:19.106 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-14T10:18:19.106 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-14T10:18:19.106 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-14T10:18:19.106 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-14T10:18:19.107 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-14T10:18:19.107 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-14T10:18:19.107 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-14T10:18:19.107 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-14T10:18:19.107 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-14T10:18:19.107 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-14T10:18:19.108 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-14T10:18:19.108 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-14T10:18:19.108 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-14T10:18:19.108 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-14T10:18:19.108 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-14T10:18:19.109 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-14T10:18:19.109 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-14T10:18:19.109 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-14T10:18:19.109 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-14T10:18:19.109 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-14T10:18:19.109 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-14T10:18:19.110 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-14T10:18:19.110 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-14T10:18:19.110 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-14T10:18:19.110 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-14T10:18:19.110 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-14T10:18:19.111 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-14T10:18:19.111 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-14T10:18:19.111 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-14T10:18:19.111 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-14T10:18:19.111 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-14T10:18:19.112 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-14T10:18:19.112 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-14T10:18:19.112 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-14T10:18:19.112 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-14T10:18:19.112 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-14T10:18:19.112 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-14T10:18:19.113 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-14T10:18:19.113 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-14T10:18:19.113 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-14T10:18:19.113 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-14T10:18:19.113 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-14T10:18:19.114 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-14T10:18:19.114 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-14T10:18:19.114 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-14T10:18:19.114 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-14T10:18:19.114 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-14T10:18:19.115 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-14T10:18:19.115 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-14T10:18:19.115 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-14T10:18:19.115 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-14T10:18:19.115 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-14T10:18:19.115 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-14T10:18:19.116 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-14T10:18:19.116 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-14T10:18:19.116 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-14T10:18:19.116 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-14T10:18:19.116 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-14T10:18:19.117 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-14T10:18:19.117 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-14T10:18:19.117 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-14T10:18:19.117 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-14T10:18:19.117 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-14T10:18:19.118 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-14T10:18:19.118 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-14T10:18:19.118 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-14T10:18:19.118 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-14T10:18:19.118 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-14T10:18:19.119 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-14T10:18:19.119 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-14T10:18:19.119 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-14T10:18:19.119 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-14T10:18:19.119 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-14T10:18:19.120 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-14T10:18:19.120 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-14T10:18:19.120 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-14T10:18:19.120 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-14T10:18:19.120 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-14T10:18:19.120 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-14T10:18:19.121 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-14T10:18:19.121 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-14T10:18:19.121 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-14T10:18:19.121 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-14T10:18:19.121 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-14T10:18:19.122 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-14T10:18:19.122 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-14T10:18:19.122 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-14T10:18:19.122 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-14T10:18:19.123 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-14T10:18:19.123 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-14T10:18:19.123 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-14T10:18:19.123 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-14T10:18:19.123 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-14T10:18:19.124 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-14T10:18:19.124 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-14T10:18:19.124 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-14T10:18:19.124 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-14T10:18:19.124 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-14T10:18:19.124 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-14T10:18:19.125 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-14T10:18:19.125 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-14T10:18:19.125 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-14T10:18:19.125 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-14T10:18:19.125 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-14T10:18:19.126 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-14T10:18:19.126 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-14T10:18:19.126 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-14T10:18:19.126 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-14T10:18:19.126 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-14T10:18:19.127 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-14T10:18:19.127 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-14T10:18:19.127 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-14T10:18:19.127 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-14T10:18:19.127 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-14T10:18:19.127 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-14T10:18:19.128 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-14T10:18:19.128 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-14T10:18:19.128 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-14T10:18:19.128 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-14T10:18:19.128 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-14T10:18:19.129 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-14T10:18:19.129 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-14T10:18:19.129 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-14T10:18:19.129 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-14T10:18:19.130 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-14T10:18:19.130 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-14T10:18:19.130 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-14T10:18:19.130 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-14T10:18:19.130 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-14T10:18:19.131 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-14T10:18:19.131 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-14T10:18:19.131 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-14T10:18:19.131 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-14T10:18:19.131 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-14T10:18:19.132 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-14T10:18:19.132 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-14T10:18:19.132 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-14T10:18:19.132 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-14T10:18:19.132 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-14T10:18:19.132 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-14T10:18:19.133 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-14T10:18:19.133 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-14T10:18:19.133 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-14T10:18:19.133 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-14T10:18:19.133 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-14T10:18:19.134 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-14T10:18:19.134 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-14T10:18:19.134 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-14T10:18:19.134 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-14T10:18:19.135 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-14T10:18:19.135 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-14T10:18:19.135 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-14T10:18:19.135 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-14T10:18:19.135 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-14T10:18:19.136 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-14T10:18:19.136 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-14T10:18:19.136 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-14T10:18:19.136 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-14T10:18:19.137 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-14T10:18:19.137 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-14T10:18:19.137 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-14T10:18:19.137 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-14T10:18:19.138 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-14T10:18:19.138 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-14T10:18:19.138 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-14T10:18:19.138 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-14T10:18:19.138 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-14T10:18:19.139 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-14T10:18:19.139 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-14T10:18:19.139 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-14T10:18:19.139 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-14T10:18:19.139 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-14T10:18:19.140 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-14T10:18:19.140 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-14T10:18:19.140 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-14T10:18:19.140 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-14T10:18:19.140 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-14T10:18:19.141 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-14T10:18:19.141 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-14T10:18:19.141 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-14T10:18:19.141 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-14T10:18:19.141 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-14T10:18:19.142 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-14T10:18:19.142 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-14T10:18:19.142 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-14T10:18:19.142 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-14T10:18:19.142 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-14T10:18:19.143 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-14T10:18:19.143 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-14T10:18:19.143 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-14T10:18:19.143 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-14T10:18:19.143 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-14T10:18:19.144 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-14T10:18:19.144 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-14T10:18:19.144 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-14T10:18:19.144 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-14T10:18:19.144 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-14T10:18:19.144 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-14T10:18:19.145 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-14T10:18:19.145 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-14T10:18:19.145 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-14T10:18:19.145 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-14T10:18:19.145 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-14T10:18:19.146 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-14T10:18:19.146 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-14T10:18:19.146 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-14T10:18:19.146 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-14T10:18:19.146 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-14T10:18:19.147 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-14T10:18:19.147 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-14T10:18:19.147 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-14T10:18:19.147 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-14T10:18:19.147 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-14T10:18:19.148 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-14T10:18:19.148 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-14T10:18:19.148 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-14T10:18:19.148 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-14T10:18:19.148 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-14T10:18:19.149 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-14T10:18:19.149 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-14T10:18:19.149 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-14T10:18:19.149 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-14T10:18:19.149 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-14T10:18:19.149 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-14T10:18:19.150 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-14T10:18:19.150 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-14T10:18:19.150 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-14T10:18:19.150 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-14T10:18:19.150 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-14T10:18:19.151 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-14T10:18:19.151 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-14T10:18:19.151 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-14T10:18:19.151 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-14T10:18:19.151 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-14T10:18:19.151 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-14T10:18:19.152 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-14T10:18:19.152 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-14T10:18:19.152 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-14T10:18:19.152 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-14T10:18:19.152 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-14T10:18:19.153 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-14T10:18:19.153 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-14T10:18:19.153 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-14T10:18:19.153 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-14T10:18:19.153 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-14T10:18:19.154 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-14T10:18:19.154 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-14T10:18:19.154 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-14T10:18:19.154 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-14T10:18:19.154 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-14T10:18:19.155 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-14T10:18:19.155 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-14T10:18:19.155 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-14T10:18:19.155 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-14T10:18:19.155 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-14T10:18:19.156 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-14T10:18:19.156 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-14T10:18:19.156 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-14T10:18:19.156 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-14T10:18:19.156 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-14T10:18:19.156 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-14T10:18:19.157 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-14T10:18:19.157 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-14T10:18:19.157 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-14T10:18:19.157 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-14T10:18:19.157 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-14T10:18:19.158 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-14T10:18:19.158 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-14T10:18:19.158 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-14T10:18:19.158 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-14T10:18:19.158 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-14T10:18:19.159 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-14T10:18:19.159 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-14T10:18:19.159 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-14T10:18:19.159 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-14T10:18:19.159 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-14T10:18:19.159 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-14T10:18:19.160 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-14T10:18:19.160 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-14T10:18:19.160 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-14T10:18:19.160 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-14T10:18:19.160 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-14T10:18:19.161 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-14T10:18:19.161 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-14T10:18:19.161 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-14T10:18:19.161 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-14T10:18:19.161 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-14T10:18:19.161 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-14T10:18:19.162 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-14T10:18:19.162 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-14T10:18:19.162 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-14T10:18:19.162 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-14T10:18:19.162 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-14T10:18:19.163 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-14T10:18:19.163 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-14T10:18:19.163 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-14T10:18:19.163 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-14T10:18:19.163 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-14T10:18:19.164 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-14T10:18:19.164 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-14T10:18:19.164 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-14T10:18:19.164 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-14T10:18:19.164 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-14T10:18:19.164 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-14T10:18:19.165 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-14T10:18:19.165 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-14T10:18:19.165 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-14T10:18:19.165 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-14T10:18:19.165 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-14T10:18:19.166 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-14T10:18:19.166 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-14T10:18:19.166 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-14T10:18:19.166 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-14T10:18:19.166 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-14T10:18:19.167 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-14T10:18:19.167 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-14T10:18:19.167 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-14T10:18:19.167 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-14T10:18:19.167 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-14T10:18:19.167 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-14T10:18:19.168 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-14T10:18:19.168 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-14T10:18:19.168 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-14T10:18:19.168 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-14T10:18:19.168 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-14T10:18:19.169 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-14T10:18:19.169 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-14T10:18:19.169 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-14T10:18:19.169 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-14T10:18:19.169 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-14T10:18:19.170 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-14T10:18:19.170 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-14T10:18:19.170 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-14T10:18:19.170 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-14T10:18:19.171 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-14T10:18:19.171 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-14T10:18:19.171 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-14T10:18:19.171 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-14T10:18:19.171 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-14T10:18:19.171 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-14T10:18:19.172 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-14T10:18:19.172 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-14T10:18:19.172 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-14T10:18:19.172 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-14T10:18:19.173 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-14T10:18:19.173 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-14T10:18:19.173 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-14T10:18:19.173 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-14T10:18:19.173 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-14T10:18:19.174 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-14T10:18:19.174 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-14T10:18:19.174 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-14T10:18:19.174 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-14T10:18:19.174 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-14T10:18:19.175 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-14T10:18:19.175 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-14T10:18:19.175 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-14T10:18:19.175 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-14T10:18:19.175 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-14T10:18:19.176 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-14T10:18:19.176 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-14T10:18:19.176 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-14T10:18:19.176 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-14T10:18:19.176 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-14T10:18:19.176 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-14T10:18:19.177 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-14T10:18:19.177 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-14T10:18:19.177 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-14T10:18:19.177 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-14T10:18:19.177 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-14T10:18:19.178 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-14T10:18:19.178 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-14T10:18:19.178 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-14T10:18:19.178 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-14T10:18:19.178 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-14T10:18:19.178 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-14T10:18:19.179 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-14T10:18:19.179 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-14T10:18:19.179 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-14T10:18:19.179 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-14T10:18:19.181 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-14T10:18:19.181 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-14T10:18:19.181 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-14T10:18:19.181 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-14T10:18:19.181 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-14T10:18:19.182 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-14T10:18:19.182 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-14T10:18:19.182 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-14T10:18:19.182 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-14T10:18:19.183 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-14T10:18:19.183 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-14T10:18:19.183 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-14T10:18:19.183 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-14T10:18:19.183 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-14T10:18:19.184 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-14T10:18:19.184 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-14T10:18:19.184 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-14T10:18:19.184 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-14T10:18:19.184 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-14T10:18:19.185 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-14T10:18:19.185 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-14T10:18:19.185 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-14T10:18:19.185 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-14T10:18:19.185 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-14T10:18:19.186 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-14T10:18:19.186 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-14T10:18:19.186 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-14T10:18:19.186 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-14T10:18:19.186 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-14T10:18:19.187 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-14T10:18:19.187 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-14T10:18:19.187 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-14T10:18:19.187 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-14T10:18:19.187 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-14T10:18:19.188 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-14T10:18:19.188 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-14T10:18:19.188 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-14T10:18:19.188 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-14T10:18:19.188 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-14T10:18:19.189 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-14T10:18:19.189 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-14T10:18:19.189 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-14T10:18:19.189 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-14T10:18:19.189 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-14T10:18:19.190 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-14T10:18:19.190 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-14T10:18:19.190 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-14T10:18:19.190 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-14T10:18:19.190 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-14T10:18:19.191 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-14T10:18:19.191 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-14T10:18:19.191 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-14T10:18:19.191 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-14T10:18:19.191 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-14T10:18:19.192 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-14T10:18:19.192 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-14T10:18:19.192 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-14T10:18:19.192 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-14T10:18:19.192 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-14T10:18:19.193 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-14T10:18:19.193 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-14T10:18:19.193 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-14T10:18:19.193 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-14T10:18:19.193 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-14T10:18:19.194 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-14T10:18:19.194 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-14T10:18:19.194 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-14T10:18:19.194 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-14T10:18:19.194 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-14T10:18:19.194 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-14T10:18:19.195 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-14T10:18:19.195 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-14T10:18:19.195 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-14T10:18:19.195 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-14T10:18:19.195 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-14T10:18:19.196 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-14T10:18:19.196 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-14T10:18:19.196 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-14T10:18:19.196 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-14T10:18:19.196 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-14T10:18:19.197 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-14T10:18:19.197 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-14T10:18:19.197 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-14T10:18:19.197 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-14T10:18:19.197 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-14T10:18:19.198 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-14T10:18:19.198 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-14T10:18:19.198 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-14T10:18:19.199 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-14T10:18:19.199 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-14T10:18:19.199 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-14T10:18:19.199 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-14T10:18:19.200 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-14T10:18:19.200 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-14T10:18:19.200 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-14T10:18:19.200 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-14T10:18:19.201 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-14T10:18:19.201 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-14T10:18:19.201 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-14T10:18:19.201 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-14T10:18:19.201 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-14T10:18:19.202 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-14T10:18:19.202 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-14T10:18:19.202 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-14T10:18:19.202 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-14T10:18:19.202 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-14T10:18:19.203 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-14T10:18:19.203 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-14T10:18:19.203 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-14T10:18:19.203 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-14T10:18:19.203 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-14T10:18:19.204 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-14T10:18:19.204 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-14T10:18:19.204 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-14T10:18:19.204 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-14T10:18:19.205 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-14T10:18:19.205 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-14T10:18:19.205 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-14T10:18:19.206 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-14T10:18:19.206 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-14T10:18:19.206 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-14T10:18:19.206 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-14T10:18:19.206 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-14T10:18:19.207 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-14T10:18:19.207 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-14T10:18:19.207 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-14T10:18:19.207 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-14T10:18:19.207 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-14T10:18:19.207 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-14T10:18:19.208 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-14T10:18:19.208 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-14T10:18:19.208 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-14T10:18:19.208 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-14T10:18:19.208 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-14T10:18:19.209 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-14T10:18:19.209 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-14T10:18:19.209 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-14T10:18:19.210 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-14T10:18:19.210 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-14T10:18:19.210 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-14T10:18:19.210 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-14T10:18:19.210 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-14T10:18:19.211 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-14T10:18:19.211 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-14T10:18:19.211 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-14T10:18:19.211 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-14T10:18:19.211 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-14T10:18:19.212 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-14T10:18:19.212 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-14T10:18:19.212 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-14T10:18:19.212 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-14T10:18:19.213 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-14T10:18:19.213 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-14T10:18:19.213 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-14T10:18:19.213 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-14T10:18:19.213 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-14T10:18:19.214 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-14T10:18:19.214 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-14T10:18:19.214 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-14T10:18:19.214 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-14T10:18:19.214 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-14T10:18:19.215 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-14T10:18:19.215 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-14T10:18:19.215 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-14T10:18:19.215 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-14T10:18:19.215 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-14T10:18:19.216 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-14T10:18:19.216 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-14T10:18:19.216 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-14T10:18:19.216 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-14T10:18:19.216 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-14T10:18:19.216 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-14T10:18:19.217 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-14T10:18:19.217 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-14T10:18:19.217 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-14T10:18:19.217 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-14T10:18:19.217 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-14T10:18:19.218 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-14T10:18:19.218 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-14T10:18:19.218 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-14T10:18:19.218 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-14T10:18:19.218 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-14T10:18:19.219 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-14T10:18:19.219 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-14T10:18:19.219 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-14T10:18:19.219 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-14T10:18:19.219 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-14T10:18:19.219 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-14T10:18:19.220 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-14T10:18:19.220 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-14T10:18:19.220 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-14T10:18:19.220 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-14T10:18:19.220 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-14T10:18:19.221 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-14T10:18:19.221 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-14T10:18:19.221 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-14T10:18:19.221 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-14T10:18:19.221 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-14T10:18:19.222 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-14T10:18:19.222 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-14T10:18:19.222 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-14T10:18:19.222 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-14T10:18:19.222 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-14T10:18:19.222 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-14T10:18:19.223 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-14T10:18:19.223 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-14T10:18:19.223 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-14T10:18:19.223 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-14T10:18:19.224 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-14T10:18:19.224 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-14T10:18:19.224 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-14T10:18:19.224 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-14T10:18:19.224 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-14T10:18:19.224 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-14T10:18:19.225 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-14T10:18:19.225 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-14T10:18:19.225 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-14T10:18:19.225 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-14T10:18:19.225 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-14T10:18:19.226 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-14T10:18:19.226 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-14T10:18:19.226 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-14T10:18:19.226 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-14T10:18:19.226 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-14T10:18:19.227 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-14T10:18:19.227 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-14T10:18:19.227 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-14T10:18:19.227 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-14T10:18:19.227 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-14T10:18:19.228 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-14T10:18:19.228 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-14T10:18:19.228 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-14T10:18:19.228 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-14T10:18:19.228 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-14T10:18:19.229 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-14T10:18:19.229 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-14T10:18:19.229 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-14T10:18:19.229 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-14T10:18:19.229 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-14T10:18:19.230 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-14T10:18:19.230 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-14T10:18:19.230 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-14T10:18:19.230 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-14T10:18:19.230 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-14T10:18:19.231 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-14T10:18:19.231 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-14T10:18:19.231 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-14T10:18:19.231 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-14T10:18:19.231 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-14T10:18:19.231 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-14T10:18:19.232 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-14T10:18:19.232 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-14T10:18:19.232 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-14T10:18:19.232 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-14T10:18:19.232 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-14T10:18:19.233 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-14T10:18:19.233 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-14T10:18:19.233 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-14T10:18:19.233 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-14T10:18:19.233 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-14T10:18:19.234 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-14T10:18:19.234 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-14T10:18:19.234 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-14T10:18:19.234 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-14T10:18:19.234 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-14T10:18:19.235 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-14T10:18:19.235 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-14T10:18:19.235 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-14T10:18:19.235 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-14T10:18:19.235 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-14T10:18:19.235 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-14T10:18:19.236 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-14T10:18:19.236 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-14T10:18:19.236 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-14T10:18:19.236 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-14T10:18:19.236 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-14T10:18:19.237 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-14T10:18:19.237 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-14T10:18:19.237 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-14T10:18:19.237 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-14T10:18:19.237 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-14T10:18:19.238 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-14T10:18:19.238 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-14T10:18:19.238 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-14T10:18:19.238 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-14T10:18:19.238 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-14T10:18:19.239 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-14T10:18:19.239 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-14T10:18:19.239 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-14T10:18:19.239 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-14T10:18:19.239 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-14T10:18:19.240 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-14T10:18:19.240 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-14T10:18:19.240 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-14T10:18:19.240 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-14T10:18:19.240 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-14T10:18:19.241 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-14T10:18:19.241 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-14T10:18:19.241 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-14T10:18:19.241 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-14T10:18:19.241 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-14T10:18:19.242 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-14T10:18:19.242 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-14T10:18:19.242 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-14T10:18:19.242 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-14T10:18:19.242 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-14T10:18:19.243 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-14T10:18:19.243 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-14T10:18:19.243 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-14T10:18:19.243 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-14T10:18:19.243 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-14T10:18:19.243 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-14T10:18:19.244 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-14T10:18:19.244 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-14T10:18:19.244 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-14T10:18:19.244 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-14T10:18:19.244 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-14T10:18:19.245 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-14T10:18:19.245 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-14T10:18:19.245 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-14T10:18:19.245 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-14T10:18:19.245 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-14T10:18:19.246 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-14T10:18:19.246 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-14T10:18:19.246 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-14T10:18:19.246 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-14T10:18:19.246 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-14T10:18:19.246 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-14T10:18:19.247 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-14T10:18:19.247 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-14T10:18:19.247 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-14T10:18:19.247 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-14T10:18:19.247 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-14T10:18:19.248 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-14T10:18:19.248 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-14T10:18:19.248 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-14T10:18:19.248 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-14T10:18:19.248 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-14T10:18:19.249 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-14T10:18:19.249 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-14T10:18:19.249 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-14T10:18:19.249 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-14T10:18:19.249 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-14T10:18:19.249 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-14T10:18:19.250 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-14T10:18:19.250 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-14T10:18:19.250 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-14T10:18:19.250 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-14T10:18:19.250 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-14T10:18:19.251 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-14T10:18:19.251 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-14T10:18:19.251 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-14T10:18:19.251 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-14T10:18:19.251 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-14T10:18:19.252 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-14T10:18:19.252 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-14T10:18:19.252 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-14T10:18:19.252 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-14T10:18:19.252 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-14T10:18:19.252 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-14T10:18:19.253 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-14T10:18:19.253 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-14T10:18:19.253 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-14T10:18:19.253 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-14T10:18:19.253 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-14T10:18:19.254 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-14T10:18:19.254 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-14T10:18:19.254 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-14T10:18:19.254 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-14T10:18:19.254 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-14T10:18:19.254 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-14T10:18:19.255 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-14T10:18:19.255 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-14T10:18:19.255 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-14T10:18:19.255 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-14T10:18:19.255 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-14T10:18:19.256 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-14T10:18:19.256 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-14T10:18:19.256 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-14T10:18:19.256 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-14T10:18:19.256 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-14T10:18:19.257 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-14T10:18:19.257 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-14T10:18:19.257 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-14T10:18:19.257 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-14T10:18:19.257 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-14T10:18:19.257 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-14T10:18:19.258 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-14T10:18:19.258 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-14T10:18:19.258 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-14T10:18:19.258 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-14T10:18:19.258 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-14T10:18:19.259 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-14T10:18:19.259 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-14T10:18:19.259 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-14T10:18:19.259 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-14T10:18:19.259 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-14T10:18:19.259 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-14T10:18:19.260 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-14T10:18:19.260 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-14T10:18:19.260 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-14T10:18:19.260 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-14T10:18:19.260 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-14T10:18:19.261 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-14T10:18:19.261 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-14T10:18:19.261 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-14T10:18:19.261 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-14T10:18:19.261 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-14T10:18:19.262 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-14T10:18:19.262 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-14T10:18:19.262 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-14T10:18:19.262 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-14T10:18:19.262 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-14T10:18:19.262 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-14T10:18:19.263 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-14T10:18:19.263 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-14T10:18:19.263 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-14T10:18:19.263 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-14T10:18:19.263 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-14T10:18:19.264 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-14T10:18:19.264 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-14T10:18:19.264 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-14T10:18:19.264 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-14T10:18:19.264 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-14T10:18:19.264 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-14T10:18:19.265 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-14T10:18:19.265 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-14T10:18:19.265 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-14T10:18:19.265 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-14T10:18:19.265 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-14T10:18:19.266 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-14T10:18:19.266 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-14T10:18:19.266 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-14T10:18:19.266 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-14T10:18:19.266 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-14T10:18:19.267 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-14T10:18:19.267 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-14T10:18:19.267 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-14T10:18:19.267 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-14T10:18:19.267 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-14T10:18:19.268 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-14T10:18:19.268 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-14T10:18:19.268 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-14T10:18:19.268 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-14T10:18:19.268 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-14T10:18:19.268 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-14T10:18:19.269 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-14T10:18:19.269 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-14T10:18:19.269 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-14T10:18:19.269 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-14T10:18:19.269 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-14T10:18:19.270 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-14T10:18:19.270 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-14T10:18:19.270 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-14T10:18:19.270 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-14T10:18:19.270 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-14T10:18:19.271 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-14T10:18:19.271 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-14T10:18:19.271 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-14T10:18:19.271 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-14T10:18:19.271 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-14T10:18:19.272 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-14T10:18:19.272 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-14T10:18:19.272 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-14T10:18:19.272 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-14T10:18:19.272 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-14T10:18:19.272 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-14T10:18:19.273 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-14T10:18:19.273 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-14T10:18:19.273 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-14T10:18:19.273 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-14T10:18:19.273 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-14T10:18:19.274 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-14T10:18:19.274 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-14T10:18:19.274 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-14T10:18:19.274 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-14T10:18:19.274 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-14T10:18:19.275 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-14T10:18:19.275 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-14T10:18:19.275 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-14T10:18:19.275 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-14T10:18:19.275 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-14T10:18:19.276 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-14T10:18:19.276 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-14T10:18:19.276 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-14T10:18:19.276 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-14T10:18:19.276 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-14T10:18:19.276 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-14T10:18:19.277 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-14T10:18:19.277 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-14T10:18:19.277 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-14T10:18:19.277 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-14T10:18:19.277 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-14T10:18:19.278 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-14T10:18:19.278 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-14T10:18:19.278 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-14T10:18:19.278 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-14T10:18:19.278 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-14T10:18:19.278 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-14T10:18:19.279 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-14T10:18:19.279 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-14T10:18:19.279 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-14T10:18:19.279 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-14T10:18:19.279 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-14T10:18:19.280 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-14T10:18:19.280 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-14T10:18:19.280 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-14T10:18:19.280 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-14T10:18:19.280 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-14T10:18:19.281 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-14T10:18:19.281 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-14T10:18:19.281 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-14T10:18:19.281 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-14T10:18:19.281 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-14T10:18:19.281 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-14T10:18:19.282 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-14T10:18:19.282 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-14T10:18:19.282 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-14T10:18:19.282 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-14T10:18:19.282 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-14T10:18:19.283 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-14T10:18:19.283 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-14T10:18:19.283 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-14T10:18:19.283 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-14T10:18:19.283 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-14T10:18:19.283 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-14T10:18:19.284 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-14T10:18:19.284 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-14T10:18:19.284 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-14T10:18:19.284 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-14T10:18:19.284 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-14T10:18:19.285 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-14T10:18:19.285 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-14T10:18:19.285 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-14T10:18:19.285 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-14T10:18:19.285 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-14T10:18:19.286 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-14T10:18:19.286 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-14T10:18:19.286 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-14T10:18:19.286 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-14T10:18:19.286 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-14T10:18:19.286 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-14T10:18:19.287 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-14T10:18:19.287 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-14T10:18:19.287 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-14T10:18:19.287 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-14T10:18:19.287 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-14T10:18:19.288 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-14T10:18:19.288 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-14T10:18:19.288 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-14T10:18:19.288 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-14T10:18:19.288 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-14T10:18:19.288 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-14T10:18:19.289 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-14T10:18:19.289 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-14T10:18:19.289 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-14T10:18:19.289 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-14T10:18:19.289 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-14T10:18:19.290 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-14T10:18:19.290 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-14T10:18:19.290 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-14T10:18:19.290 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-14T10:18:19.290 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-14T10:18:19.291 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-14T10:18:19.291 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-14T10:18:19.291 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-14T10:18:19.291 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-14T10:18:19.291 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-14T10:18:19.291 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-14T10:18:19.292 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-14T10:18:19.292 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-14T10:18:19.292 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-14T10:18:19.292 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-14T10:18:19.292 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-14T10:18:19.293 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-14T10:18:19.293 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-14T10:18:19.293 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-14T10:18:19.293 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-14T10:18:19.293 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-14T10:18:19.294 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-14T10:18:19.294 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-14T10:18:19.294 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-14T10:18:19.294 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-14T10:18:19.294 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-14T10:18:19.294 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-14T10:18:19.295 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-14T10:18:19.295 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-14T10:18:19.295 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-14T10:18:19.295 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-14T10:18:19.295 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-14T10:18:19.296 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-14T10:18:19.296 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-14T10:18:19.296 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-14T10:18:19.296 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-14T10:18:19.296 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-14T10:18:19.297 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-14T10:18:19.297 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-14T10:18:19.297 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-14T10:18:19.297 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-14T10:18:19.297 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-14T10:18:19.297 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-14T10:18:19.298 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-14T10:18:19.298 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-14T10:18:19.298 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-14T10:18:19.298 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-14T10:18:19.298 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-14T10:18:19.299 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-14T10:18:19.299 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-14T10:18:19.299 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-14T10:18:19.299 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-14T10:18:19.299 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-14T10:18:19.300 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-14T10:18:19.300 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-14T10:18:19.300 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-14T10:18:19.300 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-14T10:18:19.300 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-14T10:18:19.300 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-14T10:18:19.301 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-14T10:18:19.301 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-14T10:18:19.301 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-14T10:18:19.301 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-14T10:18:19.301 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-14T10:18:19.302 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-14T10:18:19.302 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-14T10:18:19.302 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-14T10:18:19.302 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-14T10:18:19.302 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-14T10:18:19.303 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-14T10:18:19.303 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-14T10:18:19.303 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-14T10:18:19.303 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-14T10:18:19.303 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-14T10:18:19.304 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-14T10:18:19.304 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-14T10:18:19.304 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-14T10:18:19.304 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-14T10:18:19.304 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-14T10:18:19.305 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-14T10:18:19.305 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-14T10:18:19.305 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-14T10:18:19.305 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-14T10:18:19.305 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-14T10:18:19.305 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-14T10:18:19.306 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-14T10:18:19.306 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-14T10:18:19.306 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-14T10:18:19.306 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-14T10:18:19.306 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-14T10:18:19.307 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-14T10:18:19.307 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-14T10:18:19.307 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-14T10:18:19.307 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-14T10:18:19.307 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-14T10:18:19.308 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-14T10:18:19.308 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-14T10:18:19.308 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-14T10:18:19.308 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-14T10:18:19.308 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-14T10:18:19.308 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-14T10:18:19.309 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-14T10:18:19.309 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-14T10:18:19.309 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-14T10:18:19.309 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-14T10:18:19.309 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-14T10:18:19.310 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-14T10:18:19.310 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-14T10:18:19.310 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-14T10:18:19.310 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-14T10:18:19.310 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-14T10:18:19.310 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-14T10:18:19.311 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-14T10:18:19.311 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-14T10:18:19.311 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-14T10:18:19.311 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-14T10:18:19.311 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-14T10:18:19.312 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-14T10:18:19.312 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-14T10:18:19.312 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-14T10:18:19.312 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-14T10:18:19.312 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-14T10:18:19.313 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-14T10:18:19.313 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-14T10:18:19.313 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-14T10:18:19.313 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-14T10:18:19.313 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-14T10:18:19.313 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-14T10:18:19.314 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-14T10:18:19.314 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-14T10:18:19.314 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-14T10:18:19.314 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-14T10:18:19.314 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-14T10:18:19.315 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-14T10:18:19.315 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-14T10:18:19.315 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-14T10:18:19.315 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-14T10:18:19.315 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-14T10:18:19.315 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-14T10:18:19.316 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-14T10:18:19.316 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-14T10:18:19.316 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-14T10:18:19.316 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-14T10:18:19.316 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-14T10:18:19.317 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-14T10:18:19.317 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-14T10:18:19.317 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-14T10:18:19.317 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-14T10:18:19.317 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-14T10:18:19.317 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-14T10:18:19.318 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-14T10:18:19.318 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-14T10:18:19.318 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-14T10:18:19.318 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-14T10:18:19.318 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-14T10:18:19.319 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-14T10:18:19.319 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-14T10:18:19.319 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-14T10:18:19.319 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-14T10:18:19.319 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-14T10:18:19.320 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-14T10:18:19.320 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-14T10:18:19.320 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-14T10:18:19.320 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-14T10:18:19.320 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-14T10:18:19.320 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-14T10:18:19.321 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-14T10:18:19.321 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-14T10:18:19.321 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-14T10:18:19.321 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-14T10:18:19.321 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-14T10:18:19.322 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-14T10:18:19.322 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-14T10:18:19.322 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-14T10:18:19.322 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-14T10:18:19.322 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-14T10:18:19.323 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-14T10:18:19.323 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-14T10:18:19.323 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-14T10:18:19.323 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-14T10:18:19.323 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-14T10:18:19.323 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-14T10:18:19.324 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-14T10:18:19.324 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-14T10:18:19.324 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-14T10:18:19.324 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-14T10:18:19.324 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-14T10:18:19.325 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-14T10:18:19.325 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-14T10:18:19.325 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-14T10:18:19.325 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-14T10:18:19.325 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-14T10:18:19.325 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-14T10:18:19.326 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-14T10:18:19.326 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-14T10:18:19.326 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-14T10:18:19.326 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-14T10:18:19.326 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-14T10:18:19.327 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-14T10:18:19.327 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-14T10:18:19.327 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-14T10:18:19.327 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-14T10:18:19.327 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-14T10:18:19.327 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-14T10:18:19.328 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-14T10:18:19.328 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-14T10:18:19.328 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-14T10:18:19.328 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-14T10:18:19.328 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-14T10:18:19.329 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-14T10:18:19.329 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-14T10:18:19.329 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-14T10:18:19.329 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-14T10:18:19.329 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-14T10:18:19.329 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-14T10:18:19.330 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-14T10:18:19.330 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-14T10:18:19.330 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-14T10:18:19.330 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-14T10:18:19.330 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-14T10:18:19.331 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-14T10:18:19.331 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-14T10:18:19.331 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-14T10:18:19.331 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-14T10:18:19.331 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-14T10:18:19.332 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-14T10:18:19.332 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-14T10:18:19.332 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-14T10:18:19.332 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-14T10:18:19.332 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-14T10:18:19.332 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-14T10:18:19.333 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-14T10:18:19.333 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-14T10:18:19.333 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-14T10:18:19.333 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-14T10:18:19.333 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-14T10:18:19.334 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-14T10:18:19.334 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-14T10:18:19.334 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-14T10:18:19.334 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-14T10:18:19.334 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-14T10:18:19.334 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-14T10:18:19.335 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-14T10:18:19.335 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-14T10:18:19.335 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-14T10:18:19.335 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-14T10:18:19.335 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-14T10:18:19.336 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-14T10:18:19.336 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-14T10:18:19.336 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-14T10:18:19.336 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-14T10:18:19.336 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-14T10:18:19.337 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-14T10:18:19.337 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-14T10:18:19.337 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-14T10:18:19.337 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-14T10:18:19.337 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-14T10:18:19.337 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-14T10:18:19.338 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-14T10:18:19.338 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-14T10:18:19.338 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-14T10:18:19.338 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-14T10:18:19.338 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-14T10:18:19.339 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-14T10:18:19.339 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-14T10:18:19.339 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-14T10:18:19.339 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-14T10:18:19.339 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-14T10:18:19.340 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-14T10:18:19.340 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-14T10:18:19.340 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-14T10:18:19.340 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-14T10:18:19.340 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-14T10:18:19.340 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-14T10:18:19.341 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-14T10:18:19.341 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-14T10:18:19.341 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-14T10:18:19.341 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-14T10:18:19.341 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-14T10:18:19.342 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-14T10:18:19.342 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-14T10:18:19.342 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-14T10:18:19.342 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-14T10:18:19.342 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-14T10:18:19.343 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-14T10:18:19.343 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-14T10:18:19.343 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-14T10:18:19.343 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-14T10:18:19.343 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-14T10:18:19.343 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-14T10:18:19.344 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-14T10:18:19.344 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-14T10:18:19.344 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-14T10:18:19.344 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-14T10:18:19.344 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-14T10:18:19.345 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-14T10:18:19.345 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-14T10:18:19.345 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-14T10:18:19.345 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-14T10:18:19.345 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-14T10:18:19.345 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-14T10:18:19.346 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-14T10:18:19.346 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-14T10:18:19.346 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-14T10:18:19.346 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-14T10:18:19.346 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-14T10:18:19.347 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-14T10:18:19.347 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-14T10:18:19.347 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-14T10:18:19.347 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-14T10:18:19.347 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-14T10:18:19.347 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-14T10:18:19.348 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-14T10:18:19.348 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-14T10:18:19.348 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-14T10:18:19.348 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-14T10:18:19.348 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-14T10:18:19.349 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-14T10:18:19.349 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-14T10:18:19.349 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-14T10:18:19.349 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-14T10:18:19.349 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-14T10:18:19.349 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-14T10:18:19.350 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-14T10:18:19.350 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-14T10:18:19.350 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-14T10:18:19.350 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-14T10:18:19.350 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-14T10:18:19.351 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-14T10:18:19.351 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-14T10:18:19.351 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-14T10:18:19.351 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-14T10:18:19.351 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-14T10:18:19.352 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-14T10:18:19.352 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-14T10:18:19.352 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-14T10:18:19.352 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-14T10:18:19.352 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-14T10:18:19.352 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-14T10:18:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-14T10:18:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-14T10:18:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-14T10:18:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-14T10:18:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-14T10:18:19.354 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-14T10:18:19.354 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-14T10:18:19.354 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-14T10:18:19.354 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-14T10:18:19.354 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-14T10:18:19.354 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-14T10:18:19.355 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-14T10:18:19.355 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-14T10:18:19.355 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-14T10:18:19.355 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-14T10:18:19.355 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-14T10:18:19.356 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-14T10:18:19.356 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-14T10:18:19.356 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-14T10:18:19.356 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-14T10:18:19.356 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-14T10:18:19.357 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-14T10:18:19.357 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-14T10:18:19.357 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-14T10:18:19.357 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-14T10:18:19.357 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-14T10:18:19.358 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-14T10:18:19.358 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-14T10:18:19.358 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-14T10:18:19.358 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-14T10:18:19.358 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-14T10:18:19.358 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-14T10:18:19.359 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-14T10:18:19.359 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-14T10:18:19.359 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-14T10:18:19.359 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-14T10:18:19.359 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-14T10:18:19.360 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-14T10:18:19.360 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-14T10:18:19.360 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-14T10:18:19.360 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-14T10:18:19.360 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-14T10:18:19.361 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-14T10:18:19.361 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-14T10:18:19.361 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-14T10:18:19.361 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-14T10:18:19.361 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-14T10:18:19.361 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-14T10:18:19.362 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-14T10:18:19.362 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-14T10:18:19.362 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-14T10:18:19.362 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-14T10:18:19.362 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-14T10:18:19.363 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-14T10:18:19.363 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-14T10:18:19.363 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-14T10:18:19.363 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-14T10:18:19.363 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-14T10:18:19.363 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-14T10:18:19.364 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-14T10:18:19.364 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-14T10:18:19.364 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-14T10:18:19.364 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-14T10:18:19.364 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-14T10:18:19.365 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-14T10:18:19.365 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-14T10:18:19.365 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-14T10:18:19.365 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-14T10:18:19.365 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-14T10:18:19.366 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-14T10:18:19.366 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-14T10:18:19.366 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-14T10:18:19.366 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-14T10:18:19.366 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-14T10:18:19.366 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-14T10:18:19.367 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-14T10:18:19.367 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-14T10:18:19.367 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-14T10:18:19.367 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-14T10:18:19.367 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-14T10:18:19.368 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-14T10:18:19.368 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-14T10:18:19.368 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-14T10:18:19.368 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-14T10:18:19.368 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-14T10:18:19.368 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-14T10:18:19.369 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-14T10:18:19.369 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-14T10:18:19.369 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-14T10:18:19.369 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-14T10:18:19.369 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-14T10:18:19.370 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-14T10:18:19.370 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-14T10:18:19.370 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-14T10:18:19.370 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-14T10:18:19.370 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-14T10:18:19.371 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-14T10:18:19.371 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-14T10:18:19.371 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-14T10:18:19.371 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-14T10:18:19.371 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-14T10:18:19.372 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-14T10:18:19.372 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-14T10:18:19.372 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-14T10:18:19.372 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-14T10:18:19.372 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-14T10:18:19.372 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-14T10:18:19.373 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-14T10:18:19.373 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-14T10:18:19.373 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-14T10:18:19.373 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-14T10:18:19.373 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-14T10:18:19.374 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-14T10:18:19.374 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-14T10:18:19.374 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-14T10:18:19.375 DEBUG:teuthology.orchestra.run.smithi092:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-14T10:18:19.398 INFO:teuthology.orchestra.run.smithi092.stdout:postinstall scriptlet (using /bin/sh): 2023-10-14T10:18:19.398 INFO:teuthology.orchestra.run.smithi092.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-14T10:18:19.398 INFO:teuthology.orchestra.run.smithi092.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-14T10:18:19.399 INFO:teuthology.orchestra.run.smithi092.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T10:18:19.399 INFO:teuthology.orchestra.run.smithi092.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T10:18:19.399 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T10:18:19.399 INFO:teuthology.orchestra.run.smithi092.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T10:18:19.400 INFO:teuthology.orchestra.run.smithi092.stdout:fi 2023-10-14T10:18:19.400 INFO:teuthology.orchestra.run.smithi092.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-14T10:18:19.402 INFO:teuthology.orchestra.run.smithi092.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-14T10:18:19.402 INFO:teuthology.orchestra.run.smithi092.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-14T10:18:19.402 INFO:teuthology.orchestra.run.smithi092.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-14T10:18:19.402 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-14T10:18:19.402 INFO:teuthology.orchestra.run.smithi092.stdout:fi 2023-10-14T10:18:19.403 INFO:teuthology.orchestra.run.smithi092.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-14T10:18:19.403 INFO:teuthology.orchestra.run.smithi092.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-14T10:18:19.403 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-14T10:18:19.403 INFO:teuthology.orchestra.run.smithi092.stdout:fi 2023-10-14T10:18:19.404 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -qi grub2-tools 2023-10-14T10:18:19.499 INFO:teuthology.orchestra.run.smithi092.stdout:Name : grub2-tools 2023-10-14T10:18:19.500 INFO:teuthology.orchestra.run.smithi092.stdout:Epoch : 1 2023-10-14T10:18:19.500 INFO:teuthology.orchestra.run.smithi092.stdout:Version : 2.06 2023-10-14T10:18:19.500 INFO:teuthology.orchestra.run.smithi092.stdout:Release : 68.el9 2023-10-14T10:18:19.500 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: x86_64 2023-10-14T10:18:19.500 INFO:teuthology.orchestra.run.smithi092.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-14T10:18:19.501 INFO:teuthology.orchestra.run.smithi092.stdout:Group : Unspecified 2023-10-14T10:18:19.501 INFO:teuthology.orchestra.run.smithi092.stdout:Size : 8264254 2023-10-14T10:18:19.501 INFO:teuthology.orchestra.run.smithi092.stdout:License : GPLv3+ 2023-10-14T10:18:19.501 INFO:teuthology.orchestra.run.smithi092.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-14T10:18:19.501 INFO:teuthology.orchestra.run.smithi092.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-14T10:18:19.501 INFO:teuthology.orchestra.run.smithi092.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-14T10:18:19.502 INFO:teuthology.orchestra.run.smithi092.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-14T10:18:19.502 INFO:teuthology.orchestra.run.smithi092.stdout:Packager : builder@centos.org 2023-10-14T10:18:19.502 INFO:teuthology.orchestra.run.smithi092.stdout:Vendor : CentOS 2023-10-14T10:18:19.502 INFO:teuthology.orchestra.run.smithi092.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T10:18:19.502 INFO:teuthology.orchestra.run.smithi092.stdout:Summary : Support tools for GRUB. 2023-10-14T10:18:19.503 INFO:teuthology.orchestra.run.smithi092.stdout:Description : 2023-10-14T10:18:19.503 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:18:19.503 INFO:teuthology.orchestra.run.smithi092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T10:18:19.503 INFO:teuthology.orchestra.run.smithi092.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T10:18:19.503 INFO:teuthology.orchestra.run.smithi092.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T10:18:19.504 INFO:teuthology.orchestra.run.smithi092.stdout:hardware devices. 2023-10-14T10:18:19.504 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:18:19.504 INFO:teuthology.orchestra.run.smithi092.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T10:18:19.505 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T10:18:19.505 INFO:teuthology.task.kernel:Updating grub on smithi092 to boot 6.6.0-rc5-g47672119149b 2023-10-14T10:18:19.506 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T10:18:20.088 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2023-10-14T10:18:21.488 INFO:teuthology.orchestra.run.smithi092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-14T10:18:21.516 INFO:teuthology.orchestra.run.smithi092.stderr:done 2023-10-14T10:18:21.518 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2023-10-14T10:18:21.533 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.gd1OBYTK4c 2023-10-14T10:18:21.534 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gd1OBYTK4c 2023-10-14T10:18:21.610 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.gd1OBYTK4c 2023-10-14T10:18:21.753 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.gd1OBYTK4c is 6KB 2023-10-14T10:18:21.801 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.gd1OBYTK4c 2023-10-14T10:18:21.815 DEBUG:teuthology.orchestra.run.smithi092:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T10:18:21.881 INFO:teuthology.orchestra.run.smithi092.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-14T10:18:21.881 INFO:teuthology.orchestra.run.smithi092.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-14T10:18:21.881 INFO:teuthology.orchestra.run.smithi092.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-14T10:18:21.881 INFO:teuthology.orchestra.run.smithi092.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-14T10:18:21.882 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-14T10:18:22.032 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2023-10-14T10:18:45.218 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-14T10:18:45.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-14T10:18:45.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:18:52.038 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-14T10:18:52.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-14T10:18:52.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:19:03.678 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-14T10:19:12.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-14T10:19:12.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:19:15.742 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-14T10:19:26.718 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-14T10:19:27.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-14T10:19:27.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:19:35.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-14T10:19:35.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:19:54.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-14T10:19:59.584 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-14T10:20:00.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-14T10:20:00.209 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-rc5-g47672119149b"... 2023-10-14T10:20:00.209 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-14T10:20:00.250 INFO:teuthology.orchestra.run.smithi008.stdout:6.6.0-rc5-g47672119149b 2023-10-14T10:20:00.250 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-14T10:20:00.250 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T10:20:00.251 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-14T10:20:01.252 DEBUG:teuthology.parallel:result is None 2023-10-14T10:20:06.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-14T10:20:06.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:20:09.182 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-14T10:20:24.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-14T10:20:24.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:20:24.541 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-10-14T10:20:25.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-14T10:20:25.311 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-rc5-g47672119149b"... 2023-10-14T10:20:25.311 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2023-10-14T10:20:25.360 INFO:teuthology.orchestra.run.smithi092.stdout:6.6.0-rc5-g47672119149b 2023-10-14T10:20:25.361 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-14T10:20:25.361 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T10:20:25.361 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-14T10:20:26.362 DEBUG:teuthology.parallel:result is None 2023-10-14T10:20:26.363 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T10:20:26.372 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T10:20:26.373 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T10:20:26.383 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T10:20:26.470 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T10:20:26.477 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T10:20:26.542 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T10:20:26.543 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T10:20:26.552 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T10:20:26.648 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T10:20:26.655 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T10:20:26.656 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T10:20:26.666 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T10:20:26.827 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T10:20:26.881 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T10:20:26.901 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T10:20:26.971 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T10:20:26.977 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T10:20:26.986 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T10:20:26.986 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T10:20:26.995 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T10:20:27.118 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T10:20:27.128 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T10:20:27.128 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T10:20:27.137 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T10:20:27.208 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T10:20:27.298 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T10:20:27.412 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T10:20:27.502 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T10:20:27.608 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:20:27.609 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T10:20:27.712 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T10:20:27.789 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T10:20:27.910 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T10:20:27.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T10:20:28.065 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:20:28.066 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T10:20:28.140 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2023-10-14T10:20:28.149 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2023-10-14T10:20:28.300 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T10:20:28.304 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T10:20:28.754 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T10:20:28.762 INFO:teuthology.task.internal:Starting timer... 2023-10-14T10:20:28.763 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T10:20:28.818 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T10:20:28.850 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2023-10-14T10:20:29.008 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: 2023-10-14T10:20:29.014 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2023-10-14T10:20:29.124 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2023-10-14T10:20:29.128 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T10:20:29.128 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2023-10-14T10:20:29.205 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2023-10-14T10:20:29.206 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2023-10-14T10:20:29.257 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2023-10-14T10:20:29.258 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi092.front.sepia.ceph.com': 'permissive'} 2023-10-14T10:20:29.258 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T10:20:29.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T10:20:29.358 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T10:20:29.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T10:20:29.445 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T10:20:29.445 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2023-10-14T10:20:29.570 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2023-10-14T10:20:29.730 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T10:20:29.741 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-14T10:20:29.741 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T10:20:29.757 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T10:20:29.759 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi092.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T10:30:44.042 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com')] 2023-10-14T10:30:44.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-14T10:30:44.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:30:44.190 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-14T10:30:44.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-14T10:30:44.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-14T10:30:44.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T10:30:44.481 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-10-14T10:30:44.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-14T10:30:44.633 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T10:30:44.644 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T10:30:44.644 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T10:30:44.645 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T10:30:44.653 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T10:30:44.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T10:30:44.757 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T10:30:44.760 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T10:30:44.808 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T10:30:44.818 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T10:30:44.896 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2023-10-14T10:30:44.922 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2023-10-14T10:30:44.933 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2023-10-14T10:30:44.961 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2023-10-14T10:30:44.980 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T10:30:45.010 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T10:30:45.029 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T10:30:45.063 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T10:30:45.162 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2023-10-14T10:30:45.265 INFO:teuthology.orchestra.run.smithi008.stderr:bash: line 1: ntpq: command not found 2023-10-14T10:30:45.267 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T10:30:45.267 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-10-14T10:30:45.267 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T10:30:45.268 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T10:30:45.268 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T10:30:45.268 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T10:30:45.268 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T10:30:45.268 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-10-14T10:30:45.269 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T10:30:45.269 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T10:30:45.269 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T10:30:45.269 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T10:30:45.269 INFO:teuthology.run_tasks:Running task install... 2023-10-14T10:30:45.278 DEBUG:teuthology.task.install:project ceph 2023-10-14T10:30:45.279 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-14T10:30:45.279 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-14T10:30:45.279 INFO:teuthology.task.install:Using flavor: default 2023-10-14T10:30:45.285 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T10:30:45.286 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-14T10:30:45.286 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T10:30:45.287 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T10:30:45.289 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T10:30:45.289 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T10:30:45.431 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/ 2023-10-14T10:30:45.432 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T10:30:45.439 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/ 2023-10-14T10:30:45.439 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T10:30:45.611 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T10:30:45.611 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:30:45.612 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T10:30:45.646 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T10:30:45.646 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:30:45.647 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T10:30:45.725 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T10:30:45.725 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T10:30:45.752 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T10:30:45.752 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T10:30:45.868 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T10:30:45.895 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T10:30:46.010 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T10:30:46.018 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T10:30:46.107 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2023-10-14T10:30:46.111 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2023-10-14T10:30:46.112 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2023-10-14T10:30:46.115 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2023-10-14T10:30:46.473 INFO:teuthology.orchestra.run.smithi008.stdout:70 files removed 2023-10-14T10:30:46.474 INFO:teuthology.orchestra.run.smithi092.stdout:70 files removed 2023-10-14T10:30:46.512 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T10:30:46.514 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T10:30:47.431 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 200 kB/s | 78 kB 00:00 2023-10-14T10:30:47.533 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 151 kB/s | 78 kB 00:00 2023-10-14T10:30:47.939 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 23 kB/s | 9.4 kB 00:00 2023-10-14T10:30:48.075 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 21 kB/s | 9.4 kB 00:00 2023-10-14T10:30:48.465 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2023-10-14T10:30:48.584 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2023-10-14T10:30:49.127 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - AppStream 11 MB/s | 6.3 MB 00:00 2023-10-14T10:30:49.281 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS-9 - AppStream 10 MB/s | 6.3 MB 00:00 2023-10-14T10:30:50.694 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2023-10-14T10:30:50.933 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS-9 - BaseOS 5.5 MB/s | 2.0 MB 00:00 2023-10-14T10:30:52.834 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 7.9 MB 00:01 2023-10-14T10:30:53.948 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 7.9 MB 00:02 2023-10-14T10:30:55.663 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 11 MB/s | 18 MB 00:01 2023-10-14T10:30:57.358 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 18 MB 00:02 2023-10-14T10:30:59.764 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 11 MB/s | 5.7 MB 00:00 2023-10-14T10:31:01.289 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 14 kB 00:00 2023-10-14T10:31:02.742 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 5.7 MB 00:01 2023-10-14T10:31:03.913 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 19 MB 00:02 2023-10-14T10:31:05.121 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 14 kB 00:01 2023-10-14T10:31:08.974 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-10-14T10:31:09.019 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 5.1 MB/s | 19 MB 00:03 2023-10-14T10:31:11.441 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-14T10:31:11.443 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-14T10:31:11.462 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-14T10:31:11.463 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-14T10:31:11.465 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-14T10:31:11.466 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-14T10:31:11.468 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-14T10:31:11.472 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-14T10:31:11.473 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-14T10:31:11.550 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-10-14T10:31:11.566 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================ 2023-10-14T10:31:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-10-14T10:31:11.566 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================ 2023-10-14T10:31:11.566 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-10-14T10:31:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-14T10:31:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 6.5 k 2023-10-14T10:31:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.2 M 2023-10-14T10:31:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 855 k 2023-10-14T10:31:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 141 k 2023-10-14T10:31:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.5 M 2023-10-14T10:31:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 132 k 2023-10-14T10:31:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 1.8 M 2023-10-14T10:31:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 7.4 M 2023-10-14T10:31:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 47 k 2023-10-14T10:31:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 8.6 M 2023-10-14T10:31:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 41 M 2023-10-14T10:31:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 262 k 2023-10-14T10:31:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 269 k 2023-10-14T10:31:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 218 k 2023-10-14T10:31:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 18 k 2023-10-14T10:31:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-14T10:31:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-14T10:31:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-14T10:31:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 31 k 2023-10-14T10:31:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 715 k 2023-10-14T10:31:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-14T10:31:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-14T10:31:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-14T10:31:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-14T10:31:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-14T10:31:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-14T10:31:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-14T10:31:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 162 k 2023-10-14T10:31:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 321 k 2023-10-14T10:31:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 298 k 2023-10-14T10:31:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 99 k 2023-10-14T10:31:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 85 k 2023-10-14T10:31:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-14T10:31:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 169 k 2023-10-14T10:31:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-14T10:31:11.574 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2023-10-14T10:31:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-14T10:31:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-14T10:31:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-14T10:31:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-14T10:31:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-14T10:31:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-14T10:31:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-14T10:31:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.3 M 2023-10-14T10:31:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-14T10:31:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-14T10:31:11.576 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-10-14T10:31:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-14T10:31:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-14T10:31:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-14T10:31:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 23 k 2023-10-14T10:31:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 2.1 M 2023-10-14T10:31:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 242 k 2023-10-14T10:31:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.4 M 2023-10-14T10:31:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 18 M 2023-10-14T10:31:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 15 k 2023-10-14T10:31:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 24 k 2023-10-14T10:31:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-14T10:31:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-14T10:31:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-14T10:31:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-14T10:31:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-14T10:31:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-14T10:31:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-14T10:31:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-14T10:31:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-14T10:31:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 163 k 2023-10-14T10:31:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-14T10:31:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-14T10:31:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-14T10:31:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-14T10:31:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-14T10:31:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 472 k 2023-10-14T10:31:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-14T10:31:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.8 M 2023-10-14T10:31:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-14T10:31:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-14T10:31:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-14T10:31:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-14T10:31:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-14T10:31:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-14T10:31:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-14T10:31:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-14T10:31:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-14T10:31:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-14T10:31:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-14T10:31:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-14T10:31:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 k 2023-10-14T10:31:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-14T10:31:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-14T10:31:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-14T10:31:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-14T10:31:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-14T10:31:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-14T10:31:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-14T10:31:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-14T10:31:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-14T10:31:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-14T10:31:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-14T10:31:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-14T10:31:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-14T10:31:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-14T10:31:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-14T10:31:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-14T10:31:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-14T10:31:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-14T10:31:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-14T10:31:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-14T10:31:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-14T10:31:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-14T10:31:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-14T10:31:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-14T10:31:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-14T10:31:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-14T10:31:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-14T10:31:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-14T10:31:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-14T10:31:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-14T10:31:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-14T10:31:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-14T10:31:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-14T10:31:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-14T10:31:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-14T10:31:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-14T10:31:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-14T10:31:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-14T10:31:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-14T10:31:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-14T10:31:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-14T10:31:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-14T10:31:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-14T10:31:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-14T10:31:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-14T10:31:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-14T10:31:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-14T10:31:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-14T10:31:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-14T10:31:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-14T10:31:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-14T10:31:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-14T10:31:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-14T10:31:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-14T10:31:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-14T10:31:11.595 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2023-10-14T10:31:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-14T10:31:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:31:11.595 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-10-14T10:31:11.596 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================ 2023-10-14T10:31:11.596 INFO:teuthology.orchestra.run.smithi092.stdout:Install 133 Packages 2023-10-14T10:31:11.596 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 10 Packages 2023-10-14T10:31:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:31:11.597 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 199 M 2023-10-14T10:31:11.597 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-10-14T10:31:12.259 INFO:teuthology.orchestra.run.smithi092.stdout:(1/143): ceph-18.0.0-6730.g4ba8a190.el9.x86_64. 25 kB/s | 6.5 kB 00:00 2023-10-14T10:31:12.517 INFO:teuthology.orchestra.run.smithi092.stdout:(2/143): ceph-fuse-18.0.0-6730.g4ba8a190.el9.x8 3.2 MB/s | 855 kB 00:00 2023-10-14T10:31:12.601 INFO:teuthology.orchestra.run.smithi092.stdout:(3/143): ceph-immutable-object-cache-18.0.0-673 1.7 MB/s | 141 kB 00:00 2023-10-14T10:31:12.742 INFO:teuthology.orchestra.run.smithi092.stdout:(4/143): ceph-base-18.0.0-6730.g4ba8a190.el9.x8 6.9 MB/s | 5.2 MB 00:00 2023-10-14T10:31:12.951 INFO:teuthology.orchestra.run.smithi092.stdout:(5/143): ceph-mgr-18.0.0-6730.g4ba8a190.el9.x86 7.0 MB/s | 1.5 MB 00:00 2023-10-14T10:31:13.027 INFO:teuthology.orchestra.run.smithi092.stdout:(6/143): ceph-mds-18.0.0-6730.g4ba8a190.el9.x86 4.9 MB/s | 2.1 MB 00:00 2023-10-14T10:31:13.352 INFO:teuthology.orchestra.run.smithi092.stdout:(7/143): ceph-mon-18.0.0-6730.g4ba8a190.el9.x86 11 MB/s | 4.4 MB 00:00 2023-10-14T10:31:13.911 INFO:teuthology.orchestra.run.smithi092.stdout:(8/143): ceph-common-18.0.0-6730.g4ba8a190.el9. 9.9 MB/s | 19 MB 00:01 2023-10-14T10:31:13.977 INFO:teuthology.orchestra.run.smithi092.stdout:(9/143): ceph-selinux-18.0.0-6730.g4ba8a190.el9 367 kB/s | 24 kB 00:00 2023-10-14T10:31:14.281 INFO:teuthology.orchestra.run.smithi092.stdout:(10/143): ceph-radosgw-18.0.0-6730.g4ba8a190.el 9.3 MB/s | 8.6 MB 00:00 2023-10-14T10:31:14.356 INFO:teuthology.orchestra.run.smithi092.stdout:(11/143): cephfs-mirror-18.0.0-6730.g4ba8a190.e 2.9 MB/s | 218 kB 00:00 2023-10-14T10:31:14.423 INFO:teuthology.orchestra.run.smithi092.stdout:(12/143): libcephfs-devel-18.0.0-6730.g4ba8a190 472 kB/s | 31 kB 00:00 2023-10-14T10:31:14.436 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2023-10-14T10:31:14.565 INFO:teuthology.orchestra.run.smithi092.stdout:(13/143): libcephfs2-18.0.0-6730.g4ba8a190.el9. 5.0 MB/s | 715 kB 00:00 2023-10-14T10:31:14.640 INFO:teuthology.orchestra.run.smithi092.stdout:(14/143): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.2 MB/s | 163 kB 00:00 2023-10-14T10:31:14.716 INFO:teuthology.orchestra.run.smithi092.stdout:(15/143): librados-devel-18.0.0-6730.g4ba8a190. 1.7 MB/s | 127 kB 00:00 2023-10-14T10:31:14.807 INFO:teuthology.orchestra.run.smithi092.stdout:(16/143): libradosstriper1-18.0.0-6730.g4ba8a19 5.1 MB/s | 472 kB 00:00 2023-10-14T10:31:15.400 INFO:teuthology.orchestra.run.smithi092.stdout:(17/143): librgw2-18.0.0-6730.g4ba8a190.el9.x86 8.1 MB/s | 4.8 MB 00:00 2023-10-14T10:31:15.499 INFO:teuthology.orchestra.run.smithi092.stdout:(18/143): python3-ceph-argparse-18.0.0-6730.g4b 460 kB/s | 45 kB 00:00 2023-10-14T10:31:15.567 INFO:teuthology.orchestra.run.smithi092.stdout:(19/143): python3-ceph-common-18.0.0-6730.g4ba8 1.9 MB/s | 127 kB 00:00 2023-10-14T10:31:15.642 INFO:teuthology.orchestra.run.smithi092.stdout:(20/143): python3-cephfs-18.0.0-6730.g4ba8a190. 2.1 MB/s | 162 kB 00:00 2023-10-14T10:31:15.743 INFO:teuthology.orchestra.run.smithi092.stdout:(21/143): python3-rados-18.0.0-6730.g4ba8a190.e 3.2 MB/s | 321 kB 00:00 2023-10-14T10:31:15.969 INFO:teuthology.orchestra.run.smithi092.stdout:(22/143): ceph-osd-18.0.0-6730.g4ba8a190.el9.x8 6.0 MB/s | 18 MB 00:02 2023-10-14T10:31:16.002 INFO:teuthology.orchestra.run.smithi092.stdout:(23/143): python3-rbd-18.0.0-6730.g4ba8a190.el9 1.1 MB/s | 298 kB 00:00 2023-10-14T10:31:16.035 INFO:teuthology.orchestra.run.smithi092.stdout:(24/143): python3-rgw-18.0.0-6730.g4ba8a190.el9 1.5 MB/s | 99 kB 00:00 2023-10-14T10:31:16.060 INFO:teuthology.orchestra.run.smithi092.stdout:(25/143): rbd-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.4 MB/s | 85 kB 00:00 2023-10-14T10:31:16.140 INFO:teuthology.orchestra.run.smithi092.stdout:(26/143): rbd-nbd-18.0.0-6730.g4ba8a190.el9.x86 2.1 MB/s | 169 kB 00:00 2023-10-14T10:31:16.194 INFO:teuthology.orchestra.run.smithi092.stdout:(27/143): ceph-grafana-dashboards-18.0.0-6730.g 440 kB/s | 23 kB 00:00 2023-10-14T10:31:16.261 INFO:teuthology.orchestra.run.smithi092.stdout:(28/143): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 2.0 MB/s | 132 kB 00:00 2023-10-14T10:31:16.545 INFO:teuthology.orchestra.run.smithi092.stdout:(29/143): rbd-mirror-18.0.0-6730.g4ba8a190.el9. 5.9 MB/s | 3.0 MB 00:00 2023-10-14T10:31:16.604 INFO:teuthology.orchestra.run.smithi092.stdout:(30/143): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 5.2 MB/s | 1.8 MB 00:00 2023-10-14T10:31:16.662 INFO:teuthology.orchestra.run.smithi092.stdout:(31/143): ceph-mgr-modules-core-18.0.0-6730.g4b 4.1 MB/s | 242 kB 00:00 2023-10-14T10:31:17.088 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-14T10:31:17.090 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-14T10:31:17.096 INFO:teuthology.orchestra.run.smithi092.stdout:(32/143): ceph-test-18.0.0-6730.g4ba8a190.el9.x 13 MB/s | 41 MB 00:03 2023-10-14T10:31:17.112 INFO:teuthology.orchestra.run.smithi008.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-14T10:31:17.113 INFO:teuthology.orchestra.run.smithi092.stdout:(33/143): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 106 kB/s | 47 kB 00:00 2023-10-14T10:31:17.113 INFO:teuthology.orchestra.run.smithi008.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-14T10:31:17.115 INFO:teuthology.orchestra.run.smithi008.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-14T10:31:17.117 INFO:teuthology.orchestra.run.smithi008.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-14T10:31:17.119 INFO:teuthology.orchestra.run.smithi008.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-14T10:31:17.124 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-14T10:31:17.125 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-14T10:31:17.138 INFO:teuthology.orchestra.run.smithi092.stdout:(34/143): ceph-prometheus-alerts-18.0.0-6730.g4 368 kB/s | 15 kB 00:00 2023-10-14T10:31:17.172 INFO:teuthology.orchestra.run.smithi092.stdout:(35/143): ceph-volume-18.0.0-6730.g4ba8a190.el9 4.4 MB/s | 262 kB 00:00 2023-10-14T10:31:17.210 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T10:31:17.222 INFO:teuthology.orchestra.run.smithi092.stdout:(36/143): cephadm-18.0.0-6730.g4ba8a190.el9.noa 3.2 MB/s | 269 kB 00:00 2023-10-14T10:31:17.232 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2023-10-14T10:31:17.232 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T10:31:17.232 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2023-10-14T10:31:17.232 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T10:31:17.233 INFO:teuthology.orchestra.run.smithi008.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-14T10:31:17.233 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 6.5 k 2023-10-14T10:31:17.233 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.2 M 2023-10-14T10:31:17.233 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 855 k 2023-10-14T10:31:17.234 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 141 k 2023-10-14T10:31:17.234 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.5 M 2023-10-14T10:31:17.234 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 132 k 2023-10-14T10:31:17.234 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 1.8 M 2023-10-14T10:31:17.235 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 7.4 M 2023-10-14T10:31:17.235 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 47 k 2023-10-14T10:31:17.235 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 8.6 M 2023-10-14T10:31:17.235 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 41 M 2023-10-14T10:31:17.235 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 262 k 2023-10-14T10:31:17.236 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 269 k 2023-10-14T10:31:17.236 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 218 k 2023-10-14T10:31:17.236 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 18 k 2023-10-14T10:31:17.236 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-14T10:31:17.236 INFO:teuthology.orchestra.run.smithi008.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-14T10:31:17.236 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-14T10:31:17.237 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 31 k 2023-10-14T10:31:17.237 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 715 k 2023-10-14T10:31:17.237 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-14T10:31:17.237 INFO:teuthology.orchestra.run.smithi008.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-14T10:31:17.237 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-14T10:31:17.238 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-14T10:31:17.238 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-14T10:31:17.238 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-14T10:31:17.238 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-14T10:31:17.238 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 162 k 2023-10-14T10:31:17.239 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 321 k 2023-10-14T10:31:17.239 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 298 k 2023-10-14T10:31:17.239 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 99 k 2023-10-14T10:31:17.239 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 85 k 2023-10-14T10:31:17.239 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-14T10:31:17.240 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 169 k 2023-10-14T10:31:17.240 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-14T10:31:17.240 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-10-14T10:31:17.240 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-14T10:31:17.240 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-14T10:31:17.240 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-14T10:31:17.241 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-14T10:31:17.241 INFO:teuthology.orchestra.run.smithi008.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-14T10:31:17.241 INFO:teuthology.orchestra.run.smithi008.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-14T10:31:17.241 INFO:teuthology.orchestra.run.smithi008.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-14T10:31:17.242 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.3 M 2023-10-14T10:31:17.242 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-14T10:31:17.242 INFO:teuthology.orchestra.run.smithi008.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-14T10:31:17.243 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-14T10:31:17.243 INFO:teuthology.orchestra.run.smithi008.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-14T10:31:17.243 INFO:teuthology.orchestra.run.smithi008.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-14T10:31:17.244 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-14T10:31:17.244 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 23 k 2023-10-14T10:31:17.244 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 2.1 M 2023-10-14T10:31:17.245 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 242 k 2023-10-14T10:31:17.245 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.4 M 2023-10-14T10:31:17.246 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 18 M 2023-10-14T10:31:17.246 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 15 k 2023-10-14T10:31:17.246 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 24 k 2023-10-14T10:31:17.247 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-14T10:31:17.247 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-14T10:31:17.247 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-14T10:31:17.248 INFO:teuthology.orchestra.run.smithi008.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-14T10:31:17.248 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-14T10:31:17.248 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-14T10:31:17.249 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-14T10:31:17.249 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-14T10:31:17.250 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-14T10:31:17.250 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 163 k 2023-10-14T10:31:17.250 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-14T10:31:17.251 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-14T10:31:17.251 INFO:teuthology.orchestra.run.smithi008.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-14T10:31:17.251 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-14T10:31:17.252 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-14T10:31:17.252 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 472 k 2023-10-14T10:31:17.252 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-14T10:31:17.253 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.8 M 2023-10-14T10:31:17.253 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-14T10:31:17.254 INFO:teuthology.orchestra.run.smithi008.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-14T10:31:17.254 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-14T10:31:17.254 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-14T10:31:17.255 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-14T10:31:17.255 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-14T10:31:17.255 INFO:teuthology.orchestra.run.smithi008.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-14T10:31:17.256 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-14T10:31:17.256 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-14T10:31:17.256 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-14T10:31:17.257 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-14T10:31:17.257 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-14T10:31:17.258 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 k 2023-10-14T10:31:17.258 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-14T10:31:17.258 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-14T10:31:17.259 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-14T10:31:17.259 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-14T10:31:17.259 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-14T10:31:17.260 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-14T10:31:17.260 INFO:teuthology.orchestra.run.smithi008.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-14T10:31:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-14T10:31:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-14T10:31:17.261 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-14T10:31:17.262 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-14T10:31:17.262 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-14T10:31:17.262 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-14T10:31:17.263 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-14T10:31:17.263 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-14T10:31:17.264 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-14T10:31:17.264 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-14T10:31:17.264 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-14T10:31:17.265 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-14T10:31:17.265 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-14T10:31:17.265 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-14T10:31:17.266 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-14T10:31:17.266 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-14T10:31:17.267 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-14T10:31:17.267 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-14T10:31:17.267 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-14T10:31:17.268 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-14T10:31:17.268 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-14T10:31:17.268 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-14T10:31:17.269 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-14T10:31:17.269 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-14T10:31:17.269 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-14T10:31:17.270 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-14T10:31:17.270 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-14T10:31:17.271 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-14T10:31:17.271 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-14T10:31:17.271 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-14T10:31:17.272 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-14T10:31:17.272 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-14T10:31:17.272 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-14T10:31:17.273 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-14T10:31:17.273 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-14T10:31:17.274 INFO:teuthology.orchestra.run.smithi008.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-14T10:31:17.274 INFO:teuthology.orchestra.run.smithi008.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-14T10:31:17.274 INFO:teuthology.orchestra.run.smithi008.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-14T10:31:17.275 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-14T10:31:17.275 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-14T10:31:17.275 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-14T10:31:17.276 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-14T10:31:17.276 INFO:teuthology.orchestra.run.smithi008.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-14T10:31:17.276 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-14T10:31:17.277 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-14T10:31:17.277 INFO:teuthology.orchestra.run.smithi008.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-14T10:31:17.278 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-14T10:31:17.278 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-14T10:31:17.278 INFO:teuthology.orchestra.run.smithi008.stdout:Installing weak dependencies: 2023-10-14T10:31:17.279 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-14T10:31:17.279 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:31:17.279 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T10:31:17.279 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2023-10-14T10:31:17.280 INFO:teuthology.orchestra.run.smithi008.stdout:Install 133 Packages 2023-10-14T10:31:17.280 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 10 Packages 2023-10-14T10:31:17.280 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:31:17.281 INFO:teuthology.orchestra.run.smithi092.stdout:(37/143): cephfs-top-18.0.0-6730.g4ba8a190.el9. 244 kB/s | 18 kB 00:00 2023-10-14T10:31:17.282 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 199 M 2023-10-14T10:31:17.282 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T10:31:17.498 INFO:teuthology.orchestra.run.smithi092.stdout:(38/143): ceph-mgr-diskprediction-local-18.0.0- 7.8 MB/s | 7.4 MB 00:00 2023-10-14T10:31:17.531 INFO:teuthology.orchestra.run.smithi092.stdout:(39/143): boost-program-options-1.75.0-8.el9.x8 374 kB/s | 106 kB 00:00 2023-10-14T10:31:17.590 INFO:teuthology.orchestra.run.smithi092.stdout:(40/143): bison-3.7.4-5.el9.x86_64.rpm 2.5 MB/s | 920 kB 00:00 2023-10-14T10:31:17.624 INFO:teuthology.orchestra.run.smithi092.stdout:(41/143): flex-2.6.4-9.el9.x86_64.rpm 2.5 MB/s | 307 kB 00:00 2023-10-14T10:31:17.649 INFO:teuthology.orchestra.run.smithi092.stdout:(42/143): flexiblas-3.0.4-8.el9.x86_64.rpm 277 kB/s | 32 kB 00:00 2023-10-14T10:31:17.832 INFO:teuthology.orchestra.run.smithi092.stdout:(43/143): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2023-10-14T10:31:17.857 INFO:teuthology.orchestra.run.smithi092.stdout:(44/143): flexiblas-openblas-openmp-3.0.4-8.el9 85 kB/s | 17 kB 00:00 2023-10-14T10:31:17.883 INFO:teuthology.orchestra.run.smithi092.stdout:(45/143): libaio-devel-0.3.111-13.el9.x86_64.rp 45 kB/s | 10 kB 00:00 2023-10-14T10:31:17.958 INFO:teuthology.orchestra.run.smithi092.stdout:(46/143): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-10-14T10:31:17.971 INFO:teuthology.orchestra.run.smithi008.stdout:(1/143): ceph-18.0.0-6730.g4ba8a190.el9.x86_64. 23 kB/s | 6.5 kB 00:00 2023-10-14T10:31:18.000 INFO:teuthology.orchestra.run.smithi092.stdout:(47/143): librdkafka-1.6.1-102.el9.x86_64.rpm 5.6 MB/s | 661 kB 00:00 2023-10-14T10:31:18.065 INFO:teuthology.orchestra.run.smithi092.stdout:(48/143): libtool-2.4.6-45.el9.x86_64.rpm 3.1 MB/s | 578 kB 00:00 2023-10-14T10:31:18.101 INFO:teuthology.orchestra.run.smithi092.stdout:(49/143): libzstd-devel-1.5.1-2.el9.x86_64.rpm 337 kB/s | 46 kB 00:00 2023-10-14T10:31:18.134 INFO:teuthology.orchestra.run.smithi092.stdout:(50/143): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2023-10-14T10:31:18.168 INFO:teuthology.orchestra.run.smithi092.stdout:(51/143): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.7 MB/s | 282 kB 00:00 2023-10-14T10:31:18.193 INFO:teuthology.orchestra.run.smithi092.stdout:(52/143): openblas-0.3.21-2.el9.x86_64.rpm 382 kB/s | 34 kB 00:00 2023-10-14T10:31:18.418 INFO:teuthology.orchestra.run.smithi092.stdout:(53/143): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2023-10-14T10:31:18.460 INFO:teuthology.orchestra.run.smithi092.stdout:(54/143): postgresql-contrib-13.11-1.el9.x86_64 3.1 MB/s | 811 kB 00:00 2023-10-14T10:31:18.519 INFO:teuthology.orchestra.run.smithi092.stdout:(55/143): postgresql-13.11-1.el9.x86_64.rpm 4.9 MB/s | 1.5 MB 00:00 2023-10-14T10:31:18.530 INFO:teuthology.orchestra.run.smithi008.stdout:(2/143): ceph-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.5 MB/s | 855 kB 00:00 2023-10-14T10:31:18.544 INFO:teuthology.orchestra.run.smithi092.stdout:(56/143): postgresql-private-libs-13.11-1.el9.x 1.1 MB/s | 134 kB 00:00 2023-10-14T10:31:18.755 INFO:teuthology.orchestra.run.smithi008.stdout:(3/143): ceph-immutable-object-cache-18.0.0-673 631 kB/s | 141 kB 00:00 2023-10-14T10:31:18.795 INFO:teuthology.orchestra.run.smithi092.stdout:(57/143): postgresql-server-13.11-1.el9.x86_64. 18 MB/s | 5.7 MB 00:00 2023-10-14T10:31:18.828 INFO:teuthology.orchestra.run.smithi092.stdout:(58/143): python3-devel-3.9.17-2.el9.x86_64.rpm 761 kB/s | 205 kB 00:00 2023-10-14T10:31:19.020 INFO:teuthology.orchestra.run.smithi092.stdout:(59/143): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 5.8 MB 00:00 2023-10-14T10:31:19.047 INFO:teuthology.orchestra.run.smithi008.stdout:(4/143): ceph-common-18.0.0-6730.g4ba8a190.el9. 14 MB/s | 19 MB 00:01 2023-10-14T10:31:19.054 INFO:teuthology.orchestra.run.smithi092.stdout:(60/143): python3-jinja2-2.11.3-4.el9.noarch.rp 904 kB/s | 228 kB 00:00 2023-10-14T10:31:19.079 INFO:teuthology.orchestra.run.smithi092.stdout:(61/143): python3-jsonpatch-1.21-16.el9.noarch. 103 kB/s | 24 kB 00:00 2023-10-14T10:31:19.096 INFO:teuthology.orchestra.run.smithi092.stdout:(62/143): python3-jsonpointer-2.0-4.el9.noarch. 250 kB/s | 18 kB 00:00 2023-10-14T10:31:19.121 INFO:teuthology.orchestra.run.smithi092.stdout:(63/143): python3-markupsafe-1.1.1-12.el9.x86_6 778 kB/s | 32 kB 00:00 2023-10-14T10:31:19.154 INFO:teuthology.orchestra.run.smithi092.stdout:(64/143): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-10-14T10:31:19.172 INFO:teuthology.orchestra.run.smithi008.stdout:(5/143): ceph-mgr-18.0.0-6730.g4ba8a190.el9.x86 12 MB/s | 1.5 MB 00:00 2023-10-14T10:31:19.382 INFO:teuthology.orchestra.run.smithi092.stdout:(65/143): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 4.8 MB 00:00 2023-10-14T10:31:19.414 INFO:teuthology.orchestra.run.smithi092.stdout:(66/143): python3-numpy-f2py-1.20.1-5.el9.x86_6 753 kB/s | 217 kB 00:00 2023-10-14T10:31:19.439 INFO:teuthology.orchestra.run.smithi092.stdout:(67/143): python3-oauthlib-3.1.1-5.el9.noarch.r 640 kB/s | 174 kB 00:00 2023-10-14T10:31:19.472 INFO:teuthology.orchestra.run.smithi092.stdout:(68/143): python3-prettytable-0.7.2-27.el9.noar 464 kB/s | 41 kB 00:00 2023-10-14T10:31:19.488 INFO:teuthology.orchestra.run.smithi008.stdout:(6/143): ceph-mon-18.0.0-6730.g4ba8a190.el9.x86 14 MB/s | 4.4 MB 00:00 2023-10-14T10:31:19.506 INFO:teuthology.orchestra.run.smithi092.stdout:(69/143): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2023-10-14T10:31:19.531 INFO:teuthology.orchestra.run.smithi092.stdout:(70/143): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2023-10-14T10:31:19.556 INFO:teuthology.orchestra.run.smithi092.stdout:(71/143): python3-requests-oauthlib-1.3.0-12.el 534 kB/s | 43 kB 00:00 2023-10-14T10:31:19.598 INFO:teuthology.orchestra.run.smithi008.stdout:(7/143): ceph-base-18.0.0-6730.g4ba8a190.el9.x8 2.7 MB/s | 5.2 MB 00:01 2023-10-14T10:31:19.599 INFO:teuthology.orchestra.run.smithi092.stdout:(72/143): python3-toml-0.10.2-6.el9.noarch.rpm 591 kB/s | 39 kB 00:00 2023-10-14T10:31:19.681 INFO:teuthology.orchestra.run.smithi008.stdout:(8/143): ceph-mds-18.0.0-6730.g4ba8a190.el9.x86 2.3 MB/s | 2.1 MB 00:00 2023-10-14T10:31:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:(9/143): ceph-selinux-18.0.0-6730.g4ba8a190.el9 364 kB/s | 24 kB 00:00 2023-10-14T10:31:19.874 INFO:teuthology.orchestra.run.smithi092.stdout:(73/143): socat-1.7.4.1-5.el9.x86_64.rpm 954 kB/s | 300 kB 00:00 2023-10-14T10:31:19.899 INFO:teuthology.orchestra.run.smithi092.stdout:(74/143): uuid-1.6.2-55.el9.x86_64.rpm 195 kB/s | 56 kB 00:00 2023-10-14T10:31:20.225 INFO:teuthology.orchestra.run.smithi092.stdout:(75/143): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2023-10-14T10:31:20.258 INFO:teuthology.orchestra.run.smithi092.stdout:(76/143): xmlstarlet-1.6.1-20.el9.x86_64.rpm 164 kB/s | 63 kB 00:00 2023-10-14T10:31:20.283 INFO:teuthology.orchestra.run.smithi092.stdout:(77/143): fuse-2.9.9-15.el9.x86_64.rpm 213 kB/s | 79 kB 00:00 2023-10-14T10:31:20.326 INFO:teuthology.orchestra.run.smithi092.stdout:(78/143): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.0 MB/s | 803 kB 00:00 2023-10-14T10:31:20.359 INFO:teuthology.orchestra.run.smithi092.stdout:(79/143): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.8 MB/s | 195 kB 00:00 2023-10-14T10:31:20.384 INFO:teuthology.orchestra.run.smithi092.stdout:(80/143): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 241 kB 00:00 2023-10-14T10:31:20.409 INFO:teuthology.orchestra.run.smithi092.stdout:(81/143): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2023-10-14T10:31:20.426 INFO:teuthology.orchestra.run.smithi092.stdout:(82/143): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 124 kB 00:00 2023-10-14T10:31:20.451 INFO:teuthology.orchestra.run.smithi092.stdout:(83/143): python3-requests-2.25.1-7.el9.noarch. 1.7 MB/s | 113 kB 00:00 2023-10-14T10:31:20.485 INFO:teuthology.orchestra.run.smithi092.stdout:(84/143): python3-urllib3-1.26.5-3.el9.noarch.r 2.5 MB/s | 188 kB 00:00 2023-10-14T10:31:20.549 INFO:teuthology.orchestra.run.smithi008.stdout:(10/143): ceph-osd-18.0.0-6730.g4ba8a190.el9.x8 17 MB/s | 18 MB 00:01 2023-10-14T10:31:20.610 INFO:teuthology.orchestra.run.smithi092.stdout:(85/143): elfutils-libelf-devel-0.189-3.el9.x86 181 kB/s | 22 kB 00:00 2023-10-14T10:31:20.624 INFO:teuthology.orchestra.run.smithi008.stdout:(11/143): cephfs-mirror-18.0.0-6730.g4ba8a190.e 2.9 MB/s | 218 kB 00:00 2023-10-14T10:31:20.674 INFO:teuthology.orchestra.run.smithi008.stdout:(12/143): libcephfs-devel-18.0.0-6730.g4ba8a190 635 kB/s | 31 kB 00:00 2023-10-14T10:31:20.744 INFO:teuthology.orchestra.run.smithi092.stdout:(86/143): jq-1.6-15.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-10-14T10:31:20.786 INFO:teuthology.orchestra.run.smithi092.stdout:(87/143): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2023-10-14T10:31:20.811 INFO:teuthology.orchestra.run.smithi092.stdout:(88/143): librabbitmq-0.11.0-7.el9.x86_64.rpm 686 kB/s | 45 kB 00:00 2023-10-14T10:31:20.824 INFO:teuthology.orchestra.run.smithi008.stdout:(13/143): ceph-radosgw-18.0.0-6730.g4ba8a190.el 7.0 MB/s | 8.6 MB 00:01 2023-10-14T10:31:20.837 INFO:teuthology.orchestra.run.smithi092.stdout:(89/143): libuuid-devel-2.37.4-15.el9.x86_64.rp 517 kB/s | 26 kB 00:00 2023-10-14T10:31:20.883 INFO:teuthology.orchestra.run.smithi008.stdout:(14/143): libcephfs2-18.0.0-6730.g4ba8a190.el9. 3.4 MB/s | 715 kB 00:00 2023-10-14T10:31:20.887 INFO:teuthology.orchestra.run.smithi092.stdout:(90/143): python3-cryptography-36.0.1-4.el9.x86 2.7 MB/s | 1.2 MB 00:00 2023-10-14T10:31:20.912 INFO:teuthology.orchestra.run.smithi092.stdout:(91/143): python3-pytz-2021.1-5.el9.noarch.rpm 684 kB/s | 51 kB 00:00 2023-10-14T10:31:20.917 INFO:teuthology.orchestra.run.smithi008.stdout:(15/143): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.8 MB/s | 163 kB 00:00 2023-10-14T10:31:20.971 INFO:teuthology.orchestra.run.smithi092.stdout:(92/143): zlib-devel-1.2.11-40.el9.x86_64.rpm 784 kB/s | 45 kB 00:00 2023-10-14T10:31:20.982 INFO:teuthology.orchestra.run.smithi008.stdout:(16/143): librados-devel-18.0.0-6730.g4ba8a190. 1.3 MB/s | 127 kB 00:00 2023-10-14T10:31:21.034 INFO:teuthology.orchestra.run.smithi008.stdout:(17/143): libradosstriper1-18.0.0-6730.g4ba8a19 4.0 MB/s | 472 kB 00:00 2023-10-14T10:31:21.080 INFO:teuthology.orchestra.run.smithi092.stdout:(93/143): openssl-devel-3.0.7-24.el9.x86_64.rpm 15 MB/s | 4.1 MB 00:00 2023-10-14T10:31:21.105 INFO:teuthology.orchestra.run.smithi092.stdout:(94/143): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 398 kB/s | 86 kB 00:00 2023-10-14T10:31:21.151 INFO:teuthology.orchestra.run.smithi008.stdout:(18/143): python3-ceph-argparse-18.0.0-6730.g4b 390 kB/s | 45 kB 00:00 2023-10-14T10:31:21.310 INFO:teuthology.orchestra.run.smithi008.stdout:(19/143): librgw2-18.0.0-6730.g4ba8a190.el9.x86 15 MB/s | 4.8 MB 00:00 2023-10-14T10:31:21.343 INFO:teuthology.orchestra.run.smithi008.stdout:(20/143): python3-ceph-common-18.0.0-6730.g4ba8 663 kB/s | 127 kB 00:00 2023-10-14T10:31:21.377 INFO:teuthology.orchestra.run.smithi008.stdout:(21/143): python3-cephfs-18.0.0-6730.g4ba8a190. 2.4 MB/s | 162 kB 00:00 2023-10-14T10:31:21.427 INFO:teuthology.orchestra.run.smithi008.stdout:(22/143): python3-rados-18.0.0-6730.g4ba8a190.e 3.8 MB/s | 321 kB 00:00 2023-10-14T10:31:21.461 INFO:teuthology.orchestra.run.smithi008.stdout:(23/143): python3-rbd-18.0.0-6730.g4ba8a190.el9 3.5 MB/s | 298 kB 00:00 2023-10-14T10:31:21.503 INFO:teuthology.orchestra.run.smithi008.stdout:(24/143): python3-rgw-18.0.0-6730.g4ba8a190.el9 1.3 MB/s | 99 kB 00:00 2023-10-14T10:31:21.513 INFO:teuthology.orchestra.run.smithi092.stdout:(95/143): fmt-8.1.1-5.el9.x86_64.rpm 204 kB/s | 111 kB 00:00 2023-10-14T10:31:21.528 INFO:teuthology.orchestra.run.smithi008.stdout:(25/143): rbd-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.2 MB/s | 85 kB 00:00 2023-10-14T10:31:21.603 INFO:teuthology.orchestra.run.smithi008.stdout:(26/143): rbd-nbd-18.0.0-6730.g4ba8a190.el9.x86 2.2 MB/s | 169 kB 00:00 2023-10-14T10:31:21.605 INFO:teuthology.orchestra.run.smithi092.stdout:(96/143): libarrow-doc-9.0.0-9.el9.noarch.rpm 269 kB/s | 24 kB 00:00 2023-10-14T10:31:21.662 INFO:teuthology.orchestra.run.smithi008.stdout:(27/143): ceph-grafana-dashboards-18.0.0-6730.g 402 kB/s | 23 kB 00:00 2023-10-14T10:31:21.738 INFO:teuthology.orchestra.run.smithi008.stdout:(28/143): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.7 MB/s | 132 kB 00:00 2023-10-14T10:31:21.739 INFO:teuthology.orchestra.run.smithi092.stdout:(97/143): gperftools-libs-2.9.1-2.el9.x86_64.rp 469 kB/s | 309 kB 00:00 2023-10-14T10:31:21.765 INFO:teuthology.orchestra.run.smithi092.stdout:(98/143): liboath-2.6.7-2.el9.x86_64.rpm 307 kB/s | 49 kB 00:00 2023-10-14T10:31:21.823 INFO:teuthology.orchestra.run.smithi092.stdout:(99/143): libunwind-1.6.2-1.el9.x86_64.rpm 813 kB/s | 67 kB 00:00 2023-10-14T10:31:21.888 INFO:teuthology.orchestra.run.smithi008.stdout:(29/143): rbd-mirror-18.0.0-6730.g4ba8a190.el9. 7.9 MB/s | 3.0 MB 00:00 2023-10-14T10:31:21.982 INFO:teuthology.orchestra.run.smithi092.stdout:(100/143): python3-asyncssh-2.13.2-3.el9.noarch 3.4 MB/s | 548 kB 00:00 2023-10-14T10:31:21.988 INFO:teuthology.orchestra.run.smithi008.stdout:(30/143): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 7.1 MB/s | 1.8 MB 00:00 2023-10-14T10:31:22.032 INFO:teuthology.orchestra.run.smithi092.stdout:(101/143): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.1 MB/s | 837 kB 00:00 2023-10-14T10:31:22.049 INFO:teuthology.orchestra.run.smithi092.stdout:(102/143): python3-bcrypt-3.2.2-1.el9.x86_64.rp 658 kB/s | 43 kB 00:00 2023-10-14T10:31:22.080 INFO:teuthology.orchestra.run.smithi008.stdout:(31/143): ceph-mgr-modules-core-18.0.0-6730.g4b 2.6 MB/s | 242 kB 00:00 2023-10-14T10:31:22.141 INFO:teuthology.orchestra.run.smithi092.stdout:(103/143): libarrow-9.0.0-9.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2023-10-14T10:31:22.172 INFO:teuthology.orchestra.run.smithi008.stdout:(32/143): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 524 kB/s | 47 kB 00:00 2023-10-14T10:31:22.175 INFO:teuthology.orchestra.run.smithi092.stdout:(104/143): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2023-10-14T10:31:22.200 INFO:teuthology.orchestra.run.smithi092.stdout:(105/143): python3-cachetools-4.2.4-1.el9.noarc 193 kB/s | 32 kB 00:00 2023-10-14T10:31:22.234 INFO:teuthology.orchestra.run.smithi092.stdout:(106/143): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2023-10-14T10:31:22.264 INFO:teuthology.orchestra.run.smithi008.stdout:(33/143): ceph-prometheus-alerts-18.0.0-6730.g4 166 kB/s | 15 kB 00:00 2023-10-14T10:31:22.276 INFO:teuthology.orchestra.run.smithi092.stdout:(107/143): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2023-10-14T10:31:22.309 INFO:teuthology.orchestra.run.smithi092.stdout:(108/143): python3-google-auth-2.23.2-1.el9.noa 1.8 MB/s | 196 kB 00:00 2023-10-14T10:31:22.335 INFO:teuthology.orchestra.run.smithi092.stdout:(109/143): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2023-10-14T10:31:22.360 INFO:teuthology.orchestra.run.smithi092.stdout:(110/143): python3-jaraco-classes-3.2.1-5.el9.n 212 kB/s | 18 kB 00:00 2023-10-14T10:31:22.364 INFO:teuthology.orchestra.run.smithi008.stdout:(34/143): ceph-volume-18.0.0-6730.g4ba8a190.el9 2.6 MB/s | 262 kB 00:00 2023-10-14T10:31:22.385 INFO:teuthology.orchestra.run.smithi092.stdout:(111/143): python3-jaraco-collections-3.0.0-8.e 309 kB/s | 23 kB 00:00 2023-10-14T10:31:22.411 INFO:teuthology.orchestra.run.smithi092.stdout:(112/143): python3-jaraco-functools-3.5.0-2.el9 259 kB/s | 19 kB 00:00 2023-10-14T10:31:22.436 INFO:teuthology.orchestra.run.smithi092.stdout:(113/143): python3-jaraco-text-3.2.0-6.el9.noar 262 kB/s | 20 kB 00:00 2023-10-14T10:31:22.461 INFO:teuthology.orchestra.run.smithi092.stdout:(114/143): python3-jwt+crypto-2.4.0-1.el9.noarc 120 kB/s | 9.0 kB 00:00 2023-10-14T10:31:22.473 INFO:teuthology.orchestra.run.smithi008.stdout:(35/143): cephadm-18.0.0-6730.g4ba8a190.el9.noa 2.4 MB/s | 269 kB 00:00 2023-10-14T10:31:22.486 INFO:teuthology.orchestra.run.smithi092.stdout:(115/143): python3-jwt-2.4.0-1.el9.noarch.rpm 546 kB/s | 41 kB 00:00 2023-10-14T10:31:22.554 INFO:teuthology.orchestra.run.smithi092.stdout:(116/143): python3-logutils-0.3.5-21.el9.noarch 506 kB/s | 46 kB 00:00 2023-10-14T10:31:22.579 INFO:teuthology.orchestra.run.smithi092.stdout:(117/143): python3-more-itertools-8.12.0-2.el9. 863 kB/s | 79 kB 00:00 2023-10-14T10:31:22.607 INFO:teuthology.orchestra.run.smithi008.stdout:(36/143): ceph-mgr-diskprediction-local-18.0.0- 10 MB/s | 7.4 MB 00:00 2023-10-14T10:31:22.621 INFO:teuthology.orchestra.run.smithi092.stdout:(118/143): python3-kubernetes-26.1.0-2.el9.noar 5.6 MB/s | 1.0 MB 00:00 2023-10-14T10:31:22.632 INFO:teuthology.orchestra.run.smithi008.stdout:(37/143): cephfs-top-18.0.0-6730.g4ba8a190.el9. 116 kB/s | 18 kB 00:00 2023-10-14T10:31:22.646 INFO:teuthology.orchestra.run.smithi092.stdout:(119/143): python3-natsort-7.1.1-5.el9.noarch.r 632 kB/s | 58 kB 00:00 2023-10-14T10:31:22.680 INFO:teuthology.orchestra.run.smithi092.stdout:(120/143): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2023-10-14T10:31:22.705 INFO:teuthology.orchestra.run.smithi092.stdout:(121/143): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2023-10-14T10:31:22.730 INFO:teuthology.orchestra.run.smithi092.stdout:(122/143): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2023-10-14T10:31:22.756 INFO:teuthology.orchestra.run.smithi092.stdout:(123/143): python3-repoze-lru-0.7-16.el9.noarch 410 kB/s | 31 kB 00:00 2023-10-14T10:31:22.789 INFO:teuthology.orchestra.run.smithi092.stdout:(124/143): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-10-14T10:31:22.815 INFO:teuthology.orchestra.run.smithi092.stdout:(125/143): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2023-10-14T10:31:22.832 INFO:teuthology.orchestra.run.smithi092.stdout:(126/143): python3-tempora-5.0.0-2.el9.noarch.r 476 kB/s | 36 kB 00:00 2023-10-14T10:31:22.857 INFO:teuthology.orchestra.run.smithi092.stdout:(127/143): python3-typing-extensions-4.4.0-2.el 768 kB/s | 51 kB 00:00 2023-10-14T10:31:22.857 INFO:teuthology.orchestra.run.smithi008.stdout:(38/143): boost-program-options-1.75.0-8.el9.x8 472 kB/s | 106 kB 00:00 2023-10-14T10:31:22.899 INFO:teuthology.orchestra.run.smithi092.stdout:(128/143): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-10-14T10:31:22.924 INFO:teuthology.orchestra.run.smithi092.stdout:(129/143): python3-websocket-client-1.2.3-2.el9 978 kB/s | 90 kB 00:00 2023-10-14T10:31:22.941 INFO:teuthology.orchestra.run.smithi008.stdout:(39/143): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 920 kB 00:00 2023-10-14T10:31:22.957 INFO:teuthology.orchestra.run.smithi092.stdout:(130/143): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2023-10-14T10:31:22.975 INFO:teuthology.orchestra.run.smithi008.stdout:(40/143): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 307 kB 00:00 2023-10-14T10:31:22.985 INFO:teuthology.orchestra.run.smithi092.stdout:(131/143): python3-zc-lockfile-2.0-10.el9.noarc 233 kB/s | 20 kB 00:00 2023-10-14T10:31:23.000 INFO:teuthology.orchestra.run.smithi008.stdout:(41/143): flexiblas-3.0.4-8.el9.x86_64.rpm 572 kB/s | 32 kB 00:00 2023-10-14T10:31:23.018 INFO:teuthology.orchestra.run.smithi092.stdout:(132/143): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2023-10-14T10:31:23.119 INFO:teuthology.orchestra.run.smithi092.stdout:(133/143): thrift-0.15.0-2.el9.x86_64.rpm 9.9 MB/s | 1.6 MB 00:00 2023-10-14T10:31:23.184 INFO:teuthology.orchestra.run.smithi008.stdout:(42/143): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2023-10-14T10:31:23.194 INFO:teuthology.orchestra.run.smithi092.stdout:(134/143): libacl-devel-2.3.1-4.el9.x86_64.rpm 911 kB/s | 68 kB 00:00 2023-10-14T10:31:23.209 INFO:teuthology.orchestra.run.smithi008.stdout:(43/143): flexiblas-openblas-openmp-3.0.4-8.el9 84 kB/s | 17 kB 00:00 2023-10-14T10:31:23.259 INFO:teuthology.orchestra.run.smithi008.stdout:(44/143): libaio-devel-0.3.111-13.el9.x86_64.rp 206 kB/s | 10 kB 00:00 2023-10-14T10:31:23.297 INFO:teuthology.orchestra.run.smithi008.stdout:(45/143): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.8 MB/s | 159 kB 00:00 2023-10-14T10:31:23.336 INFO:teuthology.orchestra.run.smithi092.stdout:(135/143): NetworkManager-1.45.4-1.el9.x86_64.r 16 MB/s | 2.2 MB 00:00 2023-10-14T10:31:23.339 INFO:teuthology.orchestra.run.smithi008.stdout:(46/143): librdkafka-1.6.1-102.el9.x86_64.rpm 8.3 MB/s | 661 kB 00:00 2023-10-14T10:31:23.381 INFO:teuthology.orchestra.run.smithi008.stdout:(47/143): libtool-2.4.6-45.el9.x86_64.rpm 7.4 MB/s | 578 kB 00:00 2023-10-14T10:31:23.407 INFO:teuthology.orchestra.run.smithi008.stdout:(48/143): libzstd-devel-1.5.1-2.el9.x86_64.rpm 761 kB/s | 46 kB 00:00 2023-10-14T10:31:23.440 INFO:teuthology.orchestra.run.smithi008.stdout:(49/143): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-10-14T10:31:23.462 INFO:teuthology.orchestra.run.smithi092.stdout:(136/143): NetworkManager-libnm-1.45.4-1.el9.x8 14 MB/s | 1.8 MB 00:00 2023-10-14T10:31:23.474 INFO:teuthology.orchestra.run.smithi008.stdout:(50/143): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2023-10-14T10:31:23.499 INFO:teuthology.orchestra.run.smithi008.stdout:(51/143): openblas-0.3.21-2.el9.x86_64.rpm 613 kB/s | 34 kB 00:00 2023-10-14T10:31:23.537 INFO:teuthology.orchestra.run.smithi092.stdout:(137/143): librbd1-18.0.0-6730.g4ba8a190.el9.x8 5.9 MB/s | 3.0 MB 00:00 2023-10-14T10:31:23.562 INFO:teuthology.orchestra.run.smithi092.stdout:(138/143): NetworkManager-team-1.45.4-1.el9.x86 416 kB/s | 41 kB 00:00 2023-10-14T10:31:23.646 INFO:teuthology.orchestra.run.smithi092.stdout:(139/143): librados2-18.0.0-6730.g4ba8a190.el9. 5.0 MB/s | 3.3 MB 00:00 2023-10-14T10:31:23.650 INFO:teuthology.orchestra.run.smithi008.stdout:(52/143): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2023-10-14T10:31:23.671 INFO:teuthology.orchestra.run.smithi092.stdout:(140/143): NetworkManager-tui-1.45.4-1.el9.x86_ 1.8 MB/s | 244 kB 00:00 2023-10-14T10:31:23.696 INFO:teuthology.orchestra.run.smithi092.stdout:(141/143): acl-2.3.1-4.el9.x86_64.rpm 517 kB/s | 69 kB 00:00 2023-10-14T10:31:23.717 INFO:teuthology.orchestra.run.smithi008.stdout:(53/143): postgresql-13.11-1.el9.x86_64.rpm 7.4 MB/s | 1.5 MB 00:00 2023-10-14T10:31:23.721 INFO:teuthology.orchestra.run.smithi092.stdout:(142/143): libacl-2.3.1-4.el9.x86_64.rpm 295 kB/s | 22 kB 00:00 2023-10-14T10:31:23.759 INFO:teuthology.orchestra.run.smithi008.stdout:(54/143): postgresql-contrib-13.11-1.el9.x86_64 8.5 MB/s | 811 kB 00:00 2023-10-14T10:31:23.763 INFO:teuthology.orchestra.run.smithi092.stdout:(143/143): xfsdump-3.1.12-4.el9.x86_64.rpm 4.9 MB/s | 321 kB 00:00 2023-10-14T10:31:23.778 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-10-14T10:31:23.778 INFO:teuthology.orchestra.run.smithi092.stdout:Total 16 MB/s | 199 MB 00:12 2023-10-14T10:31:23.783 INFO:teuthology.orchestra.run.smithi008.stdout:(55/143): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2023-10-14T10:31:24.206 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-10-14T10:31:24.259 INFO:teuthology.orchestra.run.smithi008.stdout:(56/143): ceph-test-18.0.0-6730.g4ba8a190.el9.x 9.1 MB/s | 41 MB 00:04 2023-10-14T10:31:24.385 INFO:teuthology.orchestra.run.smithi008.stdout:(57/143): postgresql-server-13.11-1.el9.x86_64. 9.1 MB/s | 5.7 MB 00:00 2023-10-14T10:31:24.407 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-10-14T10:31:24.407 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-10-14T10:31:24.518 INFO:teuthology.orchestra.run.smithi008.stdout:(58/143): python3-babel-2.9.1-2.el9.noarch.rpm 8.0 MB/s | 5.8 MB 00:00 2023-10-14T10:31:24.543 INFO:teuthology.orchestra.run.smithi008.stdout:(59/143): python3-devel-3.9.17-2.el9.x86_64.rpm 798 kB/s | 205 kB 00:00 2023-10-14T10:31:24.568 INFO:teuthology.orchestra.run.smithi008.stdout:(60/143): python3-jinja2-2.11.3-4.el9.noarch.rp 1.3 MB/s | 228 kB 00:00 2023-10-14T10:31:24.610 INFO:teuthology.orchestra.run.smithi008.stdout:(61/143): python3-jsonpatch-1.21-16.el9.noarch. 605 kB/s | 24 kB 00:00 2023-10-14T10:31:24.636 INFO:teuthology.orchestra.run.smithi008.stdout:(62/143): python3-jsonpointer-2.0-4.el9.noarch. 277 kB/s | 18 kB 00:00 2023-10-14T10:31:24.661 INFO:teuthology.orchestra.run.smithi008.stdout:(63/143): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 144 kB 00:00 2023-10-14T10:31:24.703 INFO:teuthology.orchestra.run.smithi008.stdout:(64/143): python3-markupsafe-1.1.1-12.el9.x86_6 783 kB/s | 32 kB 00:00 2023-10-14T10:31:24.736 INFO:teuthology.orchestra.run.smithi008.stdout:(65/143): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 217 kB 00:00 2023-10-14T10:31:24.870 INFO:teuthology.orchestra.run.smithi008.stdout:(66/143): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2023-10-14T10:31:24.895 INFO:teuthology.orchestra.run.smithi008.stdout:(67/143): python3-oauthlib-3.1.1-5.el9.noarch.r 923 kB/s | 174 kB 00:00 2023-10-14T10:31:24.920 INFO:teuthology.orchestra.run.smithi008.stdout:(68/143): python3-prettytable-0.7.2-27.el9.noar 245 kB/s | 41 kB 00:00 2023-10-14T10:31:24.962 INFO:teuthology.orchestra.run.smithi008.stdout:(69/143): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2023-10-14T10:31:24.987 INFO:teuthology.orchestra.run.smithi008.stdout:(70/143): python3-requests-oauthlib-1.3.0-12.el 659 kB/s | 43 kB 00:00 2023-10-14T10:31:25.021 INFO:teuthology.orchestra.run.smithi008.stdout:(71/143): python3-pyasn1-modules-0.4.8-6.el9.no 2.1 MB/s | 211 kB 00:00 2023-10-14T10:31:25.046 INFO:teuthology.orchestra.run.smithi008.stdout:(72/143): python3-toml-0.10.2-6.el9.noarch.rpm 697 kB/s | 39 kB 00:00 2023-10-14T10:31:25.288 INFO:teuthology.orchestra.run.smithi008.stdout:(73/143): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2023-10-14T10:31:25.322 INFO:teuthology.orchestra.run.smithi008.stdout:(74/143): uuid-1.6.2-55.el9.x86_64.rpm 217 kB/s | 56 kB 00:00 2023-10-14T10:31:25.564 INFO:teuthology.orchestra.run.smithi008.stdout:(75/143): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2023-10-14T10:31:25.589 INFO:teuthology.orchestra.run.smithi008.stdout:(76/143): xmlstarlet-1.6.1-20.el9.x86_64.rpm 246 kB/s | 63 kB 00:00 2023-10-14T10:31:25.614 INFO:teuthology.orchestra.run.smithi008.stdout:(77/143): fuse-2.9.9-15.el9.x86_64.rpm 281 kB/s | 79 kB 00:00 2023-10-14T10:31:25.656 INFO:teuthology.orchestra.run.smithi008.stdout:(78/143): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 241 kB 00:00 2023-10-14T10:31:25.690 INFO:teuthology.orchestra.run.smithi008.stdout:(79/143): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2023-10-14T10:31:25.732 INFO:teuthology.orchestra.run.smithi008.stdout:(80/143): libgfortran-11.4.1-2.3.el9.x86_64.rpm 6.8 MB/s | 803 kB 00:00 2023-10-14T10:31:25.757 INFO:teuthology.orchestra.run.smithi008.stdout:(81/143): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2023-10-14T10:31:25.782 INFO:teuthology.orchestra.run.smithi008.stdout:(82/143): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2023-10-14T10:31:25.816 INFO:teuthology.orchestra.run.smithi008.stdout:(83/143): python3-requests-2.25.1-7.el9.noarch. 2.0 MB/s | 113 kB 00:00 2023-10-14T10:31:25.849 INFO:teuthology.orchestra.run.smithi008.stdout:(84/143): python3-urllib3-1.26.5-3.el9.noarch.r 2.1 MB/s | 188 kB 00:00 2023-10-14T10:31:25.942 INFO:teuthology.orchestra.run.smithi008.stdout:(85/143): elfutils-libelf-devel-0.189-3.el9.x86 247 kB/s | 22 kB 00:00 2023-10-14T10:31:26.058 INFO:teuthology.orchestra.run.smithi008.stdout:(86/143): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2023-10-14T10:31:26.092 INFO:teuthology.orchestra.run.smithi008.stdout:(87/143): jq-1.6-15.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-10-14T10:31:26.117 INFO:teuthology.orchestra.run.smithi008.stdout:(88/143): librabbitmq-0.11.0-7.el9.x86_64.rpm 784 kB/s | 45 kB 00:00 2023-10-14T10:31:26.142 INFO:teuthology.orchestra.run.smithi008.stdout:(89/143): libuuid-devel-2.37.4-15.el9.x86_64.rp 517 kB/s | 26 kB 00:00 2023-10-14T10:31:26.209 INFO:teuthology.orchestra.run.smithi008.stdout:(90/143): python3-cryptography-36.0.1-4.el9.x86 2.9 MB/s | 1.2 MB 00:00 2023-10-14T10:31:26.235 INFO:teuthology.orchestra.run.smithi008.stdout:(91/143): python3-pytz-2021.1-5.el9.noarch.rpm 563 kB/s | 51 kB 00:00 2023-10-14T10:31:26.293 INFO:teuthology.orchestra.run.smithi008.stdout:(92/143): zlib-devel-1.2.11-40.el9.x86_64.rpm 784 kB/s | 45 kB 00:00 2023-10-14T10:31:26.377 INFO:teuthology.orchestra.run.smithi008.stdout:(93/143): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 519 kB/s | 86 kB 00:00 2023-10-14T10:31:26.649 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-10-14T10:31:26.649 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-10-14T10:31:26.719 INFO:teuthology.orchestra.run.smithi008.stdout:(94/143): openssl-devel-3.0.7-24.el9.x86_64.rpm 6.9 MB/s | 4.1 MB 00:00 2023-10-14T10:31:26.769 INFO:teuthology.orchestra.run.smithi008.stdout:(95/143): fmt-8.1.1-5.el9.x86_64.rpm 233 kB/s | 111 kB 00:00 2023-10-14T10:31:26.944 INFO:teuthology.orchestra.run.smithi008.stdout:(96/143): libarrow-doc-9.0.0-9.el9.noarch.rpm 140 kB/s | 24 kB 00:00 2023-10-14T10:31:27.036 INFO:teuthology.orchestra.run.smithi008.stdout:(97/143): gperftools-libs-2.9.1-2.el9.x86_64.rp 469 kB/s | 309 kB 00:00 2023-10-14T10:31:27.078 INFO:teuthology.orchestra.run.smithi008.stdout:(98/143): liboath-2.6.7-2.el9.x86_64.rpm 366 kB/s | 49 kB 00:00 2023-10-14T10:31:27.162 INFO:teuthology.orchestra.run.smithi008.stdout:(99/143): libunwind-1.6.2-1.el9.x86_64.rpm 541 kB/s | 67 kB 00:00 2023-10-14T10:31:27.437 INFO:teuthology.orchestra.run.smithi008.stdout:(100/143): python3-asyncssh-2.13.2-3.el9.noarch 2.0 MB/s | 548 kB 00:00 2023-10-14T10:31:27.562 INFO:teuthology.orchestra.run.smithi008.stdout:(101/143): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.7 MB/s | 837 kB 00:00 2023-10-14T10:31:27.588 INFO:teuthology.orchestra.run.smithi008.stdout:(102/143): python3-bcrypt-3.2.2-1.el9.x86_64.rp 291 kB/s | 43 kB 00:00 2023-10-14T10:31:27.705 INFO:teuthology.orchestra.run.smithi008.stdout:(103/143): python3-cachetools-4.2.4-1.el9.noarc 228 kB/s | 32 kB 00:00 2023-10-14T10:31:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:(104/143): python3-certifi-2021.10.8-2.el9.noar 106 kB/s | 15 kB 00:00 2023-10-14T10:31:27.830 INFO:teuthology.orchestra.run.smithi008.stdout:(105/143): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2023-10-14T10:31:27.881 INFO:teuthology.orchestra.run.smithi008.stdout:(106/143): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2023-10-14T10:31:27.990 INFO:teuthology.orchestra.run.smithi008.stdout:(107/143): libarrow-9.0.0-9.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2023-10-14T10:31:28.015 INFO:teuthology.orchestra.run.smithi008.stdout:(108/143): python3-jaraco-8.2.1-3.el9.noarch.rp 80 kB/s | 11 kB 00:00 2023-10-14T10:31:28.048 INFO:teuthology.orchestra.run.smithi008.stdout:(109/143): python3-google-auth-2.23.2-1.el9.noa 907 kB/s | 196 kB 00:00 2023-10-14T10:31:28.090 INFO:teuthology.orchestra.run.smithi008.stdout:(110/143): python3-jaraco-classes-3.2.1-5.el9.n 177 kB/s | 18 kB 00:00 2023-10-14T10:31:28.115 INFO:teuthology.orchestra.run.smithi008.stdout:(111/143): python3-jaraco-collections-3.0.0-8.e 232 kB/s | 23 kB 00:00 2023-10-14T10:31:28.149 INFO:teuthology.orchestra.run.smithi008.stdout:(112/143): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2023-10-14T10:31:28.191 INFO:teuthology.orchestra.run.smithi008.stdout:(113/143): python3-jaraco-text-3.2.0-6.el9.noar 197 kB/s | 20 kB 00:00 2023-10-14T10:31:28.225 INFO:teuthology.orchestra.run.smithi008.stdout:(114/143): python3-jwt+crypto-2.4.0-1.el9.noarc 83 kB/s | 9.0 kB 00:00 2023-10-14T10:31:28.250 INFO:teuthology.orchestra.run.smithi008.stdout:(115/143): python3-jwt-2.4.0-1.el9.noarch.rpm 409 kB/s | 41 kB 00:00 2023-10-14T10:31:28.342 INFO:teuthology.orchestra.run.smithi008.stdout:(116/143): python3-logutils-0.3.5-21.el9.noarch 398 kB/s | 46 kB 00:00 2023-10-14T10:31:28.367 INFO:teuthology.orchestra.run.smithi008.stdout:(117/143): python3-more-itertools-8.12.0-2.el9. 677 kB/s | 79 kB 00:00 2023-10-14T10:31:28.418 INFO:teuthology.orchestra.run.smithi008.stdout:(118/143): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2023-10-14T10:31:28.443 INFO:teuthology.orchestra.run.smithi008.stdout:(119/143): python3-natsort-7.1.1-5.el9.noarch.r 578 kB/s | 58 kB 00:00 2023-10-14T10:31:28.493 INFO:teuthology.orchestra.run.smithi008.stdout:(120/143): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2023-10-14T10:31:28.518 INFO:teuthology.orchestra.run.smithi008.stdout:(121/143): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2023-10-14T10:31:28.544 INFO:teuthology.orchestra.run.smithi008.stdout:(122/143): python3-pyOpenSSL-21.0.0-1.el9.noarc 900 kB/s | 90 kB 00:00 2023-10-14T10:31:28.594 INFO:teuthology.orchestra.run.smithi008.stdout:(123/143): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2023-10-14T10:31:28.627 INFO:teuthology.orchestra.run.smithi008.stdout:(124/143): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-10-14T10:31:28.653 INFO:teuthology.orchestra.run.smithi008.stdout:(125/143): python3-rsa-4.9-2.el9.noarch.rpm 545 kB/s | 59 kB 00:00 2023-10-14T10:31:28.695 INFO:teuthology.orchestra.run.smithi008.stdout:(126/143): python3-tempora-5.0.0-2.el9.noarch.r 358 kB/s | 36 kB 00:00 2023-10-14T10:31:28.728 INFO:teuthology.orchestra.run.smithi008.stdout:(127/143): python3-typing-extensions-4.4.0-2.el 511 kB/s | 51 kB 00:00 2023-10-14T10:31:28.779 INFO:teuthology.orchestra.run.smithi008.stdout:(128/143): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2023-10-14T10:31:28.804 INFO:teuthology.orchestra.run.smithi008.stdout:(129/143): python3-websocket-client-1.2.3-2.el9 828 kB/s | 90 kB 00:00 2023-10-14T10:31:28.846 INFO:teuthology.orchestra.run.smithi008.stdout:(130/143): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2023-10-14T10:31:28.871 INFO:teuthology.orchestra.run.smithi008.stdout:(131/143): python3-zc-lockfile-2.0-10.el9.noarc 218 kB/s | 20 kB 00:00 2023-10-14T10:31:28.922 INFO:teuthology.orchestra.run.smithi008.stdout:(132/143): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-10-14T10:31:29.030 INFO:teuthology.orchestra.run.smithi008.stdout:(133/143): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2023-10-14T10:31:29.072 INFO:teuthology.orchestra.run.smithi008.stdout:(134/143): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-10-14T10:31:29.206 INFO:teuthology.orchestra.run.smithi008.stdout:(135/143): NetworkManager-1.45.4-1.el9.x86_64.r 17 MB/s | 2.2 MB 00:00 2023-10-14T10:31:29.323 INFO:teuthology.orchestra.run.smithi008.stdout:(136/143): NetworkManager-libnm-1.45.4-1.el9.x8 15 MB/s | 1.8 MB 00:00 2023-10-14T10:31:29.356 INFO:teuthology.orchestra.run.smithi008.stdout:(137/143): NetworkManager-team-1.45.4-1.el9.x86 1.2 MB/s | 41 kB 00:00 2023-10-14T10:31:29.457 INFO:teuthology.orchestra.run.smithi008.stdout:(138/143): librados2-18.0.0-6730.g4ba8a190.el9. 5.7 MB/s | 3.3 MB 00:00 2023-10-14T10:31:29.482 INFO:teuthology.orchestra.run.smithi008.stdout:(139/143): NetworkManager-tui-1.45.4-1.el9.x86_ 1.9 MB/s | 244 kB 00:00 2023-10-14T10:31:29.499 INFO:teuthology.orchestra.run.smithi008.stdout:(140/143): acl-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 69 kB 00:00 2023-10-14T10:31:29.524 INFO:teuthology.orchestra.run.smithi008.stdout:(141/143): libacl-2.3.1-4.el9.x86_64.rpm 544 kB/s | 22 kB 00:00 2023-10-14T10:31:29.558 INFO:teuthology.orchestra.run.smithi008.stdout:(142/143): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2023-10-14T10:31:29.642 INFO:teuthology.orchestra.run.smithi008.stdout:(143/143): librbd1-18.0.0-6730.g4ba8a190.el9.x8 4.2 MB/s | 3.0 MB 00:00 2023-10-14T10:31:29.650 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T10:31:29.650 INFO:teuthology.orchestra.run.smithi008.stdout:Total 16 MB/s | 199 MB 00:12 2023-10-14T10:31:30.101 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T10:31:30.321 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T10:31:30.321 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T10:31:32.714 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T10:31:32.714 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T10:31:32.802 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-10-14T10:31:32.886 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/153 2023-10-14T10:31:33.058 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/153 2023-10-14T10:31:33.104 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/153 2023-10-14T10:31:33.212 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/153 2023-10-14T10:31:33.644 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/153 2023-10-14T10:31:33.691 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T10:31:33.880 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T10:31:33.917 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T10:31:34.074 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T10:31:34.152 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-14T10:31:34.200 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/153 2023-10-14T10:31:34.453 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/153 2023-10-14T10:31:34.513 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/153 2023-10-14T10:31:34.546 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T10:31:34.729 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T10:31:34.764 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-14T10:31:34.839 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-14T10:31:35.219 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/153 2023-10-14T10:31:35.436 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-14T10:31:35.574 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-14T10:31:35.780 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T10:31:35.864 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T10:31:36.314 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T10:31:36.360 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/153 2023-10-14T10:31:36.414 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/153 2023-10-14T10:31:36.528 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/153 2023-10-14T10:31:36.610 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 20/153 2023-10-14T10:31:36.640 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/153 2023-10-14T10:31:36.730 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/153 2023-10-14T10:31:36.843 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/153 2023-10-14T10:31:36.892 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/153 2023-10-14T10:31:36.926 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/153 2023-10-14T10:31:37.038 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/153 2023-10-14T10:31:37.084 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 27/153 2023-10-14T10:31:37.138 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 28/153 2023-10-14T10:31:37.241 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 29/153 2023-10-14T10:31:37.423 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/153 2023-10-14T10:31:37.491 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/153 2023-10-14T10:31:38.201 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/153 2023-10-14T10:31:38.304 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/153 2023-10-14T10:31:38.350 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/153 2023-10-14T10:31:38.389 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 35/153 2023-10-14T10:31:38.428 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/153 2023-10-14T10:31:38.557 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/153 2023-10-14T10:31:38.631 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/153 2023-10-14T10:31:38.660 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T10:31:38.696 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/153 2023-10-14T10:31:38.733 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/153 2023-10-14T10:31:38.762 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/153 2023-10-14T10:31:38.784 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/153 2023-10-14T10:31:38.790 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/153 2023-10-14T10:31:38.823 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/153 2023-10-14T10:31:38.870 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/153 2023-10-14T10:31:38.904 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/153 2023-10-14T10:31:38.939 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/153 2023-10-14T10:31:38.998 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/153 2023-10-14T10:31:39.057 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/153 2023-10-14T10:31:39.247 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/153 2023-10-14T10:31:39.305 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/153 2023-10-14T10:31:39.331 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/153 2023-10-14T10:31:39.349 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/153 2023-10-14T10:31:39.429 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T10:31:39.479 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/153 2023-10-14T10:31:39.522 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 50/153 2023-10-14T10:31:39.570 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/153 2023-10-14T10:31:39.595 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T10:31:39.603 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/153 2023-10-14T10:31:39.622 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T10:31:39.642 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/153 2023-10-14T10:31:39.684 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/153 2023-10-14T10:31:39.728 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 55/153 2023-10-14T10:31:39.751 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T10:31:39.810 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-14T10:31:39.849 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/153 2023-10-14T10:31:39.882 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 56/153 2023-10-14T10:31:39.936 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.2-8.el9.noarch 57/153 2023-10-14T10:31:40.006 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ply-3.11-14.el9.noarch 58/153 2023-10-14T10:31:40.086 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 59/153 2023-10-14T10:31:40.127 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/153 2023-10-14T10:31:40.185 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/153 2023-10-14T10:31:40.210 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T10:31:40.344 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 60/153 2023-10-14T10:31:40.378 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T10:31:40.403 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-14T10:31:40.406 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 61/153 2023-10-14T10:31:40.487 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-14T10:31:40.578 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 62/153 2023-10-14T10:31:40.642 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 63/153 2023-10-14T10:31:40.674 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 64/153 2023-10-14T10:31:40.714 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 65/153 2023-10-14T10:31:40.765 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 66/153 2023-10-14T10:31:40.809 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.9-15.el9.x86_64 67/153 2023-10-14T10:31:40.860 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/153 2023-10-14T10:31:40.863 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/153 2023-10-14T10:31:40.942 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/153 2023-10-14T10:31:40.991 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-14T10:31:41.001 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/153 2023-10-14T10:31:41.042 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/153 2023-10-14T10:31:41.080 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-14T10:31:41.169 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/153 2023-10-14T10:31:41.213 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/153 2023-10-14T10:31:41.249 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/153 2023-10-14T10:31:41.297 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T10:31:41.310 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/153 2023-10-14T10:31:41.351 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/153 2023-10-14T10:31:41.352 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T10:31:41.495 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/153 2023-10-14T10:31:41.550 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/153 2023-10-14T10:31:41.697 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/153 2023-10-14T10:31:41.764 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/153 2023-10-14T10:31:41.807 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T10:31:41.841 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/153 2023-10-14T10:31:41.887 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/153 2023-10-14T10:31:41.974 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/153 2023-10-14T10:31:42.041 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 20/153 2023-10-14T10:31:42.079 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/153 2023-10-14T10:31:42.133 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/153 2023-10-14T10:31:42.247 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/153 2023-10-14T10:31:42.297 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/153 2023-10-14T10:31:42.331 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/153 2023-10-14T10:31:42.448 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/153 2023-10-14T10:31:42.486 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 27/153 2023-10-14T10:31:42.537 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 28/153 2023-10-14T10:31:42.649 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 29/153 2023-10-14T10:31:42.789 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/153 2023-10-14T10:31:42.832 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/153 2023-10-14T10:31:42.846 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/153 2023-10-14T10:31:42.880 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/153 2023-10-14T10:31:42.901 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/153 2023-10-14T10:31:43.006 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/153 2023-10-14T10:31:43.081 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 85/153 2023-10-14T10:31:43.375 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.21-2.el9.x86_64 86/153 2023-10-14T10:31:43.411 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 87/153 2023-10-14T10:31:43.504 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 88/153 2023-10-14T10:31:43.649 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/153 2023-10-14T10:31:43.758 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/153 2023-10-14T10:31:43.807 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/153 2023-10-14T10:31:43.846 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 35/153 2023-10-14T10:31:43.884 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/153 2023-10-14T10:31:44.039 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/153 2023-10-14T10:31:44.070 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/153 2023-10-14T10:31:44.138 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/153 2023-10-14T10:31:44.237 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/153 2023-10-14T10:31:44.280 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/153 2023-10-14T10:31:44.321 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/153 2023-10-14T10:31:44.328 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 89/153 2023-10-14T10:31:44.393 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/153 2023-10-14T10:31:44.454 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/153 2023-10-14T10:31:44.513 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/153 2023-10-14T10:31:44.714 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/153 2023-10-14T10:31:44.739 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 90/153 2023-10-14T10:31:44.770 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/153 2023-10-14T10:31:44.817 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/153 2023-10-14T10:31:45.169 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/153 2023-10-14T10:31:45.213 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 50/153 2023-10-14T10:31:45.267 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/153 2023-10-14T10:31:45.303 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/153 2023-10-14T10:31:45.344 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/153 2023-10-14T10:31:45.386 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/153 2023-10-14T10:31:45.441 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 55/153 2023-10-14T10:31:45.599 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 56/153 2023-10-14T10:31:45.660 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : automake-1.16.2-8.el9.noarch 57/153 2023-10-14T10:31:45.742 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ply-3.11-14.el9.noarch 58/153 2023-10-14T10:31:45.831 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 59/153 2023-10-14T10:31:46.093 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 60/153 2023-10-14T10:31:46.155 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 61/153 2023-10-14T10:31:46.321 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 91/153 2023-10-14T10:31:46.344 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 62/153 2023-10-14T10:31:46.406 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 92/153 2023-10-14T10:31:46.411 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 63/153 2023-10-14T10:31:46.442 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 64/153 2023-10-14T10:31:46.443 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 93/153 2023-10-14T10:31:46.474 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : jq-1.6-15.el9.x86_64 94/153 2023-10-14T10:31:46.482 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 65/153 2023-10-14T10:31:46.513 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 95/153 2023-10-14T10:31:46.526 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 66/153 2023-10-14T10:31:46.577 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.9-15.el9.x86_64 67/153 2023-10-14T10:31:46.640 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/153 2023-10-14T10:31:46.713 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/153 2023-10-14T10:31:46.771 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/153 2023-10-14T10:31:46.811 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/153 2023-10-14T10:31:46.872 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/153 2023-10-14T10:31:46.904 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-14T10:31:46.919 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/153 2023-10-14T10:31:46.957 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/153 2023-10-14T10:31:46.983 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/153 2023-10-14T10:31:47.037 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/153 2023-10-14T10:31:47.078 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/153 2023-10-14T10:31:47.083 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-14T10:31:47.119 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/153 2023-10-14T10:31:47.176 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/153 2023-10-14T10:31:47.227 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/153 2023-10-14T10:31:47.277 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/153 2023-10-14T10:31:47.430 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/153 2023-10-14T10:31:47.501 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/153 2023-10-14T10:31:47.658 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/153 2023-10-14T10:31:47.690 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-14T10:31:47.765 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-14T10:31:47.792 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/153 2023-10-14T10:31:48.552 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/153 2023-10-14T10:31:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/153 2023-10-14T10:31:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/153 2023-10-14T10:31:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/153 2023-10-14T10:31:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 85/153 2023-10-14T10:31:49.070 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.21-2.el9.x86_64 86/153 2023-10-14T10:31:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 87/153 2023-10-14T10:31:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 88/153 2023-10-14T10:31:50.063 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 89/153 2023-10-14T10:31:50.447 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 90/153 2023-10-14T10:31:50.532 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T10:31:50.588 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T10:31:51.221 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T10:31:51.266 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-14T10:31:51.486 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-14T10:31:51.487 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-14T10:31:51.487 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-14T10:31:51.487 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:31:51.534 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-14T10:31:52.115 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 91/153 2023-10-14T10:31:52.209 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 92/153 2023-10-14T10:31:52.246 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 93/153 2023-10-14T10:31:52.277 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.6-15.el9.x86_64 94/153 2023-10-14T10:31:52.318 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 95/153 2023-10-14T10:31:52.699 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/153 2023-10-14T10:31:52.732 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-14T10:31:52.854 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-14T10:31:52.880 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/153 2023-10-14T10:31:52.937 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/153 2023-10-14T10:31:53.446 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/153 2023-10-14T10:31:53.477 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-14T10:31:53.568 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-14T10:31:53.595 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/153 2023-10-14T10:31:56.198 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T10:31:56.242 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T10:31:56.905 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T10:31:56.954 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-14T10:31:57.113 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-14T10:31:57.114 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-14T10:31:57.114 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-14T10:31:57.114 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:31:57.154 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-14T10:32:04.011 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-14T10:32:04.012 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2023-10-14T10:32:04.012 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2023-10-14T10:32:04.012 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2023-10-14T10:32:04.012 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2023-10-14T10:32:04.012 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2023-10-14T10:32:04.012 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /root 2023-10-14T10:32:04.013 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2023-10-14T10:32:04.013 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:04.221 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-14T10:32:04.270 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-14T10:32:04.270 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:04.271 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-14T10:32:04.271 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:05.922 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-14T10:32:06.019 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-14T10:32:06.020 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:06.020 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-14T10:32:06.020 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-14T10:32:06.021 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-14T10:32:06.021 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:06.272 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-14T10:32:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-14T10:32:06.338 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:06.338 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-14T10:32:06.338 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-14T10:32:06.339 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-14T10:32:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:06.831 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-14T10:32:06.913 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-14T10:32:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-14T10:32:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-14T10:32:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-14T10:32:06.915 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:07.571 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-14T10:32:07.610 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-14T10:32:07.656 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 111/153 2023-10-14T10:32:07.769 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 112/153 2023-10-14T10:32:07.804 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-14T10:32:08.110 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-14T10:32:08.170 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-14T10:32:09.270 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-14T10:32:09.296 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-14T10:32:09.438 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-14T10:32:09.604 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 116/153 2023-10-14T10:32:09.640 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-14T10:32:09.709 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-14T10:32:09.709 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:09.710 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-14T10:32:09.710 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-14T10:32:09.710 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-14T10:32:09.710 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:09.766 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-14T10:32:09.804 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-14T10:32:10.304 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-14T10:32:10.304 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2023-10-14T10:32:10.304 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2023-10-14T10:32:10.304 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2023-10-14T10:32:10.305 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2023-10-14T10:32:10.305 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2023-10-14T10:32:10.305 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /root 2023-10-14T10:32:10.305 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2023-10-14T10:32:10.305 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:10.534 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-14T10:32:10.582 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-14T10:32:10.582 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:10.582 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-14T10:32:10.582 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:10.674 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 119/153 2023-10-14T10:32:10.738 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-14T10:32:10.809 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-14T10:32:10.810 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:10.810 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-14T10:32:10.810 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-14T10:32:10.810 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-14T10:32:10.811 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:10.867 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-14T10:32:10.939 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-14T10:32:10.939 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:10.940 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-14T10:32:10.940 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:11.001 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-14T10:32:11.105 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-14T10:32:11.105 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:11.106 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-14T10:32:11.106 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-14T10:32:11.106 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-14T10:32:11.106 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-14T10:32:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-14T10:32:11.530 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:11.531 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-14T10:32:11.531 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-14T10:32:11.531 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-14T10:32:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:12.370 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-14T10:32:12.459 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-14T10:32:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-14T10:32:12.459 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-14T10:32:12.460 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-14T10:32:12.460 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-14T10:32:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-14T10:32:12.790 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:12.790 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-14T10:32:12.790 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-14T10:32:12.790 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-14T10:32:12.790 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:13.313 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-14T10:32:13.385 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-14T10:32:13.386 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:13.386 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-14T10:32:13.386 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-14T10:32:13.386 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-14T10:32:13.386 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:14.019 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-14T10:32:14.058 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-14T10:32:14.106 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 111/153 2023-10-14T10:32:14.222 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 112/153 2023-10-14T10:32:14.260 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-14T10:32:14.595 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-14T10:32:14.627 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-14T10:32:15.614 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/153 2023-10-14T10:32:15.663 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 125/153 2023-10-14T10:32:15.696 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 126/153 2023-10-14T10:32:15.806 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-14T10:32:15.844 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-14T10:32:15.960 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 127/153 2023-10-14T10:32:15.994 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-14T10:32:16.087 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 128/153 2023-10-14T10:32:16.143 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 129/153 2023-10-14T10:32:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 116/153 2023-10-14T10:32:16.189 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/153 2023-10-14T10:32:16.213 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-14T10:32:16.219 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/153 2023-10-14T10:32:16.249 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 132/153 2023-10-14T10:32:16.285 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 133/153 2023-10-14T10:32:16.299 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-14T10:32:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-14T10:32:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-14T10:32:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-14T10:32:16.300 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:16.355 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-14T10:32:16.394 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 134/153 2023-10-14T10:32:16.396 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-14T10:32:16.455 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 135/153 2023-10-14T10:32:16.520 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 136/153 2023-10-14T10:32:17.316 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 119/153 2023-10-14T10:32:17.362 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-14T10:32:17.427 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-14T10:32:17.427 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:17.427 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-14T10:32:17.428 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-14T10:32:17.428 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-14T10:32:17.428 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:17.474 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-14T10:32:17.577 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-14T10:32:17.577 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:17.577 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-14T10:32:17.577 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:17.650 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-14T10:32:17.743 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T10:32:17.755 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-14T10:32:17.755 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:17.755 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-14T10:32:17.755 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-14T10:32:17.756 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-14T10:32:17.756 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:17.795 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T10:32:17.850 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T10:32:17.908 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 138/153 2023-10-14T10:32:18.133 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-14T10:32:18.216 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-14T10:32:18.216 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T10:32:18.217 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-14T10:32:18.217 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-14T10:32:18.217 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-14T10:32:18.217 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:19.272 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 139/153 2023-10-14T10:32:19.375 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 140/153 2023-10-14T10:32:19.424 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 141/153 2023-10-14T10:32:19.548 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.4-9.el9.x86_64 142/153 2023-10-14T10:32:19.585 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.7.4-5.el9.x86_64 143/153 2023-10-14T10:32:19.614 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 144/153 2023-10-14T10:32:19.615 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-14T10:32:19.758 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-14T10:32:19.790 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 146/153 2023-10-14T10:32:19.822 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 147/153 2023-10-14T10:32:19.855 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 148/153 2023-10-14T10:32:19.894 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T10:32:19.894 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T10:32:20.230 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T10:32:20.231 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-14T10:32:20.444 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-14T10:32:20.475 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-14T10:32:20.475 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-14T10:32:20.638 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-14T10:32:20.761 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T10:32:21.017 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T10:32:21.017 INFO:teuthology.orchestra.run.smithi092.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-14T10:32:21.017 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:22.572 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/153 2023-10-14T10:32:22.628 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 125/153 2023-10-14T10:32:22.663 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 126/153 2023-10-14T10:32:22.941 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 127/153 2023-10-14T10:32:23.075 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 128/153 2023-10-14T10:32:23.137 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 129/153 2023-10-14T10:32:23.190 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/153 2023-10-14T10:32:23.241 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/153 2023-10-14T10:32:23.312 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 132/153 2023-10-14T10:32:23.355 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 133/153 2023-10-14T10:32:23.471 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 134/153 2023-10-14T10:32:23.542 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 135/153 2023-10-14T10:32:23.580 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 136/153 2023-10-14T10:32:24.493 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T10:32:24.544 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T10:32:24.617 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T10:32:24.680 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 138/153 2023-10-14T10:32:25.561 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 1/153 2023-10-14T10:32:25.561 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2/153 2023-10-14T10:32:25.561 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 3/153 2023-10-14T10:32:25.561 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 4/153 2023-10-14T10:32:25.562 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/153 2023-10-14T10:32:25.562 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T10:32:25.562 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T10:32:25.562 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-14T10:32:25.562 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 9/153 2023-10-14T10:32:25.563 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 10/153 2023-10-14T10:32:25.563 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 11/153 2023-10-14T10:32:25.563 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T10:32:25.563 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/153 2023-10-14T10:32:25.563 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 14/153 2023-10-14T10:32:25.564 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 15/153 2023-10-14T10:32:25.564 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 16/153 2023-10-14T10:32:25.564 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 17/153 2023-10-14T10:32:25.564 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 18/153 2023-10-14T10:32:25.564 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 19/153 2023-10-14T10:32:25.564 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/153 2023-10-14T10:32:25.565 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 21/153 2023-10-14T10:32:25.565 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 22/153 2023-10-14T10:32:25.565 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 23/153 2023-10-14T10:32:25.565 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 24/153 2023-10-14T10:32:25.565 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 25/153 2023-10-14T10:32:25.565 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 26/153 2023-10-14T10:32:25.566 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 27/153 2023-10-14T10:32:25.566 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 28/153 2023-10-14T10:32:25.576 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/153 2023-10-14T10:32:25.576 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 30/153 2023-10-14T10:32:25.577 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 31/153 2023-10-14T10:32:25.577 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/153 2023-10-14T10:32:25.577 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/153 2023-10-14T10:32:25.577 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 34/153 2023-10-14T10:32:25.577 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/153 2023-10-14T10:32:25.578 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 36/153 2023-10-14T10:32:25.578 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 37/153 2023-10-14T10:32:25.578 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 38/153 2023-10-14T10:32:25.578 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/153 2023-10-14T10:32:25.578 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/153 2023-10-14T10:32:25.579 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/153 2023-10-14T10:32:25.579 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/153 2023-10-14T10:32:25.579 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/153 2023-10-14T10:32:25.579 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/153 2023-10-14T10:32:25.579 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/153 2023-10-14T10:32:25.579 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/153 2023-10-14T10:32:25.580 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/153 2023-10-14T10:32:25.580 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/153 2023-10-14T10:32:25.580 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/153 2023-10-14T10:32:25.580 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/153 2023-10-14T10:32:25.581 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/153 2023-10-14T10:32:25.581 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/153 2023-10-14T10:32:25.581 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/153 2023-10-14T10:32:25.581 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/153 2023-10-14T10:32:25.581 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/153 2023-10-14T10:32:25.581 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/153 2023-10-14T10:32:25.582 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/153 2023-10-14T10:32:25.582 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/153 2023-10-14T10:32:25.582 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/153 2023-10-14T10:32:25.582 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/153 2023-10-14T10:32:25.582 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/153 2023-10-14T10:32:25.583 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/153 2023-10-14T10:32:25.583 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/153 2023-10-14T10:32:25.583 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/153 2023-10-14T10:32:25.583 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/153 2023-10-14T10:32:25.583 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/153 2023-10-14T10:32:25.584 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/153 2023-10-14T10:32:25.584 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/153 2023-10-14T10:32:25.584 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/153 2023-10-14T10:32:25.584 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/153 2023-10-14T10:32:25.584 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/153 2023-10-14T10:32:25.584 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/153 2023-10-14T10:32:25.585 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/153 2023-10-14T10:32:25.585 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/153 2023-10-14T10:32:25.585 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/153 2023-10-14T10:32:25.585 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/153 2023-10-14T10:32:25.586 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/153 2023-10-14T10:32:25.586 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/153 2023-10-14T10:32:25.586 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/153 2023-10-14T10:32:25.586 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/153 2023-10-14T10:32:25.586 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/153 2023-10-14T10:32:25.587 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/153 2023-10-14T10:32:25.587 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/153 2023-10-14T10:32:25.587 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 84/153 2023-10-14T10:32:25.587 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/153 2023-10-14T10:32:25.587 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/153 2023-10-14T10:32:25.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/153 2023-10-14T10:32:25.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : jq-1.6-15.el9.x86_64 88/153 2023-10-14T10:32:25.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/153 2023-10-14T10:32:25.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/153 2023-10-14T10:32:25.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/153 2023-10-14T10:32:25.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/153 2023-10-14T10:32:25.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/153 2023-10-14T10:32:25.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/153 2023-10-14T10:32:25.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 95/153 2023-10-14T10:32:25.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/153 2023-10-14T10:32:25.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 97/153 2023-10-14T10:32:25.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 98/153 2023-10-14T10:32:25.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/153 2023-10-14T10:32:25.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/153 2023-10-14T10:32:25.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 101/153 2023-10-14T10:32:25.591 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 102/153 2023-10-14T10:32:25.591 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 103/153 2023-10-14T10:32:25.591 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 104/153 2023-10-14T10:32:25.591 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 105/153 2023-10-14T10:32:25.591 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 106/153 2023-10-14T10:32:25.591 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 107/153 2023-10-14T10:32:25.592 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 108/153 2023-10-14T10:32:25.592 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 109/153 2023-10-14T10:32:25.592 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 110/153 2023-10-14T10:32:25.592 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 111/153 2023-10-14T10:32:25.592 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 112/153 2023-10-14T10:32:25.592 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 113/153 2023-10-14T10:32:25.593 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 114/153 2023-10-14T10:32:25.593 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 115/153 2023-10-14T10:32:25.593 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/153 2023-10-14T10:32:25.593 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/153 2023-10-14T10:32:25.593 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/153 2023-10-14T10:32:25.594 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/153 2023-10-14T10:32:25.594 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/153 2023-10-14T10:32:25.594 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/153 2023-10-14T10:32:25.594 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/153 2023-10-14T10:32:25.594 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/153 2023-10-14T10:32:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/153 2023-10-14T10:32:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/153 2023-10-14T10:32:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/153 2023-10-14T10:32:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/153 2023-10-14T10:32:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/153 2023-10-14T10:32:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/153 2023-10-14T10:32:25.596 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/153 2023-10-14T10:32:25.596 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/153 2023-10-14T10:32:25.596 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/153 2023-10-14T10:32:25.596 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/153 2023-10-14T10:32:25.596 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 134/153 2023-10-14T10:32:25.596 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/153 2023-10-14T10:32:25.597 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 136/153 2023-10-14T10:32:25.597 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/153 2023-10-14T10:32:25.597 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/153 2023-10-14T10:32:25.597 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/153 2023-10-14T10:32:25.597 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 140/153 2023-10-14T10:32:25.597 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/153 2023-10-14T10:32:25.598 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 142/153 2023-10-14T10:32:25.598 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/153 2023-10-14T10:32:25.598 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 144/153 2023-10-14T10:32:25.598 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/153 2023-10-14T10:32:25.598 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 146/153 2023-10-14T10:32:25.599 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/153 2023-10-14T10:32:25.599 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/153 2023-10-14T10:32:25.599 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/153 2023-10-14T10:32:25.599 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/153 2023-10-14T10:32:25.599 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-14T10:32:25.599 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/153 2023-10-14T10:32:26.221 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 139/153 2023-10-14T10:32:26.351 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 140/153 2023-10-14T10:32:26.397 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 141/153 2023-10-14T10:32:26.524 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flex-2.6.4-9.el9.x86_64 142/153 2023-10-14T10:32:26.561 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : bison-3.7.4-5.el9.x86_64 143/153 2023-10-14T10:32:26.598 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 144/153 2023-10-14T10:32:26.599 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-14T10:32:26.726 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-14T10:32:26.750 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 146/153 2023-10-14T10:32:26.790 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 147/153 2023-10-14T10:32:26.823 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 148/153 2023-10-14T10:32:26.863 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T10:32:26.864 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T10:32:27.199 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T10:32:27.199 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-14T10:32:27.345 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-14T10:32:27.376 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-14T10:32:27.377 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-14T10:32:27.514 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-14T10:32:27.652 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T10:32:27.704 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T10:32:27.704 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:27.705 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2023-10-14T10:32:27.705 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-14T10:32:27.706 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-14T10:32:27.706 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-14T10:32:27.706 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-14T10:32:27.707 INFO:teuthology.orchestra.run.smithi092.stdout: acl-2.3.1-4.el9.x86_64 2023-10-14T10:32:27.707 INFO:teuthology.orchestra.run.smithi092.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-14T10:32:27.707 INFO:teuthology.orchestra.run.smithi092.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-14T10:32:27.708 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.708 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.708 INFO:teuthology.orchestra.run.smithi092.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-14T10:32:27.709 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-10-14T10:32:27.709 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.2-8.el9.noarch 2023-10-14T10:32:27.710 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.7.4-5.el9.x86_64 2023-10-14T10:32:27.710 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-14T10:32:27.710 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.711 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.712 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.712 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:27.712 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.713 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.713 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.713 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:27.714 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:27.714 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:27.714 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:27.715 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:27.715 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.716 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.716 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:27.716 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.717 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.717 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.717 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:27.718 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:27.718 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.719 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:27.719 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-14T10:32:27.719 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.4-9.el9.x86_64 2023-10-14T10:32:27.720 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-14T10:32:27.720 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-14T10:32:27.720 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-14T10:32:27.721 INFO:teuthology.orchestra.run.smithi092.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-14T10:32:27.721 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-14T10:32:27.722 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-14T10:32:27.722 INFO:teuthology.orchestra.run.smithi092.stdout: jq-1.6-15.el9.x86_64 2023-10-14T10:32:27.723 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-14T10:32:27.723 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-14T10:32:27.723 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-14T10:32:27.724 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.724 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.725 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.725 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-14T10:32:27.725 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-14T10:32:27.726 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-14T10:32:27.726 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-14T10:32:27.726 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-14T10:32:27.727 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.727 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.728 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-14T10:32:27.728 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.728 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-14T10:32:27.729 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-14T10:32:27.729 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-14T10:32:27.729 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-14T10:32:27.730 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-14T10:32:27.730 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-14T10:32:27.731 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-14T10:32:27.731 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-14T10:32:27.731 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-14T10:32:27.732 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-14T10:32:27.732 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-13.11-1.el9.x86_64 2023-10-14T10:32:27.732 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-14T10:32:27.733 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-14T10:32:27.733 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-14T10:32:27.733 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-14T10:32:27.734 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-14T10:32:27.734 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-14T10:32:27.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-14T10:32:27.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.735 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-14T10:32:27.736 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-14T10:32:27.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-14T10:32:27.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-14T10:32:27.737 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-14T10:32:27.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-14T10:32:27.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-14T10:32:27.738 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-14T10:32:27.739 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-14T10:32:27.739 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-14T10:32:27.739 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-14T10:32:27.740 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-14T10:32:27.740 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-14T10:32:27.741 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-14T10:32:27.741 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-14T10:32:27.741 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-14T10:32:27.742 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-14T10:32:27.742 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-14T10:32:27.742 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-14T10:32:27.743 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-14T10:32:27.743 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-14T10:32:27.744 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-14T10:32:27.744 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-14T10:32:27.744 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-14T10:32:27.745 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-14T10:32:27.745 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-14T10:32:27.745 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-14T10:32:27.746 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply-3.11-14.el9.noarch 2023-10-14T10:32:27.746 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-14T10:32:27.747 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-14T10:32:27.747 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-14T10:32:27.747 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-14T10:32:27.748 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-14T10:32:27.748 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-14T10:32:27.748 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-14T10:32:27.749 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.749 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.749 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-14T10:32:27.750 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-14T10:32:27.750 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-14T10:32:27.750 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.751 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-14T10:32:27.751 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-14T10:32:27.752 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-14T10:32:27.752 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-14T10:32:27.752 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-14T10:32:27.753 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-14T10:32:27.753 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-14T10:32:27.753 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-14T10:32:27.754 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-14T10:32:27.754 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-14T10:32:27.755 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-14T10:32:27.755 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.755 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.755 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:27.756 INFO:teuthology.orchestra.run.smithi092.stdout: re2-1:20211101-3.el9.x86_64 2023-10-14T10:32:27.756 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-14T10:32:27.756 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-14T10:32:27.757 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-14T10:32:27.757 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-14T10:32:27.758 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-14T10:32:27.758 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-14T10:32:27.759 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:27.759 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-10-14T10:32:27.925 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T10:32:27.926 INFO:teuthology.orchestra.run.smithi008.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-14T10:32:27.926 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:28.297 DEBUG:teuthology.parallel:result is None 2023-10-14T10:32:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 1/153 2023-10-14T10:32:32.653 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2/153 2023-10-14T10:32:32.654 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 3/153 2023-10-14T10:32:32.654 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 4/153 2023-10-14T10:32:32.654 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/153 2023-10-14T10:32:32.654 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T10:32:32.655 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T10:32:32.655 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-14T10:32:32.655 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 9/153 2023-10-14T10:32:32.655 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 10/153 2023-10-14T10:32:32.656 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 11/153 2023-10-14T10:32:32.656 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T10:32:32.656 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/153 2023-10-14T10:32:32.656 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 14/153 2023-10-14T10:32:32.656 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 15/153 2023-10-14T10:32:32.657 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 16/153 2023-10-14T10:32:32.657 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 17/153 2023-10-14T10:32:32.657 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 18/153 2023-10-14T10:32:32.657 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 19/153 2023-10-14T10:32:32.657 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/153 2023-10-14T10:32:32.658 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 21/153 2023-10-14T10:32:32.658 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 22/153 2023-10-14T10:32:32.658 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 23/153 2023-10-14T10:32:32.658 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 24/153 2023-10-14T10:32:32.658 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 25/153 2023-10-14T10:32:32.659 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 26/153 2023-10-14T10:32:32.659 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 27/153 2023-10-14T10:32:32.659 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 28/153 2023-10-14T10:32:32.659 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/153 2023-10-14T10:32:32.659 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 30/153 2023-10-14T10:32:32.660 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 31/153 2023-10-14T10:32:32.660 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/153 2023-10-14T10:32:32.660 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/153 2023-10-14T10:32:32.660 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 34/153 2023-10-14T10:32:32.660 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/153 2023-10-14T10:32:32.661 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 36/153 2023-10-14T10:32:32.661 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 37/153 2023-10-14T10:32:32.661 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 38/153 2023-10-14T10:32:32.661 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/153 2023-10-14T10:32:32.661 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/153 2023-10-14T10:32:32.661 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/153 2023-10-14T10:32:32.662 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/153 2023-10-14T10:32:32.662 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/153 2023-10-14T10:32:32.662 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/153 2023-10-14T10:32:32.662 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/153 2023-10-14T10:32:32.662 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/153 2023-10-14T10:32:32.663 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/153 2023-10-14T10:32:32.663 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/153 2023-10-14T10:32:32.663 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/153 2023-10-14T10:32:32.663 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/153 2023-10-14T10:32:32.663 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/153 2023-10-14T10:32:32.664 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/153 2023-10-14T10:32:32.664 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/153 2023-10-14T10:32:32.664 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/153 2023-10-14T10:32:32.664 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/153 2023-10-14T10:32:32.665 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/153 2023-10-14T10:32:32.665 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/153 2023-10-14T10:32:32.665 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/153 2023-10-14T10:32:32.666 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/153 2023-10-14T10:32:32.666 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/153 2023-10-14T10:32:32.666 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/153 2023-10-14T10:32:32.666 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/153 2023-10-14T10:32:32.667 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/153 2023-10-14T10:32:32.667 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/153 2023-10-14T10:32:32.667 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/153 2023-10-14T10:32:32.668 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/153 2023-10-14T10:32:32.668 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/153 2023-10-14T10:32:32.668 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/153 2023-10-14T10:32:32.668 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/153 2023-10-14T10:32:32.669 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/153 2023-10-14T10:32:32.669 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/153 2023-10-14T10:32:32.669 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/153 2023-10-14T10:32:32.669 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/153 2023-10-14T10:32:32.670 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/153 2023-10-14T10:32:32.670 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/153 2023-10-14T10:32:32.670 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/153 2023-10-14T10:32:32.671 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/153 2023-10-14T10:32:32.671 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/153 2023-10-14T10:32:32.671 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/153 2023-10-14T10:32:32.671 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/153 2023-10-14T10:32:32.671 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/153 2023-10-14T10:32:32.672 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/153 2023-10-14T10:32:32.672 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/153 2023-10-14T10:32:32.672 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 84/153 2023-10-14T10:32:32.672 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/153 2023-10-14T10:32:32.673 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/153 2023-10-14T10:32:32.673 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/153 2023-10-14T10:32:32.673 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.6-15.el9.x86_64 88/153 2023-10-14T10:32:32.673 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/153 2023-10-14T10:32:32.674 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/153 2023-10-14T10:32:32.674 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/153 2023-10-14T10:32:32.674 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/153 2023-10-14T10:32:32.674 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/153 2023-10-14T10:32:32.675 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/153 2023-10-14T10:32:32.675 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 95/153 2023-10-14T10:32:32.675 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/153 2023-10-14T10:32:32.675 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 97/153 2023-10-14T10:32:32.676 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 98/153 2023-10-14T10:32:32.676 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/153 2023-10-14T10:32:32.676 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/153 2023-10-14T10:32:32.676 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 101/153 2023-10-14T10:32:32.676 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 102/153 2023-10-14T10:32:32.677 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 103/153 2023-10-14T10:32:32.677 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 104/153 2023-10-14T10:32:32.677 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 105/153 2023-10-14T10:32:32.677 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 106/153 2023-10-14T10:32:32.678 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 107/153 2023-10-14T10:32:32.678 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 108/153 2023-10-14T10:32:32.678 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 109/153 2023-10-14T10:32:32.679 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 110/153 2023-10-14T10:32:32.679 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 111/153 2023-10-14T10:32:32.679 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 112/153 2023-10-14T10:32:32.679 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 113/153 2023-10-14T10:32:32.679 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 114/153 2023-10-14T10:32:32.680 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 115/153 2023-10-14T10:32:32.680 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/153 2023-10-14T10:32:32.680 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/153 2023-10-14T10:32:32.680 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/153 2023-10-14T10:32:32.681 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/153 2023-10-14T10:32:32.681 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/153 2023-10-14T10:32:32.681 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/153 2023-10-14T10:32:32.681 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/153 2023-10-14T10:32:32.682 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/153 2023-10-14T10:32:32.682 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/153 2023-10-14T10:32:32.682 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/153 2023-10-14T10:32:32.683 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/153 2023-10-14T10:32:32.683 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/153 2023-10-14T10:32:32.683 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/153 2023-10-14T10:32:32.684 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/153 2023-10-14T10:32:32.684 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/153 2023-10-14T10:32:32.684 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/153 2023-10-14T10:32:32.684 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/153 2023-10-14T10:32:32.685 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/153 2023-10-14T10:32:32.685 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 134/153 2023-10-14T10:32:32.685 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/153 2023-10-14T10:32:32.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 136/153 2023-10-14T10:32:32.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/153 2023-10-14T10:32:32.687 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/153 2023-10-14T10:32:32.687 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/153 2023-10-14T10:32:32.687 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 140/153 2023-10-14T10:32:32.687 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/153 2023-10-14T10:32:32.688 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 142/153 2023-10-14T10:32:32.688 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/153 2023-10-14T10:32:32.688 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 144/153 2023-10-14T10:32:32.688 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/153 2023-10-14T10:32:32.689 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 146/153 2023-10-14T10:32:32.689 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/153 2023-10-14T10:32:32.689 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/153 2023-10-14T10:32:32.689 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/153 2023-10-14T10:32:32.690 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/153 2023-10-14T10:32:32.690 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-14T10:32:32.690 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/153 2023-10-14T10:32:35.005 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T10:32:35.005 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:35.005 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-10-14T10:32:35.005 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-14T10:32:35.006 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-14T10:32:35.006 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-14T10:32:35.006 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-14T10:32:35.006 INFO:teuthology.orchestra.run.smithi008.stdout: acl-2.3.1-4.el9.x86_64 2023-10-14T10:32:35.006 INFO:teuthology.orchestra.run.smithi008.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-14T10:32:35.007 INFO:teuthology.orchestra.run.smithi008.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-14T10:32:35.007 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.007 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.007 INFO:teuthology.orchestra.run.smithi008.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-14T10:32:35.007 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T10:32:35.007 INFO:teuthology.orchestra.run.smithi008.stdout: automake-1.16.2-8.el9.noarch 2023-10-14T10:32:35.008 INFO:teuthology.orchestra.run.smithi008.stdout: bison-3.7.4-5.el9.x86_64 2023-10-14T10:32:35.008 INFO:teuthology.orchestra.run.smithi008.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-14T10:32:35.008 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.008 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.008 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.009 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.009 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:35.009 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.009 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.009 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.010 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:35.010 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:35.010 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:35.010 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:35.010 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:35.011 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.011 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.011 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:35.011 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.011 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.012 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.012 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:35.012 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:35.012 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.012 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T10:32:35.013 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-14T10:32:35.013 INFO:teuthology.orchestra.run.smithi008.stdout: flex-2.6.4-9.el9.x86_64 2023-10-14T10:32:35.013 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-14T10:32:35.013 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-14T10:32:35.013 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-14T10:32:35.014 INFO:teuthology.orchestra.run.smithi008.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-14T10:32:35.014 INFO:teuthology.orchestra.run.smithi008.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-14T10:32:35.014 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-14T10:32:35.014 INFO:teuthology.orchestra.run.smithi008.stdout: jq-1.6-15.el9.x86_64 2023-10-14T10:32:35.014 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-14T10:32:35.015 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-14T10:32:35.015 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-14T10:32:35.015 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.015 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.015 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.015 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-14T10:32:35.016 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-14T10:32:35.016 INFO:teuthology.orchestra.run.smithi008.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-14T10:32:35.016 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-14T10:32:35.016 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-14T10:32:35.016 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.017 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.017 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-14T10:32:35.017 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.017 INFO:teuthology.orchestra.run.smithi008.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-14T10:32:35.017 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-14T10:32:35.018 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-14T10:32:35.018 INFO:teuthology.orchestra.run.smithi008.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-14T10:32:35.018 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-14T10:32:35.018 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-14T10:32:35.018 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-14T10:32:35.019 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-14T10:32:35.019 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-14T10:32:35.019 INFO:teuthology.orchestra.run.smithi008.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-14T10:32:35.019 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-13.11-1.el9.x86_64 2023-10-14T10:32:35.019 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-14T10:32:35.020 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-14T10:32:35.020 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-14T10:32:35.020 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-14T10:32:35.020 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-14T10:32:35.020 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-14T10:32:35.020 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-14T10:32:35.021 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.021 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.021 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.021 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-14T10:32:35.021 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-14T10:32:35.022 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-14T10:32:35.022 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-14T10:32:35.022 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-14T10:32:35.022 INFO:teuthology.orchestra.run.smithi008.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-14T10:32:35.022 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-14T10:32:35.023 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-14T10:32:35.023 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-14T10:32:35.023 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-14T10:32:35.023 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-14T10:32:35.023 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-14T10:32:35.023 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-14T10:32:35.024 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-14T10:32:35.024 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-14T10:32:35.024 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-14T10:32:35.024 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-14T10:32:35.024 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-14T10:32:35.024 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-14T10:32:35.025 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-14T10:32:35.025 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-14T10:32:35.025 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-14T10:32:35.025 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-14T10:32:35.025 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-14T10:32:35.026 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-14T10:32:35.026 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-14T10:32:35.026 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-14T10:32:35.026 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ply-3.11-14.el9.noarch 2023-10-14T10:32:35.026 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-14T10:32:35.026 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-14T10:32:35.027 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-14T10:32:35.027 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-14T10:32:35.027 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-14T10:32:35.027 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-14T10:32:35.027 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-14T10:32:35.028 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.028 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.028 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-14T10:32:35.028 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-14T10:32:35.028 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-14T10:32:35.028 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.029 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-14T10:32:35.029 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-14T10:32:35.029 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-14T10:32:35.029 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-14T10:32:35.029 INFO:teuthology.orchestra.run.smithi008.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-14T10:32:35.030 INFO:teuthology.orchestra.run.smithi008.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-14T10:32:35.030 INFO:teuthology.orchestra.run.smithi008.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-14T10:32:35.030 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-14T10:32:35.030 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-14T10:32:35.030 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-14T10:32:35.030 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-14T10:32:35.031 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.031 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.031 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T10:32:35.031 INFO:teuthology.orchestra.run.smithi008.stdout: re2-1:20211101-3.el9.x86_64 2023-10-14T10:32:35.032 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-14T10:32:35.032 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-14T10:32:35.032 INFO:teuthology.orchestra.run.smithi008.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-14T10:32:35.032 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-14T10:32:35.032 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-14T10:32:35.033 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-14T10:32:35.033 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:35.033 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T10:32:35.592 DEBUG:teuthology.parallel:result is None 2023-10-14T10:32:35.592 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T10:32:35.775 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T10:32:35.833 INFO:teuthology.orchestra.run.smithi008.stdout:18.0.0-6730.g4ba8a190.el9 2023-10-14T10:32:35.834 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el9 2023-10-14T10:32:35.834 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T10:32:35.834 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T10:32:36.067 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T10:32:36.141 INFO:teuthology.orchestra.run.smithi092.stdout:18.0.0-6730.g4ba8a190.el9 2023-10-14T10:32:36.141 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el9 2023-10-14T10:32:36.142 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T10:32:36.142 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T10:32:36.143 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:32:36.143 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T10:32:36.234 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:32:36.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T10:32:36.337 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T10:32:36.338 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:32:36.338 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T10:32:36.426 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T10:32:36.498 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:32:36.499 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T10:32:36.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T10:32:36.671 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T10:32:36.671 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:32:36.672 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T10:32:36.756 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T10:32:36.874 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:32:36.875 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T10:32:36.959 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T10:32:37.077 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T10:32:37.078 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:32:37.078 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T10:32:37.164 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T10:32:37.237 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:32:37.237 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T10:32:37.329 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T10:32:37.461 INFO:teuthology.run_tasks:Running task ceph... 2023-10-14T10:32:37.520 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-14T10:32:37.520 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /var/log/ceph 2023-10-14T10:32:37.526 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2023-10-14T10:32:37.613 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-14T10:32:37.613 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T10:32:37.618 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T10:32:37.708 INFO:tasks.ceph:Creating extra log directories... 2023-10-14T10:32:37.708 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T10:32:37.713 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T10:32:37.808 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-14T10:32:37.808 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-14T10:32:37.808 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-14T10:32:37.809 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:32:37.809 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T10:32:37.851 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T10:32:38.068 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T10:32:38.145 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:32:38.145 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T10:32:38.202 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T10:32:38.474 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T10:32:38.583 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-14T10:32:38.583 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', '\\(MDS_INSUFFICIENT_STANDBY\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_DAMAGE\\)', '\\(FS_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-14T10:32:38.584 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217', 'branch': 'rishabh-2023oct13', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover}', 'email': None, 'first_in_suite': False, 'job_id': '7425217', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', '\\(MDS_INSUFFICIENT_STANDBY\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_DAMAGE\\)', '\\(FS_DEGRADED\\)'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'disabled': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi008.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJbRN2m1thcVQpCsyuQTL+DCHe2isdRV4ohjSBmxB0doGHf17+4IZ0ht7e0NgjIsgT9FyQkaFgKWHMHohu6xqw=', 'smithi092.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP/EQYXPQOGDDCHO62xogl3UH0iFPEqytp/CH5wRYoLQcchSx2clehL0xvQEnNdUUG6t4dD4BqQE0xb7MlREKPE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', '\\(MDS_INSUFFICIENT_STANDBY\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_DAMAGE\\)', '\\(FS_DEGRADED\\)'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'kclient': None}, {'exec': {'mon.a': ['ceph config set mgr mgr/crash/warn_recent_interval 0']}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_failover']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-13_18:04:14', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-14T10:32:38.585 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T10:32:38.591 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T10:32:38.647 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T10:32:38.652 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T10:32:38.745 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:32:38.745 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T10:32:38.789 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T10:32:38.789 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2023-10-14T10:32:38.873 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T10:32:38.874 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T10:32:38.874 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-10-14T10:32:38.874 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T10:32:38.874 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T10:32:38.874 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-14 10:32:28.358592053 +0000 2023-10-14T10:32:38.875 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-14 10:30:00.631753865 +0000 2023-10-14T10:32:38.875 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-14 10:30:00.631753865 +0000 2023-10-14T10:32:38.875 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-14 10:30:00.631753865 +0000 2023-10-14T10:32:38.875 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T10:32:39.005 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-14T10:32:39.006 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-14T10:32:39.006 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000312287 s, 1.6 MB/s 2023-10-14T10:32:39.008 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T10:32:39.055 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2023-10-14T10:32:39.140 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T10:32:39.140 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T10:32:39.141 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 652 Links: 1 2023-10-14T10:32:39.141 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T10:32:39.141 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T10:32:39.141 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-14 10:32:28.359592041 +0000 2023-10-14T10:32:39.141 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-14 10:30:01.690745829 +0000 2023-10-14T10:32:39.142 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-14 10:30:01.690745829 +0000 2023-10-14T10:32:39.142 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-14 10:30:01.690745829 +0000 2023-10-14T10:32:39.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T10:32:39.252 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-14T10:32:39.252 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-14T10:32:39.252 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000195836 s, 2.6 MB/s 2023-10-14T10:32:39.255 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T10:32:39.297 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2023-10-14T10:32:39.382 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T10:32:39.382 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T10:32:39.382 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 670 Links: 1 2023-10-14T10:32:39.382 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T10:32:39.383 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T10:32:39.383 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-14 10:32:28.360592030 +0000 2023-10-14T10:32:39.383 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-14 10:30:02.761737701 +0000 2023-10-14T10:32:39.383 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-14 10:30:02.761737701 +0000 2023-10-14T10:32:39.383 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-14 10:30:02.761737701 +0000 2023-10-14T10:32:39.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T10:32:39.511 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-14T10:32:39.511 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-14T10:32:39.511 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.00025451 s, 2.0 MB/s 2023-10-14T10:32:39.515 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T10:32:39.578 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2023-10-14T10:32:39.631 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T10:32:39.631 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T10:32:39.631 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-10-14T10:32:39.631 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T10:32:39.632 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T10:32:39.632 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-14 10:32:28.361592019 +0000 2023-10-14T10:32:39.632 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-14 10:30:03.809729749 +0000 2023-10-14T10:32:39.632 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-14 10:30:03.809729749 +0000 2023-10-14T10:32:39.632 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-10-14 10:30:03.809729749 +0000 2023-10-14T10:32:39.633 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T10:32:39.727 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-14T10:32:39.727 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-14T10:32:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000275245 s, 1.9 MB/s 2023-10-14T10:32:39.732 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T10:32:39.798 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T10:32:39.799 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:32:39.799 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T10:32:39.860 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T10:32:39.860 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2023-10-14T10:32:39.917 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T10:32:39.918 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T10:32:39.918 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 633 Links: 1 2023-10-14T10:32:39.918 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T10:32:39.918 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T10:32:39.919 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-14 10:32:21.486083613 +0000 2023-10-14T10:32:39.919 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-14 10:29:34.140830815 +0000 2023-10-14T10:32:39.919 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-14 10:29:34.140830815 +0000 2023-10-14T10:32:39.919 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2023-10-14 10:29:34.140830815 +0000 2023-10-14T10:32:39.919 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T10:32:40.010 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-14T10:32:40.010 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-14T10:32:40.011 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000323303 s, 1.6 MB/s 2023-10-14T10:32:40.013 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T10:32:40.068 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2023-10-14T10:32:40.118 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T10:32:40.118 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T10:32:40.119 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-10-14T10:32:40.119 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T10:32:40.119 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T10:32:40.119 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-14 10:32:21.488083555 +0000 2023-10-14T10:32:40.119 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-14 10:29:35.146801711 +0000 2023-10-14T10:32:40.120 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-14 10:29:35.146801711 +0000 2023-10-14T10:32:40.120 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2023-10-14 10:29:35.146801711 +0000 2023-10-14T10:32:40.120 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T10:32:40.205 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-14T10:32:40.206 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-14T10:32:40.206 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000316351 s, 1.6 MB/s 2023-10-14T10:32:40.209 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T10:32:40.263 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2023-10-14T10:32:40.313 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T10:32:40.314 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T10:32:40.314 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-10-14T10:32:40.314 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T10:32:40.315 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T10:32:40.315 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-14 10:32:21.488083555 +0000 2023-10-14T10:32:40.315 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-14 10:29:36.177771885 +0000 2023-10-14T10:32:40.316 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-14 10:29:36.177771885 +0000 2023-10-14T10:32:40.316 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2023-10-14 10:29:36.177771885 +0000 2023-10-14T10:32:40.317 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T10:32:40.404 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-14T10:32:40.404 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-14T10:32:40.404 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.00030377 s, 1.7 MB/s 2023-10-14T10:32:40.408 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T10:32:40.464 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2023-10-14T10:32:40.516 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T10:32:40.516 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T10:32:40.516 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-10-14T10:32:40.516 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T10:32:40.517 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T10:32:40.517 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-10-14 10:32:21.489083526 +0000 2023-10-14T10:32:40.517 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-10-14 10:29:37.209742029 +0000 2023-10-14T10:32:40.517 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-10-14 10:29:37.209742029 +0000 2023-10-14T10:32:40.517 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2023-10-14 10:29:37.209742029 +0000 2023-10-14T10:32:40.518 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T10:32:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-10-14T10:32:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-10-14T10:32:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000321561 s, 1.6 MB/s 2023-10-14T10:32:40.614 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T10:32:40.670 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T10:32:40.670 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T10:32:40.671 INFO:tasks.ceph:Generating config... 2023-10-14T10:32:40.672 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-14T10:32:40.672 INFO:tasks.ceph:[client] debug client = 20 2023-10-14T10:32:40.673 INFO:tasks.ceph:[client] debug ms = 1 2023-10-14T10:32:40.673 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-14T10:32:40.673 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-14T10:32:40.673 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-14T10:32:40.674 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-14T10:32:40.674 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-14T10:32:40.674 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-14T10:32:40.674 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-14T10:32:40.675 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-14T10:32:40.675 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-14T10:32:40.675 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-14T10:32:40.675 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-14T10:32:40.676 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-14T10:32:40.676 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-14T10:32:40.676 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-14T10:32:40.676 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-14T10:32:40.677 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-14T10:32:40.677 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-14T10:32:40.677 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-14T10:32:40.677 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-14T10:32:40.678 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-14T10:32:40.678 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-14T10:32:40.678 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-14T10:32:40.679 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-14T10:32:40.679 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-14T10:32:40.679 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-14T10:32:40.679 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-14T10:32:40.680 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-14T10:32:40.680 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-14T10:32:40.680 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-14T10:32:40.680 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-14T10:32:40.681 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-14T10:32:40.681 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-14T10:32:40.681 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-14T10:32:40.681 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-14T10:32:40.682 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-14T10:32:40.682 INFO:tasks.ceph:Setting up mon.a... 2023-10-14T10:32:40.682 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-14T10:32:40.832 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.keyring 2023-10-14T10:32:40.841 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-14T10:32:40.982 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T10:32:41.081 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.8'), ('mon.b', '172.21.15.92'), ('mon.c', '[v2:172.21.15.92:3301,v1:172.21.15.92:6790]')] 2023-10-14T10:32:41.081 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.8,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-14T10:32:41.082 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:32:41.082 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T10:32:41.141 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.8 --add b 172.21.15.92 --addv c '[v2:172.21.15.92:3301,v1:172.21.15.92:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:32:41.300 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:32:41.300 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: generated fsid 452b10b4-f8ad-4e99-85d0-4d157f344356 2023-10-14T10:32:41.300 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = pacific 2023-10-14T10:32:41.301 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 0 2023-10-14T10:32:41.301 INFO:teuthology.orchestra.run.smithi008.stdout:fsid 452b10b4-f8ad-4e99-85d0-4d157f344356 2023-10-14T10:32:41.301 INFO:teuthology.orchestra.run.smithi008.stdout:last_changed 2023-10-14T10:32:41.299244+0000 2023-10-14T10:32:41.301 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-14T10:32:41.299244+0000 2023-10-14T10:32:41.301 INFO:teuthology.orchestra.run.smithi008.stdout:min_mon_release 16 (pacific) 2023-10-14T10:32:41.302 INFO:teuthology.orchestra.run.smithi008.stdout:election_strategy: 1 2023-10-14T10:32:41.302 INFO:teuthology.orchestra.run.smithi008.stdout:0: [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon.a 2023-10-14T10:32:41.302 INFO:teuthology.orchestra.run.smithi008.stdout:1: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2023-10-14T10:32:41.302 INFO:teuthology.orchestra.run.smithi008.stdout:2: [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] mon.c 2023-10-14T10:32:41.302 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-14T10:32:41.303 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T10:32:41.356 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 452b10b4-f8ad-4e99-85d0-4d157f344356... 2023-10-14T10:32:41.357 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T10:32:41.364 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T10:32:41.533 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-10-14T10:32:41.534 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2023-10-14T10:32:41.534 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T10:32:41.534 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2023-10-14T10:32:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2023-10-14T10:32:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2023-10-14T10:32:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.535 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2023-10-14T10:32:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2023-10-14T10:32:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2023-10-14T10:32:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2023-10-14T10:32:41.536 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T10:32:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2023-10-14T10:32:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T10:32:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T10:32:41.537 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2023-10-14T10:32:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2023-10-14T10:32:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2023-10-14T10:32:41.538 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2023-10-14T10:32:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2023-10-14T10:32:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2023-10-14T10:32:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2023-10-14T10:32:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2023-10-14T10:32:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T10:32:41.539 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T10:32:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2023-10-14T10:32:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T10:32:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2023-10-14T10:32:41.540 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2023-10-14T10:32:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2023-10-14T10:32:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2023-10-14T10:32:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2023-10-14T10:32:41.541 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]" 2023-10-14T10:32:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on skipped message = False 2023-10-14T10:32:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 452b10b4-f8ad-4e99-85d0-4d157f344356 2023-10-14T10:32:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.542 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2023-10-14T10:32:41.542 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2023-10-14T10:32:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2023-10-14T10:32:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2023-10-14T10:32:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2023-10-14T10:32:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.543 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2023-10-14T10:32:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2023-10-14T10:32:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2023-10-14T10:32:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2023-10-14T10:32:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2023-10-14T10:32:41.544 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2023-10-14T10:32:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2023-10-14T10:32:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2023-10-14T10:32:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.545 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2023-10-14T10:32:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2023-10-14T10:32:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2023-10-14T10:32:41.546 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2023-10-14T10:32:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2023-10-14T10:32:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2023-10-14T10:32:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: bdev async discard = True 2023-10-14T10:32:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: bdev enable discard = True 2023-10-14T10:32:41.547 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore allocator = bitmap 2023-10-14T10:32:41.548 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2023-10-14T10:32:41.548 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2023-10-14T10:32:41.548 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 1/20 2023-10-14T10:32:41.548 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 1/20 2023-10-14T10:32:41.548 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-14T10:32:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2023-10-14T10:32:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 4/10 2023-10-14T10:32:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T10:32:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2023-10-14T10:32:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2023-10-14T10:32:41.549 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2023-10-14T10:32:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2023-10-14T10:32:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2023-10-14T10:32:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.550 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2023-10-14T10:32:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-14T10:32:41.550 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2023-10-14T10:32:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-10-14T10:32:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-10-14T10:32:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-10-14T10:32:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-10-14T10:32:41.551 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2023-10-14T10:32:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.552 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2023-10-14T10:32:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-14T10:32:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-10-14T10:32:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2023-10-14T10:32:41.552 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-10-14T10:32:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2023-10-14T10:32:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2023-10-14T10:32:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-10-14T10:32:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2023-10-14T10:32:41.553 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2023-10-14T10:32:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-10-14T10:32:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T10:32:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T10:32:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T10:32:41.554 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T10:32:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T10:32:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T10:32:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2023-10-14T10:32:41.555 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2023-10-14T10:32:41.556 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.556 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2023-10-14T10:32:41.556 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2023-10-14T10:32:41.556 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:32:41.556 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2023-10-14T10:32:41.556 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2023-10-14T10:32:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2023-10-14T10:32:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2023-10-14T10:32:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T10:32:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T10:32:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2023-10-14T10:32:41.557 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2023-10-14T10:32:41.558 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-14T10:32:41.558 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2023-10-14T10:32:41.558 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2023-10-14T10:32:41.558 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2023-10-14T10:32:41.558 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2023-10-14T10:32:41.559 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2023-10-14T10:32:41.559 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2023-10-14T10:32:41.559 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2023-10-14T10:32:41.559 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2023-10-14T10:32:41.559 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2023-10-14T10:32:41.559 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2023-10-14T10:32:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2023-10-14T10:32:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds balancer = 20 2023-10-14T10:32:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-14T10:32:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2023-10-14T10:32:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = True 2023-10-14T10:32:41.560 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2023-10-14T10:32:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = True 2023-10-14T10:32:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2023-10-14T10:32:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2023-10-14T10:32:41.561 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2023-10-14T10:32:41.561 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2023-10-14T10:32:41.562 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2023-10-14T10:32:41.562 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T10:32:41.562 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2023-10-14T10:32:41.562 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.563 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2023-10-14T10:32:41.563 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.563 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2023-10-14T10:32:41.563 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.563 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2023-10-14T10:32:41.563 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2023-10-14T10:32:41.564 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.564 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2023-10-14T10:32:41.564 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2023-10-14T10:32:41.564 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.564 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T10:32:41.565 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2023-10-14T10:32:41.565 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.565 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T10:32:41.565 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T10:32:41.565 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.565 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2023-10-14T10:32:41.566 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.566 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2023-10-14T10:32:41.566 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2023-10-14T10:32:41.566 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2023-10-14T10:32:41.566 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2023-10-14T10:32:41.567 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2023-10-14T10:32:41.567 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2023-10-14T10:32:41.567 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2023-10-14T10:32:41.567 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T10:32:41.567 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T10:32:41.567 INFO:teuthology.orchestra.run.smithi092.stdout: mon_allow_pool_size_one = true 2023-10-14T10:32:41.568 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.568 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T10:32:41.568 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.568 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2023-10-14T10:32:41.568 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.569 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2023-10-14T10:32:41.569 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.569 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2023-10-14T10:32:41.569 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2023-10-14T10:32:41.569 INFO:teuthology.orchestra.run.smithi092.stdout: mon health detail to clog = false 2023-10-14T10:32:41.569 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = "172.21.15.8,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]" 2023-10-14T10:32:41.570 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on skipped message = False 2023-10-14T10:32:41.570 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = 452b10b4-f8ad-4e99-85d0-4d157f344356 2023-10-14T10:32:41.570 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.570 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2023-10-14T10:32:41.570 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2023-10-14T10:32:41.570 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.571 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2023-10-14T10:32:41.571 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2023-10-14T10:32:41.571 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock profile = high_recovery_ops 2023-10-14T10:32:41.571 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.571 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2023-10-14T10:32:41.571 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2023-10-14T10:32:41.572 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.572 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2023-10-14T10:32:41.572 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2023-10-14T10:32:41.572 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2023-10-14T10:32:41.572 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.573 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2023-10-14T10:32:41.573 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2023-10-14T10:32:41.573 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.573 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2023-10-14T10:32:41.573 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.573 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2023-10-14T10:32:41.574 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.574 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2023-10-14T10:32:41.574 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.574 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2023-10-14T10:32:41.574 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2023-10-14T10:32:41.574 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.575 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2023-10-14T10:32:41.575 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2023-10-14T10:32:41.575 INFO:teuthology.orchestra.run.smithi092.stdout: bdev async discard = True 2023-10-14T10:32:41.575 INFO:teuthology.orchestra.run.smithi092.stdout: bdev enable discard = True 2023-10-14T10:32:41.575 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore allocator = bitmap 2023-10-14T10:32:41.576 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore block size = 96636764160 2023-10-14T10:32:41.576 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore fsck on mount = True 2023-10-14T10:32:41.576 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluefs = 1/20 2023-10-14T10:32:41.576 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluestore = 1/20 2023-10-14T10:32:41.576 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-14T10:32:41.576 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 20 2023-10-14T10:32:41.577 INFO:teuthology.orchestra.run.smithi092.stdout: debug rocksdb = 4/10 2023-10-14T10:32:41.577 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T10:32:41.577 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd full ratio = 0.9 2023-10-14T10:32:41.577 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd nearfull ratio = 0.8 2023-10-14T10:32:41.577 INFO:teuthology.orchestra.run.smithi092.stdout: osd failsafe full ratio = 0.95 2023-10-14T10:32:41.577 INFO:teuthology.orchestra.run.smithi092.stdout: osd objectstore = bluestore 2023-10-14T10:32:41.578 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2023-10-14T10:32:41.578 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.578 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2023-10-14T10:32:41.578 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-14T10:32:41.578 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2023-10-14T10:32:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-10-14T10:32:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-10-14T10:32:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-10-14T10:32:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-10-14T10:32:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2023-10-14T10:32:41.579 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.580 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2023-10-14T10:32:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-14T10:32:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-10-14T10:32:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2023-10-14T10:32:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-10-14T10:32:41.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2023-10-14T10:32:41.581 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2023-10-14T10:32:41.581 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-10-14T10:32:41.581 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2023-10-14T10:32:41.581 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2023-10-14T10:32:41.581 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-10-14T10:32:41.581 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.582 INFO:teuthology.orchestra.run.smithi092.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T10:32:41.582 INFO:teuthology.orchestra.run.smithi092.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T10:32:41.582 INFO:teuthology.orchestra.run.smithi092.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T10:32:41.582 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.582 INFO:teuthology.orchestra.run.smithi092.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T10:32:41.583 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T10:32:41.583 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T10:32:41.583 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.583 INFO:teuthology.orchestra.run.smithi092.stdout: # 1m isn't quite enough 2023-10-14T10:32:41.583 INFO:teuthology.orchestra.run.smithi092.stdout: mon_down_mkfs_grace = 2m 2023-10-14T10:32:41.583 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.584 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_filestore_osds = false 2023-10-14T10:32:41.584 INFO:teuthology.orchestra.run.smithi092.stdout: mon op complaint time = 120 2023-10-14T10:32:41.584 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-14T10:32:41.584 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2023-10-14T10:32:41.584 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2023-10-14T10:32:41.584 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2023-10-14T10:32:41.585 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2023-10-14T10:32:41.585 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T10:32:41.585 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T10:32:41.585 INFO:teuthology.orchestra.run.smithi092.stdout: client mount timeout = 600 2023-10-14T10:32:41.585 INFO:teuthology.orchestra.run.smithi092.stdout: debug client = 20 2023-10-14T10:32:41.585 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-14T10:32:41.586 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2023-10-14T10:32:41.586 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2023-10-14T10:32:41.586 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2023-10-14T10:32:41.586 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.b] 2023-10-14T10:32:41.586 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.c] 2023-10-14T10:32:41.586 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2023-10-14T10:32:41.587 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2023-10-14T10:32:41.587 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2023-10-14T10:32:41.587 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d] 2023-10-14T10:32:41.587 INFO:teuthology.orchestra.run.smithi092.stdout:[mds] 2023-10-14T10:32:41.587 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds = 20 2023-10-14T10:32:41.587 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds balancer = 20 2023-10-14T10:32:41.588 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-10-14T10:32:41.588 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug frag = True 2023-10-14T10:32:41.588 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug scatterstat = True 2023-10-14T10:32:41.588 INFO:teuthology.orchestra.run.smithi092.stdout: mds op complaint time = 180 2023-10-14T10:32:41.588 INFO:teuthology.orchestra.run.smithi092.stdout: mds verify scatter = True 2023-10-14T10:32:41.588 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2023-10-14T10:32:41.589 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2023-10-14T10:32:41.589 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2023-10-14T10:32:41.590 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-14T10:32:41.590 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-14T10:32:41.743 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-14T10:32:41.743 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:32:41.744 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-14T10:32:41.799 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:32:41.799 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-14T10:32:41.852 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:32:41.852 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:32:41.853 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T10:32:41.853 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T10:32:42.016 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:32:42.017 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:32:42.120 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T10:32:42.121 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:32:42.121 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T10:32:42.121 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T10:32:42.277 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:32:42.278 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:32:42.377 INFO:tasks.ceph:Setting up mon nodes... 2023-10-14T10:32:42.378 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-14T10:32:42.378 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T10:32:42.564 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T10:32:42.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T10:32:42.780 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T10:32:42.791 INFO:tasks.ceph:Setting up mds nodes... 2023-10-14T10:32:42.791 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T10:32:42.964 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T10:32:42.973 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-14T10:32:43.055 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T10:32:43.221 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T10:32:43.228 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-14T10:32:43.315 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T10:32:43.498 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T10:32:43.508 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-14T10:32:43.603 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T10:32:43.767 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T10:32:43.775 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-14T10:32:43.860 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-14T10:32:43.861 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T10:32:43.991 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-14T10:32:44.041 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-14T10:32:44.176 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-14T10:32:44.223 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-14T10:32:44.223 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T10:32:44.223 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-14T10:32:44.328 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T10:32:44.329 INFO:tasks.ceph:role: osd.0 2023-10-14T10:32:44.329 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:32:44.329 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T10:32:44.433 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T10:32:44.434 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T10:32:44.434 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T10:32:44.434 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T10:32:44.434 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T10:32:44.434 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-10-14T10:32:44.435 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T10:32:44.435 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T10:32:44.435 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T10:32:44.435 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T10:32:44.467 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-10-14T10:32:44.474 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-10-14T10:32:44.474 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-14T10:32:44.587 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-14T10:32:44.669 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-14T10:32:44.761 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T10:32:44.761 INFO:tasks.ceph:role: osd.1 2023-10-14T10:32:44.761 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:32:44.762 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T10:32:44.862 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T10:32:44.862 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T10:32:44.862 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T10:32:44.863 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T10:32:44.863 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T10:32:44.863 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-10-14T10:32:44.863 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T10:32:44.864 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T10:32:44.864 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T10:32:44.864 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T10:32:44.896 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-10-14T10:32:44.902 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-10-14T10:32:44.902 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-14T10:32:45.028 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-14T10:32:45.120 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-14T10:32:45.206 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T10:32:45.206 INFO:tasks.ceph:role: osd.2 2023-10-14T10:32:45.207 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:32:45.207 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T10:32:45.305 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T10:32:45.306 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T10:32:45.306 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T10:32:45.306 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T10:32:45.307 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T10:32:45.307 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-10-14T10:32:45.307 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T10:32:45.307 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T10:32:45.307 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T10:32:45.308 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T10:32:45.340 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-10-14T10:32:45.346 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-10-14T10:32:45.346 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-14T10:32:45.465 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-14T10:32:45.554 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-14T10:32:45.642 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T10:32:45.643 INFO:tasks.ceph:role: osd.3 2023-10-14T10:32:45.643 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:32:45.643 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T10:32:45.739 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T10:32:45.739 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T10:32:45.739 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T10:32:45.739 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T10:32:45.740 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T10:32:45.740 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-10-14T10:32:45.740 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T10:32:45.740 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T10:32:45.740 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T10:32:45.741 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T10:32:45.773 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-10-14T10:32:45.779 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-10-14T10:32:45.779 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-14T10:32:45.887 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-14T10:32:45.974 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:32:46.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:46.114+0000 7f6e50194500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-14T10:32:46.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:46.115+0000 7f6e50194500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-14T10:32:46.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:46.115+0000 7f6e50194500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T10:32:46.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:46.115+0000 7f6e50194500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T10:32:46.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:46.115+0000 7f6e50194500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T10:32:46.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:46.118+0000 7f6e50194500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-14T10:32:49.300 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-14T10:32:49.406 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:32:49.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:49.550+0000 7ffb2dbde500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-14T10:32:49.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:49.551+0000 7ffb2dbde500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-14T10:32:49.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:49.551+0000 7ffb2dbde500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T10:32:49.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:49.551+0000 7ffb2dbde500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T10:32:49.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:49.551+0000 7ffb2dbde500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T10:32:49.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:49.553+0000 7ffb2dbde500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-14T10:32:52.728 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-14T10:32:52.835 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:32:52.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:52.981+0000 7fa891463500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-14T10:32:52.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:52.981+0000 7fa891463500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-14T10:32:52.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:52.982+0000 7fa891463500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T10:32:52.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:52.982+0000 7fa891463500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T10:32:52.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:52.982+0000 7fa891463500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T10:32:52.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:52.983+0000 7fa891463500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-14T10:32:56.158 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-14T10:32:56.257 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:32:56.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:56.390+0000 7f53861e2500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-14T10:32:56.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:56.390+0000 7f53861e2500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-14T10:32:56.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:56.390+0000 7f53861e2500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T10:32:56.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:56.390+0000 7f53861e2500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T10:32:56.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:56.391+0000 7f53861e2500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T10:32:56.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:32:56.393+0000 7f53861e2500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-14T10:32:59.566 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-14T10:32:59.671 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-14T10:32:59.770 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T10:32:59.771 INFO:tasks.ceph:role: osd.4 2023-10-14T10:32:59.771 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T10:32:59.771 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T10:32:59.869 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T10:32:59.870 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T10:32:59.870 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T10:32:59.870 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T10:32:59.870 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T10:32:59.871 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-10-14T10:32:59.871 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T10:32:59.871 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T10:32:59.871 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T10:32:59.871 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T10:33:00.391 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-10-14T10:33:00.398 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-10-14T10:33:00.399 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-14T10:33:00.599 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-14T10:33:00.708 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-14T10:33:00.791 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T10:33:00.792 INFO:tasks.ceph:role: osd.5 2023-10-14T10:33:00.792 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T10:33:00.792 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T10:33:00.881 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T10:33:00.881 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T10:33:00.882 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T10:33:00.882 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T10:33:00.882 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T10:33:00.882 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-10-14T10:33:00.882 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T10:33:00.883 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T10:33:00.883 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T10:33:00.883 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T10:33:01.363 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-10-14T10:33:01.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-10-14T10:33:01.369 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-14T10:33:01.502 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-14T10:33:01.592 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-14T10:33:01.680 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T10:33:01.681 INFO:tasks.ceph:role: osd.6 2023-10-14T10:33:01.681 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T10:33:01.681 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T10:33:01.766 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T10:33:01.766 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T10:33:01.767 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T10:33:01.767 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T10:33:01.767 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T10:33:01.767 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-10-14T10:33:01.767 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T10:33:01.768 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T10:33:01.768 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T10:33:01.768 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T10:33:02.286 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-10-14T10:33:02.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-10-14T10:33:02.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-14T10:33:02.483 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-14T10:33:02.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-14T10:33:02.686 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T10:33:02.687 INFO:tasks.ceph:role: osd.7 2023-10-14T10:33:02.687 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T10:33:02.687 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T10:33:02.785 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T10:33:02.785 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T10:33:02.785 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T10:33:02.786 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T10:33:02.786 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T10:33:02.786 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-10-14T10:33:02.786 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T10:33:02.786 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T10:33:02.787 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T10:33:02.787 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T10:33:03.232 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-10-14T10:33:03.237 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-10-14T10:33:03.238 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-14T10:33:03.381 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-14T10:33:03.476 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:33:03.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:03.629+0000 7f1db3e0e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-14T10:33:03.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:03.631+0000 7f1db3e0e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-14T10:33:03.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:03.631+0000 7f1db3e0e500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T10:33:03.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:03.631+0000 7f1db3e0e500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T10:33:03.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:03.631+0000 7f1db3e0e500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T10:33:03.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:03.636+0000 7f1db3e0e500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-14T10:33:06.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-14T10:33:06.923 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:33:07.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:07.061+0000 7fddbfa16500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-14T10:33:07.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:07.061+0000 7fddbfa16500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-14T10:33:07.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:07.061+0000 7fddbfa16500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T10:33:07.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:07.061+0000 7fddbfa16500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T10:33:07.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:07.061+0000 7fddbfa16500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T10:33:07.066 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:07.064+0000 7fddbfa16500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-14T10:33:08.586 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:33:08.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:33:10.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-14T10:33:10.331 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:33:10.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:10.463+0000 7f58f6225500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-14T10:33:10.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:10.464+0000 7f58f6225500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-14T10:33:10.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:10.464+0000 7f58f6225500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T10:33:10.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:10.464+0000 7f58f6225500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T10:33:10.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:10.464+0000 7f58f6225500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T10:33:10.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:10.466+0000 7f58f6225500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-14T10:33:13.650 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-14T10:33:13.752 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:33:13.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:13.931+0000 7fc47f00e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-14T10:33:13.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:13.931+0000 7fc47f00e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-14T10:33:13.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:13.931+0000 7fc47f00e500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T10:33:13.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:13.931+0000 7fc47f00e500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T10:33:13.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:13.932+0000 7fc47f00e500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T10:33:13.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:13.934+0000 7fc47f00e500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-14T10:33:16.864 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-14T10:33:16.965 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-14T10:33:16.966 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:33:16.966 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-14T10:33:17.078 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:33:17.079 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-14T10:33:17.185 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:33:17.185 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-14T10:33:17.287 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:33:17.288 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-14T10:33:17.390 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:33:17.390 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-14T10:33:17.496 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:33:17.496 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-14T10:33:17.601 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:33:17.601 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-14T10:33:17.704 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:33:17.705 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-14T10:33:17.805 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:33:17.806 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-14T10:33:17.898 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:33:17.899 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-14T10:33:18.041 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:33:18.041 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-14T10:33:18.141 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:33:18.141 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-14T10:33:18.238 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:33:18.238 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-14T10:33:18.334 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:33:18.334 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-14T10:33:18.429 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:33:18.429 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-14T10:33:18.492 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:33:18.492 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-14T10:33:18.552 INFO:tasks.ceph:Adding keys to all mons... 2023-10-14T10:33:18.552 DEBUG:teuthology.orchestra.run.smithi008:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T10:33:18.561 DEBUG:teuthology.orchestra.run.smithi092:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T10:33:18.651 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.y] 2023-10-14T10:33:18.651 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBKbiplz3SXIRAAY/z2yYJwA7ebu+XpyDktYw== 2023-10-14T10:33:18.651 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2023-10-14T10:33:18.652 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBKbiplIfZ0ORAAzxvyFvrMMtE4TZo5N6G02A== 2023-10-14T10:33:18.652 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2023-10-14T10:33:18.652 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBLbiplIqAoDRAAjxtn5CLFYxRk/saVH1hCsw== 2023-10-14T10:33:18.652 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.0] 2023-10-14T10:33:18.652 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBObipleVjlBhAAJ9li83jkhcTmES65Gmvy2A== 2023-10-14T10:33:18.653 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.1] 2023-10-14T10:33:18.653 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBRbiplK8XiIBAA5Fd7lWuAKH2ZByZSAWEMxA== 2023-10-14T10:33:18.653 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.2] 2023-10-14T10:33:18.653 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBUbipl3ZuJOhAAo5GZgRoXSGAvj4JKrGvp2Q== 2023-10-14T10:33:18.653 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.3] 2023-10-14T10:33:18.654 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBYbiplNVJUFxAAwx4hcnN+XZzBUc7J14d+jw== 2023-10-14T10:33:18.654 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.x] 2023-10-14T10:33:18.654 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBKbiplZ7dyLhAAx2sk5bhKg1d0xEmNILAbxw== 2023-10-14T10:33:18.654 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2023-10-14T10:33:18.654 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBLbiplfHerHRAACauumrzP2V67TiqmBsYYyw== 2023-10-14T10:33:18.655 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d] 2023-10-14T10:33:18.655 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBLbiplznWrLRAAJLhxw+3FKycDGT7WlRe7kQ== 2023-10-14T10:33:18.655 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.4] 2023-10-14T10:33:18.655 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBfbipl9aeiJRAAaxnuP8mRSVGbRlwgOaHwHA== 2023-10-14T10:33:18.655 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.5] 2023-10-14T10:33:18.656 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBjbiplh3G+AxAA5mMOlOgWGHeYj9aPXJ89iw== 2023-10-14T10:33:18.656 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.6] 2023-10-14T10:33:18.656 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBmbiplUPG5GxAAYbxO3vvKYD8Y1b/oa8+jig== 2023-10-14T10:33:18.656 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.7] 2023-10-14T10:33:18.656 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBpbiplJ1ibNxAAmewjPrVbOVUubYa+vPH2kg== 2023-10-14T10:33:18.657 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2023-10-14T10:33:18.657 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBLbiplEpMMOxAAFJoRo9wSqT02h3Z28vhhgQ== 2023-10-14T10:33:18.657 INFO:teuthology.orchestra.run.smithi092.stdout:[client.1] 2023-10-14T10:33:18.657 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBMbiplL295ChAAx54HRTAqn5jA5DhVcC1MnQ== 2023-10-14T10:33:18.658 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.y] 2023-10-14T10:33:18.658 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBKbiplz3SXIRAAY/z2yYJwA7ebu+XpyDktYw== 2023-10-14T10:33:18.658 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2023-10-14T10:33:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBKbiplIfZ0ORAAzxvyFvrMMtE4TZo5N6G02A== 2023-10-14T10:33:18.659 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2023-10-14T10:33:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBLbiplIqAoDRAAjxtn5CLFYxRk/saVH1hCsw== 2023-10-14T10:33:18.659 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.0] 2023-10-14T10:33:18.659 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBObipleVjlBhAAJ9li83jkhcTmES65Gmvy2A== 2023-10-14T10:33:18.660 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.1] 2023-10-14T10:33:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBRbiplK8XiIBAA5Fd7lWuAKH2ZByZSAWEMxA== 2023-10-14T10:33:18.660 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.2] 2023-10-14T10:33:18.660 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBUbipl3ZuJOhAAo5GZgRoXSGAvj4JKrGvp2Q== 2023-10-14T10:33:18.660 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.3] 2023-10-14T10:33:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBYbiplNVJUFxAAwx4hcnN+XZzBUc7J14d+jw== 2023-10-14T10:33:18.661 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.x] 2023-10-14T10:33:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBKbiplZ7dyLhAAx2sk5bhKg1d0xEmNILAbxw== 2023-10-14T10:33:18.661 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2023-10-14T10:33:18.661 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBLbiplfHerHRAACauumrzP2V67TiqmBsYYyw== 2023-10-14T10:33:18.662 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2023-10-14T10:33:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBLbiplznWrLRAAJLhxw+3FKycDGT7WlRe7kQ== 2023-10-14T10:33:18.662 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.4] 2023-10-14T10:33:18.662 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBfbipl9aeiJRAAaxnuP8mRSVGbRlwgOaHwHA== 2023-10-14T10:33:18.662 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.5] 2023-10-14T10:33:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBjbiplh3G+AxAA5mMOlOgWGHeYj9aPXJ89iw== 2023-10-14T10:33:18.663 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.6] 2023-10-14T10:33:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBmbiplUPG5GxAAYbxO3vvKYD8Y1b/oa8+jig== 2023-10-14T10:33:18.663 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.7] 2023-10-14T10:33:18.663 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBpbiplJ1ibNxAAmewjPrVbOVUubYa+vPH2kg== 2023-10-14T10:33:18.664 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-10-14T10:33:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBLbiplEpMMOxAAFJoRo9wSqT02h3Z28vhhgQ== 2023-10-14T10:33:18.664 INFO:teuthology.orchestra.run.smithi008.stdout:[client.1] 2023-10-14T10:33:18.664 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBMbiplL295ChAAx54HRTAqn5jA5DhVcC1MnQ== 2023-10-14T10:33:18.666 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T10:33:18.672 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T10:33:18.821 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T10:33:18.826 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T10:33:18.980 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T10:33:18.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T10:33:19.133 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:19.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:19.288 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:19.294 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:19.439 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:19.444 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:19.594 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:19.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:19.749 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T10:33:19.758 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T10:33:19.903 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T10:33:19.910 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T10:33:20.060 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T10:33:20.066 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T10:33:20.216 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:20.222 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:20.371 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:20.377 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:20.524 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:20.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:20.678 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:20.684 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T10:33:20.830 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T10:33:20.839 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T10:33:20.991 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T10:33:21.000 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T10:33:21.152 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-14T10:33:21.152 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-14T10:33:21.251 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T10:33:21.423 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-14T10:33:21.519 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-14T10:33:21.621 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T10:33:21.774 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-14T10:33:21.851 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-14T10:33:21.948 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T10:33:22.099 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-14T10:33:22.181 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:33:22.190 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T10:33:22.244 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-14T10:33:22.244 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-14T10:33:22.245 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-14T10:33:22.251 INFO:tasks.ceph.mon.a:Started 2023-10-14T10:33:22.252 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-14T10:33:22.252 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-14T10:33:22.260 INFO:tasks.ceph.mon.b:Started 2023-10-14T10:33:22.260 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-14T10:33:22.261 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-14T10:33:22.269 INFO:tasks.ceph.mon.c:Started 2023-10-14T10:33:22.269 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-14T10:33:22.270 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-14T10:33:22.270 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-14T10:33:22.278 INFO:tasks.ceph.mgr.y:Started 2023-10-14T10:33:22.279 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-14T10:33:22.279 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-14T10:33:22.285 INFO:tasks.ceph.mgr.x:Started 2023-10-14T10:33:22.286 INFO:tasks.ceph:Setting crush tunables to default 2023-10-14T10:33:22.286 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd crush tunables default 2023-10-14T10:33:22.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.467+0000 7f6cb490c640 1 Processor -- start 2023-10-14T10:33:22.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.468+0000 7f6cb490c640 1 -- start start 2023-10-14T10:33:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.468+0000 7f6cb490c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.468+0000 7f6cb490c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6cb490c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb00c2240 con 0x7f6cb0070470 2023-10-14T10:33:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6cb490c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb00c56b0 con 0x7f6cb00aca50 2023-10-14T10:33:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6cb490c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb00ad740 con 0x7f6cb00c5ad0 2023-10-14T10:33:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6ca7fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6cae59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6ca7fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:34896/0 (socket says 172.21.15.8:34896) 2023-10-14T10:33:22.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 learned_addr learned my addr 172.21.15.8:0/1718151165 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 msgr2=0x7f6cb0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T10:33:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 msgr2=0x7f6cb0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T10:33:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T10:33:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T10:33:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6cae59c640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 msgr2=0x7f6cb01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T10:33:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6cae59c640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 msgr2=0x7f6cb01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T10:33:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.469+0000 7f6cae59c640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T10:33:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.470+0000 7f6cae59c640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T10:33:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.670+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:22.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.671+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 msgr2=0x7f6cb0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T10:33:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.671+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 msgr2=0x7f6cb0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T10:33:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.671+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T10:33:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.671+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T10:33:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.671+0000 7f6cae59c640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.671+0000 7f6cae59c640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 msgr2=0x7f6cb01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T10:33:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.671+0000 7f6cae59c640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 msgr2=0x7f6cb01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T10:33:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.671+0000 7f6cae59c640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T10:33:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:22.671+0000 7f6cae59c640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T10:33:23.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.072+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:23.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.072+0000 7f6cae59c640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:23.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.073+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 msgr2=0x7f6cb0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T10:33:23.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.073+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 msgr2=0x7f6cb0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T10:33:23.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.073+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T10:33:23.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.073+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T10:33:23.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.073+0000 7f6cae59c640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 msgr2=0x7f6cb01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T10:33:23.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.073+0000 7f6cae59c640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 msgr2=0x7f6cb01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T10:33:23.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.073+0000 7f6cae59c640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T10:33:23.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.073+0000 7f6cae59c640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T10:33:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.875+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:23.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.875+0000 7f6cae59c640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.875+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 msgr2=0x7f6cb0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T10:33:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.875+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 msgr2=0x7f6cb0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T10:33:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.875+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T10:33:23.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.875+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T10:33:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.875+0000 7f6cae59c640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 msgr2=0x7f6cb01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T10:33:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.875+0000 7f6cae59c640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 msgr2=0x7f6cb01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T10:33:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.875+0000 7f6cae59c640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T10:33:23.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:23.875+0000 7f6cae59c640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T10:33:25.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.469+0000 7f6cacd99640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 msgr2=0x7f6cb0155b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T10:33:25.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.469+0000 7f6cacd99640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.92:3300/0 conn(0x7f6cb00c5ad0 0x7f6cb0155b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:25.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.469+0000 7f6cacd99640 1 -- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 msgr2=0x7f6cb01555c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T10:33:25.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.469+0000 7f6cacd99640 1 --2- 172.21.15.8:0/1718151165 >> v2:172.21.15.8:3300/0 conn(0x7f6cb00aca50 0x7f6cb01555c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:25.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.469+0000 7f6cacd99640 1 -- 172.21.15.8:0/1718151165 >> v1:172.21.15.8:6789/0 conn(0x7f6cb0070470 legacy=0x7f6cb014ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:25.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.469+0000 7f6cacd99640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:25.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.469+0000 7f6cacd99640 1 -- 172.21.15.8:0/1718151165 --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb0152d70 con 0x7f6c900036b0 2023-10-14T10:33:25.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.469+0000 7f6cacd99640 1 -- 172.21.15.8:0/1718151165 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00c56b0 con 0x7f6c900072c0 2023-10-14T10:33:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.470+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.471+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 msgr2=0x7f6c90009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T10:33:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.471+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 msgr2=0x7f6c90009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T10:33:25.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.471+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T10:33:25.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.471+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T10:33:25.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.672+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:25.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.672+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 msgr2=0x7f6c90009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T10:33:25.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.673+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 msgr2=0x7f6c90009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T10:33:25.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.673+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T10:33:25.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:25.673+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T10:33:26.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:26.074+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:26.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:26.074+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 msgr2=0x7f6c90009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T10:33:26.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:26.074+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 msgr2=0x7f6c90009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T10:33:26.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:26.074+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T10:33:26.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:26.074+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T10:33:26.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:26.877+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:26.877+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 msgr2=0x7f6c90009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T10:33:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:26.877+0000 7f6ca7fff640 1 -- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 msgr2=0x7f6c90009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T10:33:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:26.877+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T10:33:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:26.878+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T10:33:27.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.513+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075592782 0 0) 0x7f6cb0152d70 con 0x7f6c900036b0 2023-10-14T10:33:27.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.513+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c9c003520 con 0x7f6c900036b0 2023-10-14T10:33:27.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.519+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 <== mon.1 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1706336719 0 0) 0x7f6c9c003520 con 0x7f6c900036b0 2023-10-14T10:33:27.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.519+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 msgr2=0x7f6c90009780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T10:33:27.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.519+0000 7f6cadd9b640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c900072c0 0x7f6c90009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.519+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9000af40 con 0x7f6c900036b0 2023-10-14T10:33:27.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.519+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 <== mon.1 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f6ca000d580 con 0x7f6c900036b0 2023-10-14T10:33:27.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.519+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 >> v1:172.21.15.92:6789/0 conn(0x7f6c900036b0 legacy=0x7f6c90005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:27.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.519+0000 7f6caed9d640 1 -- 172.21.15.8:0/1718151165 reap_dead start 2023-10-14T10:33:27.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.519+0000 7f6cadd9b640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c9c003970 0x7f6c9c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:27.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.519+0000 7f6cadd9b640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c0047c0 0x7f6c9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:27.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.519+0000 7f6cadd9b640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0052a0 0x7f6c9c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:27.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.519+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00c56b0 con 0x7f6c9c0052a0 2023-10-14T10:33:27.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.520+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c00c1f0 con 0x7f6c9c0047c0 2023-10-14T10:33:27.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.520+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c00c3b0 con 0x7f6c9c003970 2023-10-14T10:33:27.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.520+0000 7f6caed9d640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0052a0 0x7f6c9c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:27.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.520+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c0047c0 0x7f6c9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:27.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.520+0000 7f6cae59c640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c9c003970 0x7f6c9c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:27.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.521+0000 7f6caed9d640 1 -- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c9c003970 msgr2=0x7f6c9c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:27.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.521+0000 7f6caed9d640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c9c003970 0x7f6c9c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.521+0000 7f6caed9d640 1 -- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c0047c0 msgr2=0x7f6c9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:27.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.521+0000 7f6caed9d640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c0047c0 0x7f6c9c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.521+0000 7f6caed9d640 1 -- 172.21.15.8:0/1718151165 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c003520 con 0x7f6c9c0052a0 2023-10-14T10:33:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.523+0000 7f6caed9d640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0052a0 0x7f6c9c00b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6cb01566a0 tx=0x7f6c9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf59324b14884fdb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.523+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8005d40 con 0x7f6c9c0052a0 2023-10-14T10:33:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.523+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca802e070 con 0x7f6c9c0052a0 2023-10-14T10:33:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.523+0000 7f6cadd9b640 1 -- 172.21.15.8:0/1718151165 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80072b0 con 0x7f6c9c0052a0 2023-10-14T10:33:27.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.524+0000 7f6cb490c640 1 -- 172.21.15.8:0/1718151165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0052a0 msgr2=0x7f6c9c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:27.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.524+0000 7f6cb490c640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0052a0 0x7f6c9c00b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6cb01566a0 tx=0x7f6c9c0057f0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.524+0000 7f6cb490c640 1 -- 172.21.15.8:0/1718151165 shutdown_connections 2023-10-14T10:33:27.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.524+0000 7f6cb490c640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0052a0 0x7f6c9c00b980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.524+0000 7f6cb490c640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c0047c0 0x7f6c9c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.524+0000 7f6cb490c640 1 --2- 172.21.15.8:0/1718151165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c9c003970 0x7f6c9c003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.524+0000 7f6cb490c640 1 -- 172.21.15.8:0/1718151165 >> 172.21.15.8:0/1718151165 conn(0x7f6cb00a9250 msgr2=0x7f6cb00a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:27.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.525+0000 7f6cb490c640 1 -- 172.21.15.8:0/1718151165 shutdown_connections 2023-10-14T10:33:27.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.525+0000 7f6cb490c640 1 -- 172.21.15.8:0/1718151165 wait complete. 2023-10-14T10:33:27.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.530+0000 7f6cb490c640 1 Processor -- start 2023-10-14T10:33:27.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.530+0000 7f6cb490c640 1 -- start start 2023-10-14T10:33:27.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.533+0000 7f6cb490c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c9c003970 0x7f6cb014e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:27.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.533+0000 7f6cb490c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0047c0 0x7f6cb00aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:27.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.533+0000 7f6cb490c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c0052a0 0x7f6cb0150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:27.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6cb490c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00ba4d0 con 0x7f6c9c0047c0 2023-10-14T10:33:27.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6ca7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0047c0 0x7f6cb00aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:27.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6cb490c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb014fbd0 con 0x7f6c9c0052a0 2023-10-14T10:33:27.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6cb490c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00ba720 con 0x7f6c9c003970 2023-10-14T10:33:27.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6ca7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0047c0 0x7f6cb00aa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53736/0 (socket says 172.21.15.8:53736) 2023-10-14T10:33:27.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6ca7fff640 1 -- 172.21.15.8:0/639817312 learned_addr learned my addr 172.21.15.8:0/639817312 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:27.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6cae59c640 1 --2- 172.21.15.8:0/639817312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c9c003970 0x7f6cb014e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:27.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6caed9d640 1 --2- 172.21.15.8:0/639817312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c0052a0 0x7f6cb0150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:27.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6ca7fff640 1 -- 172.21.15.8:0/639817312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c9c003970 msgr2=0x7f6cb014e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/639817312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c9c003970 0x7f6cb014e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6ca7fff640 1 -- 172.21.15.8:0/639817312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c0052a0 msgr2=0x7f6cb0150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/639817312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c0052a0 0x7f6cb0150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.534+0000 7f6ca7fff640 1 -- 172.21.15.8:0/639817312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb00baa00 con 0x7f6c9c0047c0 2023-10-14T10:33:27.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.535+0000 7f6ca7fff640 1 --2- 172.21.15.8:0/639817312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0047c0 0x7f6cb00aa5a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6c980169f0 tx=0x7f6c98016eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:27.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.535+0000 7f6ca6ffd640 1 -- 172.21.15.8:0/639817312 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9801e050 con 0x7f6c9c0047c0 2023-10-14T10:33:27.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.535+0000 7f6ca6ffd640 1 -- 172.21.15.8:0/639817312 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9801f040 con 0x7f6c9c0047c0 2023-10-14T10:33:27.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.535+0000 7f6cb490c640 1 -- 172.21.15.8:0/639817312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb014fe20 con 0x7f6c9c0047c0 2023-10-14T10:33:27.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.535+0000 7f6ca6ffd640 1 -- 172.21.15.8:0/639817312 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98023400 con 0x7f6c9c0047c0 2023-10-14T10:33:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.536+0000 7f6cb490c640 1 -- 172.21.15.8:0/639817312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb0152050 con 0x7f6c9c0047c0 2023-10-14T10:33:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.536+0000 7f6ca6ffd640 1 -- 172.21.15.8:0/639817312 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6c98005c90 con 0x7f6c9c0047c0 2023-10-14T10:33:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.536+0000 7f6ca6ffd640 1 -- 172.21.15.8:0/639817312 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6c98006020 con 0x7f6c9c0047c0 2023-10-14T10:33:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.537+0000 7f6cb490c640 1 -- 172.21.15.8:0/639817312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb0073b50 con 0x7f6c9c0047c0 2023-10-14T10:33:27.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.541+0000 7f6ca6ffd640 1 -- 172.21.15.8:0/639817312 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6c98027020 con 0x7f6c9c0047c0 2023-10-14T10:33:27.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.615+0000 7f6cb490c640 1 -- 172.21.15.8:0/639817312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6cb00be280 con 0x7f6c9c0047c0 2023-10-14T10:33:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.619+0000 7f6ca6ffd640 1 -- 172.21.15.8:0/639817312 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6c98039090 con 0x7f6c9c0047c0 2023-10-14T10:33:27.621 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2023-10-14T10:33:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.620+0000 7f6cb490c640 1 -- 172.21.15.8:0/639817312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0047c0 msgr2=0x7f6cb00aa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:27.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.620+0000 7f6cb490c640 1 --2- 172.21.15.8:0/639817312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0047c0 0x7f6cb00aa5a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6c980169f0 tx=0x7f6c98016eb0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.621+0000 7f6cb490c640 1 -- 172.21.15.8:0/639817312 shutdown_connections 2023-10-14T10:33:27.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.621+0000 7f6cb490c640 1 --2- 172.21.15.8:0/639817312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c9c0052a0 0x7f6cb0150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.621+0000 7f6cb490c640 1 --2- 172.21.15.8:0/639817312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0047c0 0x7f6cb00aa5a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.621+0000 7f6cb490c640 1 --2- 172.21.15.8:0/639817312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c9c003970 0x7f6cb014e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:27.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.621+0000 7f6cb490c640 1 -- 172.21.15.8:0/639817312 >> 172.21.15.8:0/639817312 conn(0x7f6cb00a9250 msgr2=0x7f6cb00a9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:27.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.621+0000 7f6cb490c640 1 -- 172.21.15.8:0/639817312 shutdown_connections 2023-10-14T10:33:27.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:27.621+0000 7f6cb490c640 1 -- 172.21.15.8:0/639817312 wait complete. 2023-10-14T10:33:27.639 INFO:tasks.ceph:check_enable_crimson: False 2023-10-14T10:33:27.640 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-14T10:33:27.640 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:33:27.641 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-14T10:33:27.718 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:33:27.719 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-14T10:33:27.860 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:33:27.861 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-14T10:33:27.948 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:33:27.949 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-14T10:33:28.038 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:33:28.038 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-14T10:33:28.140 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:33:28.141 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-14T10:33:28.142 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:28.139+0000 7f0bb0034040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T10:33:28.203 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:28.201+0000 7f0bb0034040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T10:33:28.232 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:33:28.233 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-14T10:33:28.331 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:33:28.332 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-14T10:33:28.428 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 7dd633d9-7a74-4616-ad34-6c2f9da358ca 0 2023-10-14T10:33:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.616+0000 7fae0c8c3640 1 Processor -- start 2023-10-14T10:33:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.617+0000 7fae0c8c3640 1 -- start start 2023-10-14T10:33:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.618+0000 7fae0c8c3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fae080c43a0 0x7fae080c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.618+0000 7fae0c8c3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fae080c5610 0x7fae0806ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.618+0000 7fae0c8c3640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae080c4e30 con 0x7fae08151420 2023-10-14T10:33:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.618+0000 7fae0c8c3640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae080c5450 con 0x7fae080c5610 2023-10-14T10:33:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.618+0000 7fae0c8c3640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae08154950 con 0x7fae080c43a0 2023-10-14T10:33:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.618+0000 7fadfffff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fae080c43a0 0x7fae080c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.618+0000 7fadfffff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fae080c43a0 0x7fae080c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56252/0 (socket says 172.21.15.92:56252) 2023-10-14T10:33:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.618+0000 7fadfffff640 1 -- 172.21.15.92:0/1290019819 learned_addr learned my addr 172.21.15.92:0/1290019819 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:28.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.619+0000 7fae07fff640 1 --2- 172.21.15.92:0/1290019819 >> v2:172.21.15.8:3300/0 conn(0x7fae080c5610 0x7fae0806ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:28.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.619+0000 7fadfffff640 1 -- 172.21.15.92:0/1290019819 >> v2:172.21.15.8:3300/0 conn(0x7fae080c5610 msgr2=0x7fae0806ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:28.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.619+0000 7fadfffff640 1 --2- 172.21.15.92:0/1290019819 >> v2:172.21.15.8:3300/0 conn(0x7fae080c5610 0x7fae0806ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.619+0000 7fadfffff640 1 -- 172.21.15.92:0/1290019819 >> v1:172.21.15.8:6789/0 conn(0x7fae08151420 legacy=0x7fae080c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:28.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.619+0000 7fadfffff640 1 -- 172.21.15.92:0/1290019819 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae080c5d00 con 0x7fae080c43a0 2023-10-14T10:33:28.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.620+0000 7fadfffff640 1 --2- 172.21.15.92:0/1290019819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080c43a0 0x7fae080c48f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae0806a9d0 tx=0x7fadf002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=843541bd780b4c6f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:28.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.620+0000 7fae06ffd640 1 -- 172.21.15.92:0/1290019819 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0031870 con 0x7fae080c43a0 2023-10-14T10:33:28.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.620+0000 7fae06ffd640 1 -- 172.21.15.92:0/1290019819 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf00319d0 con 0x7fae080c43a0 2023-10-14T10:33:28.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.620+0000 7fae06ffd640 1 -- 172.21.15.92:0/1290019819 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0031d60 con 0x7fae080c43a0 2023-10-14T10:33:28.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.621+0000 7fae0c8c3640 1 -- 172.21.15.92:0/1290019819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080c43a0 msgr2=0x7fae080c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:28.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.621+0000 7fae0c8c3640 1 --2- 172.21.15.92:0/1290019819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080c43a0 0x7fae080c48f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae0806a9d0 tx=0x7fadf002b910 comp rx=0 tx=0).stop 2023-10-14T10:33:28.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.621+0000 7fae0c8c3640 1 -- 172.21.15.92:0/1290019819 shutdown_connections 2023-10-14T10:33:28.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.621+0000 7fae0c8c3640 1 --2- 172.21.15.92:0/1290019819 >> v2:172.21.15.8:3300/0 conn(0x7fae080c5610 0x7fae0806ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.621+0000 7fae0c8c3640 1 --2- 172.21.15.92:0/1290019819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080c43a0 0x7fae080c48f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.621+0000 7fae0c8c3640 1 -- 172.21.15.92:0/1290019819 >> 172.21.15.92:0/1290019819 conn(0x7fae080c96c0 msgr2=0x7fae080c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:28.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.621+0000 7fae0c8c3640 1 -- 172.21.15.92:0/1290019819 shutdown_connections 2023-10-14T10:33:28.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.621+0000 7fae0c8c3640 1 -- 172.21.15.92:0/1290019819 wait complete. 2023-10-14T10:33:28.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.623+0000 7fae0c8c3640 1 Processor -- start 2023-10-14T10:33:28.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.623+0000 7fae0c8c3640 1 -- start start 2023-10-14T10:33:28.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.624+0000 7fae0c8c3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080c43a0 0x7fae080ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:28.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.624+0000 7fae0c8c3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae080c5610 0x7fae08149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:28.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.624+0000 7fae0c8c3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae08151420 0x7fae08144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:28.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.624+0000 7fae0c8c3640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae080ad560 con 0x7fae08151420 2023-10-14T10:33:28.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.624+0000 7fae0c8c3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae080aeda0 con 0x7fae080c43a0 2023-10-14T10:33:28.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.624+0000 7fae0c8c3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae081535a0 con 0x7fae080c5610 2023-10-14T10:33:28.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.624+0000 7fadfffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae080c5610 0x7fae08149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:28.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.624+0000 7fae077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080c43a0 0x7fae080ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:28.630 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.624+0000 7fadfffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae080c5610 0x7fae08149090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:42644/0 (socket says 172.21.15.92:42644) 2023-10-14T10:33:28.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.624+0000 7fae077fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080c43a0 0x7fae080ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56256/0 (socket says 172.21.15.92:56256) 2023-10-14T10:33:28.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.624+0000 7fadfffff640 1 -- 172.21.15.92:0/371569534 learned_addr learned my addr 172.21.15.92:0/371569534 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:28.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.624+0000 7fae07fff640 1 --2- 172.21.15.92:0/371569534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae08151420 0x7fae08144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:28.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.625+0000 7fae077fe640 1 -- 172.21.15.92:0/371569534 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae080c5610 msgr2=0x7fae08149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:28.631 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.625+0000 7fae077fe640 1 --2- 172.21.15.92:0/371569534 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae080c5610 0x7fae08149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.625+0000 7fae077fe640 1 -- 172.21.15.92:0/371569534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae08151420 msgr2=0x7fae08144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:28.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.625+0000 7fae077fe640 1 --2- 172.21.15.92:0/371569534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae08151420 0x7fae08144760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.625+0000 7fae077fe640 1 -- 172.21.15.92:0/371569534 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00094d0 con 0x7fae080c43a0 2023-10-14T10:33:28.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.625+0000 7fadfffff640 1 --2- 172.21.15.92:0/371569534 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae080c5610 0x7fae08149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:33:28.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.625+0000 7fae077fe640 1 --2- 172.21.15.92:0/371569534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080c43a0 0x7fae080ae860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c390 tx=0x7fadf800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:28.632 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.625+0000 7fae04ff9640 1 -- 172.21.15.92:0/371569534 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80052d0 con 0x7fae080c43a0 2023-10-14T10:33:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.625+0000 7fae04ff9640 1 -- 172.21.15.92:0/371569534 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8005430 con 0x7fae080c43a0 2023-10-14T10:33:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.625+0000 7fae0c8c3640 1 -- 172.21.15.92:0/371569534 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae081495d0 con 0x7fae080c43a0 2023-10-14T10:33:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.625+0000 7fae04ff9640 1 -- 172.21.15.92:0/371569534 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8003830 con 0x7fae080c43a0 2023-10-14T10:33:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.625+0000 7fae0c8c3640 1 -- 172.21.15.92:0/371569534 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae081ec5a0 con 0x7fae080c43a0 2023-10-14T10:33:28.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.626+0000 7fae04ff9640 1 -- 172.21.15.92:0/371569534 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fadf8003c90 con 0x7fae080c43a0 2023-10-14T10:33:28.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.626+0000 7fae04ff9640 1 -- 172.21.15.92:0/371569534 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fadf801c780 con 0x7fae080c43a0 2023-10-14T10:33:28.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.627+0000 7fae0c8c3640 1 -- 172.21.15.92:0/371569534 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae080619f0 con 0x7fae080c43a0 2023-10-14T10:33:28.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.629+0000 7fae04ff9640 1 -- 172.21.15.92:0/371569534 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fadf8017070 con 0x7fae080c43a0 2023-10-14T10:33:28.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.708+0000 7fae0c8c3640 1 -- 172.21.15.92:0/371569534 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7dd633d9-7a74-4616-ad34-6c2f9da358ca", "id": 0} v 0) v1 -- 0x7fae080af130 con 0x7fae080c43a0 2023-10-14T10:33:28.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.714+0000 7fae04ff9640 1 -- 172.21.15.92:0/371569534 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7dd633d9-7a74-4616-ad34-6c2f9da358ca", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae080c4e30 con 0x7fae080c43a0 2023-10-14T10:33:28.716 INFO:teuthology.orchestra.run.smithi092.stdout:0 2023-10-14T10:33:28.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.716+0000 7fae0c8c3640 1 -- 172.21.15.92:0/371569534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080c43a0 msgr2=0x7fae080ae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:28.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.716+0000 7fae0c8c3640 1 --2- 172.21.15.92:0/371569534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080c43a0 0x7fae080ae860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c390 tx=0x7fadf800c850 comp rx=0 tx=0).stop 2023-10-14T10:33:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.716+0000 7fae0c8c3640 1 -- 172.21.15.92:0/371569534 shutdown_connections 2023-10-14T10:33:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.716+0000 7fae0c8c3640 1 --2- 172.21.15.92:0/371569534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae08151420 0x7fae08144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.716+0000 7fae0c8c3640 1 --2- 172.21.15.92:0/371569534 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae080c5610 0x7fae08149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.716+0000 7fae0c8c3640 1 --2- 172.21.15.92:0/371569534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae080c43a0 0x7fae080ae860 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.716+0000 7fae0c8c3640 1 -- 172.21.15.92:0/371569534 >> 172.21.15.92:0/371569534 conn(0x7fae080c96c0 msgr2=0x7fae0814ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.716+0000 7fae0c8c3640 1 -- 172.21.15.92:0/371569534 shutdown_connections 2023-10-14T10:33:28.720 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.717+0000 7fae0c8c3640 1 -- 172.21.15.92:0/371569534 wait complete. 2023-10-14T10:33:28.735 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 2d91f3ae-0e58-4009-8491-1574ba15fbab 1 2023-10-14T10:33:28.924 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.923+0000 7fe8cb213640 1 Processor -- start 2023-10-14T10:33:28.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.923+0000 7fe8cb213640 1 -- start start 2023-10-14T10:33:28.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.924+0000 7fe8cb213640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe8c4151640 0x7fe8c406b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:28.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.924+0000 7fe8cb213640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe8c406ae00 0x7fe8c4157420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:28.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.924+0000 7fe8cb213640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c4158330 con 0x7fe8c40c4450 2023-10-14T10:33:28.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.924+0000 7fe8cb213640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c40c5e30 con 0x7fe8c406ae00 2023-10-14T10:33:28.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.924+0000 7fe8cb213640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c40c4a40 con 0x7fe8c4151640 2023-10-14T10:33:28.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.924+0000 7fe8ca211640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe8c4151640 0x7fe8c406b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:28.927 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.925+0000 7fe8ca211640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe8c4151640 0x7fe8c406b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56264/0 (socket says 172.21.15.92:56264) 2023-10-14T10:33:28.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.925+0000 7fe8ca211640 1 -- 172.21.15.92:0/1315289354 learned_addr learned my addr 172.21.15.92:0/1315289354 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:28.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.925+0000 7fe8caa12640 1 --2- 172.21.15.92:0/1315289354 >> v2:172.21.15.8:3300/0 conn(0x7fe8c406ae00 0x7fe8c4157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:28.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.925+0000 7fe8ca211640 1 -- 172.21.15.92:0/1315289354 >> v2:172.21.15.8:3300/0 conn(0x7fe8c406ae00 msgr2=0x7fe8c4157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:28.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.925+0000 7fe8ca211640 1 --2- 172.21.15.92:0/1315289354 >> v2:172.21.15.8:3300/0 conn(0x7fe8c406ae00 0x7fe8c4157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.925+0000 7fe8ca211640 1 -- 172.21.15.92:0/1315289354 >> v1:172.21.15.8:6789/0 conn(0x7fe8c40c4450 legacy=0x7fe8c40c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:28.928 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.925+0000 7fe8ca211640 1 -- 172.21.15.92:0/1315289354 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c40c4d20 con 0x7fe8c4151640 2023-10-14T10:33:28.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.926+0000 7fe8ca211640 1 --2- 172.21.15.92:0/1315289354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c4151640 0x7fe8c406b450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40ac210 tx=0x7fe8c002b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8bee322f56c51fe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:28.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.926+0000 7fe8c920f640 1 -- 172.21.15.92:0/1315289354 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00317e0 con 0x7fe8c4151640 2023-10-14T10:33:28.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.926+0000 7fe8c920f640 1 -- 172.21.15.92:0/1315289354 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c0031940 con 0x7fe8c4151640 2023-10-14T10:33:28.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.926+0000 7fe8c920f640 1 -- 172.21.15.92:0/1315289354 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0031cd0 con 0x7fe8c4151640 2023-10-14T10:33:28.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.927+0000 7fe8cb213640 1 -- 172.21.15.92:0/1315289354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c4151640 msgr2=0x7fe8c406b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:28.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.927+0000 7fe8cb213640 1 --2- 172.21.15.92:0/1315289354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c4151640 0x7fe8c406b450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40ac210 tx=0x7fe8c002b880 comp rx=0 tx=0).stop 2023-10-14T10:33:28.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.927+0000 7fe8cb213640 1 -- 172.21.15.92:0/1315289354 shutdown_connections 2023-10-14T10:33:28.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.927+0000 7fe8cb213640 1 --2- 172.21.15.92:0/1315289354 >> v2:172.21.15.8:3300/0 conn(0x7fe8c406ae00 0x7fe8c4157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.927+0000 7fe8cb213640 1 --2- 172.21.15.92:0/1315289354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c4151640 0x7fe8c406b450 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.927+0000 7fe8cb213640 1 -- 172.21.15.92:0/1315289354 >> 172.21.15.92:0/1315289354 conn(0x7fe8c40c96b0 msgr2=0x7fe8c40c9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:28.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.927+0000 7fe8cb213640 1 -- 172.21.15.92:0/1315289354 shutdown_connections 2023-10-14T10:33:28.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.927+0000 7fe8cb213640 1 -- 172.21.15.92:0/1315289354 wait complete. 2023-10-14T10:33:28.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.929+0000 7fe8cb213640 1 Processor -- start 2023-10-14T10:33:28.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.929+0000 7fe8cb213640 1 -- start start 2023-10-14T10:33:28.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8cb213640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8c406ae00 0x7fe8c4147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:28.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8cb213640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c40c4450 0x7fe8c41482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:28.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8cb213640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c4151640 0x7fe8c41ec9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:28.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8cb213640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c41487e0 con 0x7fe8c4151640 2023-10-14T10:33:28.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8cb213640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4154c70 con 0x7fe8c40c4450 2023-10-14T10:33:28.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8cb213640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c41ea640 con 0x7fe8c406ae00 2023-10-14T10:33:28.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8c9a10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c40c4450 0x7fe8c41482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:28.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8ca211640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8c406ae00 0x7fe8c4147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:28.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8c9a10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c40c4450 0x7fe8c41482a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56274/0 (socket says 172.21.15.92:56274) 2023-10-14T10:33:28.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8c9a10640 1 -- 172.21.15.92:0/758623931 learned_addr learned my addr 172.21.15.92:0/758623931 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:28.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8caa12640 1 --2- 172.21.15.92:0/758623931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c4151640 0x7fe8c41ec9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:28.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8c9a10640 1 -- 172.21.15.92:0/758623931 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8c406ae00 msgr2=0x7fe8c4147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:28.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8c9a10640 1 --2- 172.21.15.92:0/758623931 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8c406ae00 0x7fe8c4147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8c9a10640 1 -- 172.21.15.92:0/758623931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c4151640 msgr2=0x7fe8c41ec9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:28.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8c9a10640 1 --2- 172.21.15.92:0/758623931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c4151640 0x7fe8c41ec9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:28.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8c9a10640 1 -- 172.21.15.92:0/758623931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c00094d0 con 0x7fe8c40c4450 2023-10-14T10:33:28.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.930+0000 7fe8ca211640 1 --2- 172.21.15.92:0/758623931 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8c406ae00 0x7fe8c4147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:33:28.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.931+0000 7fe8c9a10640 1 --2- 172.21.15.92:0/758623931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c40c4450 0x7fe8c41482a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400c400 tx=0x7fe8b400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:28.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.931+0000 7fe8baffd640 1 -- 172.21.15.92:0/758623931 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40052d0 con 0x7fe8c40c4450 2023-10-14T10:33:28.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.931+0000 7fe8baffd640 1 -- 172.21.15.92:0/758623931 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b4005430 con 0x7fe8c40c4450 2023-10-14T10:33:28.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.931+0000 7fe8cb213640 1 -- 172.21.15.92:0/758623931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c414e330 con 0x7fe8c40c4450 2023-10-14T10:33:28.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.931+0000 7fe8baffd640 1 -- 172.21.15.92:0/758623931 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4003830 con 0x7fe8c40c4450 2023-10-14T10:33:28.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.931+0000 7fe8cb213640 1 -- 172.21.15.92:0/758623931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c41ea8e0 con 0x7fe8c40c4450 2023-10-14T10:33:28.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.931+0000 7fe8baffd640 1 -- 172.21.15.92:0/758623931 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe8b4003c90 con 0x7fe8c40c4450 2023-10-14T10:33:28.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.931+0000 7fe8baffd640 1 -- 172.21.15.92:0/758623931 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fe8b401c440 con 0x7fe8c40c4450 2023-10-14T10:33:28.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.932+0000 7fe8cb213640 1 -- 172.21.15.92:0/758623931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c40619f0 con 0x7fe8c40c4450 2023-10-14T10:33:28.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:28.935+0000 7fe8baffd640 1 -- 172.21.15.92:0/758623931 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe8b4017070 con 0x7fe8c40c4450 2023-10-14T10:33:28.947 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:28.945+0000 7f0bb0034040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T10:33:29.011 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:29.009+0000 7f0bb0034040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T10:33:29.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.012+0000 7fe8cb213640 1 -- 172.21.15.92:0/758623931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2d91f3ae-0e58-4009-8491-1574ba15fbab", "id": 1} v 0) v1 -- 0x7fe8c414f5c0 con 0x7fe8c40c4450 2023-10-14T10:33:29.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.018+0000 7fe8baffd640 1 -- 172.21.15.92:0/758623931 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d91f3ae-0e58-4009-8491-1574ba15fbab", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe8b4011590 con 0x7fe8c40c4450 2023-10-14T10:33:29.020 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-10-14T10:33:29.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.019+0000 7fe8cb213640 1 -- 172.21.15.92:0/758623931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c40c4450 msgr2=0x7fe8c41482a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.019+0000 7fe8cb213640 1 --2- 172.21.15.92:0/758623931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c40c4450 0x7fe8c41482a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400c400 tx=0x7fe8b400c8c0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.021 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.019+0000 7fe8cb213640 1 -- 172.21.15.92:0/758623931 shutdown_connections 2023-10-14T10:33:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.019+0000 7fe8cb213640 1 --2- 172.21.15.92:0/758623931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c4151640 0x7fe8c41ec9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.019+0000 7fe8cb213640 1 --2- 172.21.15.92:0/758623931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c40c4450 0x7fe8c41482a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.019+0000 7fe8cb213640 1 --2- 172.21.15.92:0/758623931 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8c406ae00 0x7fe8c4147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.019+0000 7fe8cb213640 1 -- 172.21.15.92:0/758623931 >> 172.21.15.92:0/758623931 conn(0x7fe8c40c96b0 msgr2=0x7fe8c414ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:29.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.020+0000 7fe8cb213640 1 -- 172.21.15.92:0/758623931 shutdown_connections 2023-10-14T10:33:29.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.020+0000 7fe8cb213640 1 -- 172.21.15.92:0/758623931 wait complete. 2023-10-14T10:33:29.027 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:29.026+0000 7fd524012040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T10:33:29.036 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new c7c6a1ec-a582-4bf3-80af-a2e8a9208882 2 2023-10-14T10:33:29.064 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:29.062+0000 7f0bb0034040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T10:33:29.090 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:29.089+0000 7fd524012040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T10:33:29.129 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:29.127+0000 7f0bb0034040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T10:33:29.181 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:29.179+0000 7f0bb0034040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T10:33:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.222+0000 7fe48e0a9640 1 Processor -- start 2023-10-14T10:33:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.222+0000 7fe48e0a9640 1 -- start start 2023-10-14T10:33:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.223+0000 7fe48e0a9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe48806c9b0 0x7fe4880c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.223+0000 7fe48e0a9640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe488150ef0 0x7fe488151380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.223+0000 7fe48e0a9640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4880c25a0 con 0x7fe4881545a0 2023-10-14T10:33:29.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.223+0000 7fe48e0a9640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4881550d0 con 0x7fe48806c9b0 2023-10-14T10:33:29.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.223+0000 7fe48e0a9640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48806ec60 con 0x7fe488150ef0 2023-10-14T10:33:29.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.224+0000 7fe487fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe488150ef0 0x7fe488151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.226 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.224+0000 7fe487fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe488150ef0 0x7fe488151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:42660/0 (socket says 172.21.15.92:42660) 2023-10-14T10:33:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.224+0000 7fe487fff640 1 -- 172.21.15.92:0/942796603 learned_addr learned my addr 172.21.15.92:0/942796603 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.224+0000 7fe47ffff640 1 --2- 172.21.15.92:0/942796603 >> v2:172.21.15.8:3300/0 conn(0x7fe48806c9b0 0x7fe4880c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.224+0000 7fe487fff640 1 -- 172.21.15.92:0/942796603 >> v2:172.21.15.8:3300/0 conn(0x7fe48806c9b0 msgr2=0x7fe4880c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.224+0000 7fe487fff640 1 --2- 172.21.15.92:0/942796603 >> v2:172.21.15.8:3300/0 conn(0x7fe48806c9b0 0x7fe4880c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.224+0000 7fe487fff640 1 -- 172.21.15.92:0/942796603 >> v1:172.21.15.8:6789/0 conn(0x7fe4881545a0 legacy=0x7fe48806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.228 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.224+0000 7fe487fff640 1 -- 172.21.15.92:0/942796603 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe488154df0 con 0x7fe488150ef0 2023-10-14T10:33:29.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.226+0000 7fe487fff640 1 --2- 172.21.15.92:0/942796603 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe488150ef0 0x7fe488151380 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe480009e50 tx=0x7fe48002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65a604ddd67c7109 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:29.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.226+0000 7fe486ffd640 1 -- 172.21.15.92:0/942796603 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48002cb00 con 0x7fe488150ef0 2023-10-14T10:33:29.229 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.226+0000 7fe486ffd640 1 -- 172.21.15.92:0/942796603 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48002cc60 con 0x7fe488150ef0 2023-10-14T10:33:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.226+0000 7fe486ffd640 1 -- 172.21.15.92:0/942796603 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4800343f0 con 0x7fe488150ef0 2023-10-14T10:33:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.227+0000 7fe48e0a9640 1 -- 172.21.15.92:0/942796603 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe488150ef0 msgr2=0x7fe488151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.227+0000 7fe48e0a9640 1 --2- 172.21.15.92:0/942796603 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe488150ef0 0x7fe488151380 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe480009e50 tx=0x7fe48002bf60 comp rx=0 tx=0).stop 2023-10-14T10:33:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.227+0000 7fe48e0a9640 1 -- 172.21.15.92:0/942796603 shutdown_connections 2023-10-14T10:33:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.227+0000 7fe48e0a9640 1 --2- 172.21.15.92:0/942796603 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe488150ef0 0x7fe488151380 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.227+0000 7fe48e0a9640 1 --2- 172.21.15.92:0/942796603 >> v2:172.21.15.8:3300/0 conn(0x7fe48806c9b0 0x7fe4880c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.227+0000 7fe48e0a9640 1 -- 172.21.15.92:0/942796603 >> 172.21.15.92:0/942796603 conn(0x7fe4880a9280 msgr2=0x7fe4880a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.227+0000 7fe48e0a9640 1 -- 172.21.15.92:0/942796603 shutdown_connections 2023-10-14T10:33:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.227+0000 7fe48e0a9640 1 -- 172.21.15.92:0/942796603 wait complete. 2023-10-14T10:33:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.228+0000 7fe48e0a9640 1 Processor -- start 2023-10-14T10:33:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.229+0000 7fe48e0a9640 1 -- start start 2023-10-14T10:33:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.229+0000 7fe48e0a9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe48806c9b0 0x7fe48806b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.229+0000 7fe48e0a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488150ef0 0x7fe4880a7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.229+0000 7fe48e0a9640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4881545a0 0x7fe4880a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.229+0000 7fe48e0a9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880c1440 con 0x7fe48806c9b0 2023-10-14T10:33:29.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.230+0000 7fe48e0a9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880bf220 con 0x7fe488150ef0 2023-10-14T10:33:29.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.230+0000 7fe48e0a9640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880a89a0 con 0x7fe4881545a0 2023-10-14T10:33:29.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.230+0000 7fe47ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488150ef0 0x7fe4880a7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.230+0000 7fe487fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4881545a0 0x7fe4880a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.230+0000 7fe47ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488150ef0 0x7fe4880a7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56286/0 (socket says 172.21.15.92:56286) 2023-10-14T10:33:29.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.230+0000 7fe47ffff640 1 -- 172.21.15.92:0/324975789 learned_addr learned my addr 172.21.15.92:0/324975789 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:29.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.230+0000 7fe4877fe640 1 --2- 172.21.15.92:0/324975789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe48806c9b0 0x7fe48806b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.230+0000 7fe487fff640 1 -- 172.21.15.92:0/324975789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488150ef0 msgr2=0x7fe4880a7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.230+0000 7fe487fff640 1 --2- 172.21.15.92:0/324975789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488150ef0 0x7fe4880a7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.230+0000 7fe487fff640 1 -- 172.21.15.92:0/324975789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe48806c9b0 msgr2=0x7fe48806b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.230+0000 7fe487fff640 1 --2- 172.21.15.92:0/324975789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe48806c9b0 0x7fe48806b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.230+0000 7fe487fff640 1 -- 172.21.15.92:0/324975789 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480009b30 con 0x7fe4881545a0 2023-10-14T10:33:29.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.231+0000 7fe487fff640 1 --2- 172.21.15.92:0/324975789 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4881545a0 0x7fe4880a8460 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe480032000 tx=0x7fe480004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:29.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.231+0000 7fe484ff9640 1 -- 172.21.15.92:0/324975789 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480009510 con 0x7fe4881545a0 2023-10-14T10:33:29.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.231+0000 7fe484ff9640 1 -- 172.21.15.92:0/324975789 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48003e450 con 0x7fe4881545a0 2023-10-14T10:33:29.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.231+0000 7fe48e0a9640 1 -- 172.21.15.92:0/324975789 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe488158480 con 0x7fe4881545a0 2023-10-14T10:33:29.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.231+0000 7fe484ff9640 1 -- 172.21.15.92:0/324975789 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48003e820 con 0x7fe4881545a0 2023-10-14T10:33:29.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.231+0000 7fe48e0a9640 1 -- 172.21.15.92:0/324975789 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4881ed310 con 0x7fe4881545a0 2023-10-14T10:33:29.238 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.231+0000 7fe484ff9640 1 -- 172.21.15.92:0/324975789 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe480003c90 con 0x7fe4881545a0 2023-10-14T10:33:29.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.231+0000 7fe484ff9640 1 -- 172.21.15.92:0/324975789 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe48003e980 con 0x7fe4881545a0 2023-10-14T10:33:29.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.232+0000 7fe48e0a9640 1 -- 172.21.15.92:0/324975789 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48804e9b0 con 0x7fe4881545a0 2023-10-14T10:33:29.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.237+0000 7fe484ff9640 1 -- 172.21.15.92:0/324975789 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe480043020 con 0x7fe4881545a0 2023-10-14T10:33:29.300 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:29.298+0000 7f0bb0034040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T10:33:29.315 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.313+0000 7fe48e0a9640 1 -- 172.21.15.92:0/324975789 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c7c6a1ec-a582-4bf3-80af-a2e8a9208882", "id": 2} v 0) v1 -- 0x7fe48806cee0 con 0x7fe4881545a0 2023-10-14T10:33:29.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.319+0000 7fe484ff9640 1 -- 172.21.15.92:0/324975789 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7c6a1ec-a582-4bf3-80af-a2e8a9208882", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe480004020 con 0x7fe4881545a0 2023-10-14T10:33:29.321 INFO:teuthology.orchestra.run.smithi092.stdout:2 2023-10-14T10:33:29.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.321+0000 7fe48e0a9640 1 -- 172.21.15.92:0/324975789 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4881545a0 msgr2=0x7fe4880a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.321+0000 7fe48e0a9640 1 --2- 172.21.15.92:0/324975789 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4881545a0 0x7fe4880a8460 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe480032000 tx=0x7fe480004a40 comp rx=0 tx=0).stop 2023-10-14T10:33:29.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.321+0000 7fe48e0a9640 1 -- 172.21.15.92:0/324975789 shutdown_connections 2023-10-14T10:33:29.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.321+0000 7fe48e0a9640 1 --2- 172.21.15.92:0/324975789 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4881545a0 0x7fe4880a8460 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.321+0000 7fe48e0a9640 1 --2- 172.21.15.92:0/324975789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe488150ef0 0x7fe4880a7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.321+0000 7fe48e0a9640 1 --2- 172.21.15.92:0/324975789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe48806c9b0 0x7fe48806b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.321+0000 7fe48e0a9640 1 -- 172.21.15.92:0/324975789 >> 172.21.15.92:0/324975789 conn(0x7fe4880a9280 msgr2=0x7fe4880c5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:29.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.321+0000 7fe48e0a9640 1 -- 172.21.15.92:0/324975789 shutdown_connections 2023-10-14T10:33:29.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.321+0000 7fe48e0a9640 1 -- 172.21.15.92:0/324975789 wait complete. 2023-10-14T10:33:29.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new d1e58121-1911-4043-a181-bd757b9e23c5 3 2023-10-14T10:33:29.384 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:29.382+0000 7f0bb0034040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T10:33:29.440 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:29.438+0000 7f0bb0034040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T10:33:29.503 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:29.501+0000 7f0bb0034040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T10:33:29.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.531+0000 7fbe94333640 1 Processor -- start 2023-10-14T10:33:29.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.532+0000 7fbe94333640 1 -- start start 2023-10-14T10:33:29.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.533+0000 7fbe94333640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbe8c14e4b0 0x7fbe8c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.533+0000 7fbe94333640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbe8c0a8a30 0x7fbe8c0c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.533+0000 7fbe94333640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8c1552e0 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.533+0000 7fbe94333640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8c0c0b70 con 0x7fbe8c14e4b0 2023-10-14T10:33:29.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.533+0000 7fbe94333640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8c0c1670 con 0x7fbe8c0a8a30 2023-10-14T10:33:29.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.534+0000 7fbe918ce640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbe8c0a8a30 0x7fbe8c0c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.534+0000 7fbe918ce640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbe8c0a8a30 0x7fbe8c0c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56288/0 (socket says 172.21.15.92:56288) 2023-10-14T10:33:29.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.534+0000 7fbe918ce640 1 -- 172.21.15.92:0/226665827 learned_addr learned my addr 172.21.15.92:0/226665827 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:29.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.534+0000 7fbe920cf640 1 --2- 172.21.15.92:0/226665827 >> v2:172.21.15.8:3300/0 conn(0x7fbe8c14e4b0 0x7fbe8c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.534+0000 7fbe918ce640 1 -- 172.21.15.92:0/226665827 >> v2:172.21.15.8:3300/0 conn(0x7fbe8c14e4b0 msgr2=0x7fbe8c154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:29.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.534+0000 7fbe918ce640 1 --2- 172.21.15.92:0/226665827 >> v2:172.21.15.8:3300/0 conn(0x7fbe8c14e4b0 0x7fbe8c154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.534+0000 7fbe918ce640 1 -- 172.21.15.92:0/226665827 >> v1:172.21.15.8:6789/0 conn(0x7fbe8c0c5ce0 legacy=0x7fbe8c150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.534+0000 7fbe918ce640 1 -- 172.21.15.92:0/226665827 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c0c0540 con 0x7fbe8c0a8a30 2023-10-14T10:33:29.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.534+0000 7fbe920cf640 1 --2- 172.21.15.92:0/226665827 >> v2:172.21.15.8:3300/0 conn(0x7fbe8c14e4b0 0x7fbe8c154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:29.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.536+0000 7fbe918ce640 1 --2- 172.21.15.92:0/226665827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe8c0a8a30 0x7fbe8c0c57a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c06de80 tx=0x7fbe7c02e0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3208800cd0411c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:29.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.536+0000 7fbe910cd640 1 -- 172.21.15.92:0/226665827 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c02ee90 con 0x7fbe8c0a8a30 2023-10-14T10:33:29.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.536+0000 7fbe910cd640 1 -- 172.21.15.92:0/226665827 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c036440 con 0x7fbe8c0a8a30 2023-10-14T10:33:29.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.536+0000 7fbe910cd640 1 -- 172.21.15.92:0/226665827 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0367d0 con 0x7fbe8c0a8a30 2023-10-14T10:33:29.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.537+0000 7fbe94333640 1 -- 172.21.15.92:0/226665827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe8c0a8a30 msgr2=0x7fbe8c0c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.537+0000 7fbe94333640 1 --2- 172.21.15.92:0/226665827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe8c0a8a30 0x7fbe8c0c57a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c06de80 tx=0x7fbe7c02e0e0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.537+0000 7fbe94333640 1 -- 172.21.15.92:0/226665827 shutdown_connections 2023-10-14T10:33:29.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.537+0000 7fbe94333640 1 --2- 172.21.15.92:0/226665827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe8c0a8a30 0x7fbe8c0c57a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.537+0000 7fbe94333640 1 --2- 172.21.15.92:0/226665827 >> v2:172.21.15.8:3300/0 conn(0x7fbe8c14e4b0 0x7fbe8c154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.537+0000 7fbe94333640 1 -- 172.21.15.92:0/226665827 >> 172.21.15.92:0/226665827 conn(0x7fbe8c0a74d0 msgr2=0x7fbe8c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:29.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.537+0000 7fbe94333640 1 -- 172.21.15.92:0/226665827 shutdown_connections 2023-10-14T10:33:29.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.537+0000 7fbe94333640 1 -- 172.21.15.92:0/226665827 wait complete. 2023-10-14T10:33:29.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.539+0000 7fbe94333640 1 Processor -- start 2023-10-14T10:33:29.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.539+0000 7fbe94333640 1 -- start start 2023-10-14T10:33:29.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.540+0000 7fbe94333640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8c0a8a30 0x7fbe8c0c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.540+0000 7fbe94333640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe8c0c5ce0 0x7fbe8c14f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe94333640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe8c14e4b0 0x7fbe8c143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe94333640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c14d530 con 0x7fbe8c0a8a30 2023-10-14T10:33:29.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe94333640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c14bc20 con 0x7fbe8c14e4b0 2023-10-14T10:33:29.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe94333640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c1e88d0 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe918ce640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe8c0c5ce0 0x7fbe8c14f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe918ce640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe8c0c5ce0 0x7fbe8c14f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:42680/0 (socket says 172.21.15.92:42680) 2023-10-14T10:33:29.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe918ce640 1 -- 172.21.15.92:0/1422630942 learned_addr learned my addr 172.21.15.92:0/1422630942 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:29.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe928d0640 1 --2- 172.21.15.92:0/1422630942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe8c14e4b0 0x7fbe8c143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe920cf640 1 --2- 172.21.15.92:0/1422630942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8c0a8a30 0x7fbe8c0c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe918ce640 1 -- 172.21.15.92:0/1422630942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe8c14e4b0 msgr2=0x7fbe8c143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe918ce640 1 --2- 172.21.15.92:0/1422630942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe8c14e4b0 0x7fbe8c143ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe918ce640 1 -- 172.21.15.92:0/1422630942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8c0a8a30 msgr2=0x7fbe8c0c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe918ce640 1 --2- 172.21.15.92:0/1422630942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8c0a8a30 0x7fbe8c0c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe918ce640 1 -- 172.21.15.92:0/1422630942 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c00b770 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.541+0000 7fbe920cf640 1 --2- 172.21.15.92:0/1422630942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8c0a8a30 0x7fbe8c0c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:29.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.542+0000 7fbe918ce640 1 --2- 172.21.15.92:0/1422630942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe8c0c5ce0 0x7fbe8c14f650 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c02e120 tx=0x7fbe7c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:29.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.542+0000 7fbe82ffd640 1 -- 172.21.15.92:0/1422630942 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c034850 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.542+0000 7fbe82ffd640 1 -- 172.21.15.92:0/1422630942 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c0349b0 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.542+0000 7fbe82ffd640 1 -- 172.21.15.92:0/1422630942 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c034d60 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.542+0000 7fbe94333640 1 -- 172.21.15.92:0/1422630942 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8c1e8bb0 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.542+0000 7fbe94333640 1 -- 172.21.15.92:0/1422630942 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8c14bf00 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.543+0000 7fbe82ffd640 1 -- 172.21.15.92:0/1422630942 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbe7c03d040 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.543+0000 7fbe82ffd640 1 -- 172.21.15.92:0/1422630942 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fbe7c0418b0 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.543+0000 7fbe94333640 1 -- 172.21.15.92:0/1422630942 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8c14d700 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.546+0000 7fbe82ffd640 1 -- 172.21.15.92:0/1422630942 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fbe7c069b40 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.561 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:29.559+0000 7f0bb0034040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T10:33:29.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.623+0000 7fbe94333640 1 -- 172.21.15.92:0/1422630942 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d1e58121-1911-4043-a181-bd757b9e23c5", "id": 3} v 0) v1 -- 0x7fbe8c04e9b0 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.633 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.631+0000 7fbe82ffd640 1 -- 172.21.15.92:0/1422630942 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d1e58121-1911-4043-a181-bd757b9e23c5", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbe7c058030 con 0x7fbe8c0c5ce0 2023-10-14T10:33:29.633 INFO:teuthology.orchestra.run.smithi092.stdout:3 2023-10-14T10:33:29.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.633+0000 7fbe94333640 1 -- 172.21.15.92:0/1422630942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe8c0c5ce0 msgr2=0x7fbe8c14f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.633+0000 7fbe94333640 1 --2- 172.21.15.92:0/1422630942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe8c0c5ce0 0x7fbe8c14f650 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c02e120 tx=0x7fbe7c0046c0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.633+0000 7fbe94333640 1 -- 172.21.15.92:0/1422630942 shutdown_connections 2023-10-14T10:33:29.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.633+0000 7fbe94333640 1 --2- 172.21.15.92:0/1422630942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe8c14e4b0 0x7fbe8c143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.633+0000 7fbe94333640 1 --2- 172.21.15.92:0/1422630942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbe8c0c5ce0 0x7fbe8c14f650 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.633+0000 7fbe94333640 1 --2- 172.21.15.92:0/1422630942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8c0a8a30 0x7fbe8c0c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.635 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.633+0000 7fbe94333640 1 -- 172.21.15.92:0/1422630942 >> 172.21.15.92:0/1422630942 conn(0x7fbe8c0a74d0 msgr2=0x7fbe8c0704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:29.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.633+0000 7fbe94333640 1 -- 172.21.15.92:0/1422630942 shutdown_connections 2023-10-14T10:33:29.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.633+0000 7fbe94333640 1 -- 172.21.15.92:0/1422630942 wait complete. 2023-10-14T10:33:29.650 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1 4 2023-10-14T10:33:29.704 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:29.703+0000 7fd524012040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T10:33:29.769 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:29.767+0000 7fd524012040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T10:33:29.822 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:29.821+0000 7fd524012040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T10:33:29.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.835+0000 7fe1714e5640 1 Processor -- start 2023-10-14T10:33:29.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.836+0000 7fe1714e5640 1 -- start start 2023-10-14T10:33:29.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.837+0000 7fe1714e5640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe16c0a9170 0x7fe16c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.837+0000 7fe1714e5640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c0af820 0x7fe16c0c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.837+0000 7fe1714e5640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16c151ae0 con 0x7fe16c06ab00 2023-10-14T10:33:29.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.837+0000 7fe1714e5640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c155040 con 0x7fe16c0a9170 2023-10-14T10:33:29.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.837+0000 7fe1714e5640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0c4490 con 0x7fe16c0af820 2023-10-14T10:33:29.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.837+0000 7fe16affd640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe16c06ab00 0x7fe16c0c52c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43242/0 (socket says 172.21.15.92:43242) 2023-10-14T10:33:29.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.837+0000 7fe16affd640 1 -- 172.21.15.92:0/2005016013 learned_addr learned my addr 172.21.15.92:0/2005016013 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-10-14T10:33:29.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.837+0000 7fe16b7fe640 1 --2- 172.21.15.92:0/2005016013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c0af820 0x7fe16c0c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.838+0000 7fe16a7fc640 1 --2- 172.21.15.92:0/2005016013 >> v2:172.21.15.8:3300/0 conn(0x7fe16c0a9170 0x7fe16c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.838+0000 7fe169ffb640 1 -- 172.21.15.92:0/2005016013 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361617059 0 0) 0x7fe15c001490 con 0x7fe16c06ab00 2023-10-14T10:33:29.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.838+0000 7fe169ffb640 1 -- 172.21.15.92:0/2005016013 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe158003520 con 0x7fe16c06ab00 2023-10-14T10:33:29.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.838+0000 7fe16b7fe640 1 -- 172.21.15.92:0/2005016013 >> v2:172.21.15.8:3300/0 conn(0x7fe16c0a9170 msgr2=0x7fe16c06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:29.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.838+0000 7fe16b7fe640 1 --2- 172.21.15.92:0/2005016013 >> v2:172.21.15.8:3300/0 conn(0x7fe16c0a9170 0x7fe16c06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.838+0000 7fe16b7fe640 1 -- 172.21.15.92:0/2005016013 >> v1:172.21.15.92:6789/0 conn(0x7fe16c06ab00 legacy=0x7fe16c0c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.838+0000 7fe16b7fe640 1 -- 172.21.15.92:0/2005016013 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c154aa0 con 0x7fe16c0af820 2023-10-14T10:33:29.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.838+0000 7fe16a7fc640 1 --2- 172.21.15.92:0/2005016013 >> v2:172.21.15.8:3300/0 conn(0x7fe16c0a9170 0x7fe16c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:29.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.839+0000 7fe16b7fe640 1 --2- 172.21.15.92:0/2005016013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c0af820 0x7fe16c0c59d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe1640097a0 tx=0x7fe16402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23ff556b10851a27 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:29.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.839+0000 7fe169ffb640 1 -- 172.21.15.92:0/2005016013 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164031780 con 0x7fe16c0af820 2023-10-14T10:33:29.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.839+0000 7fe169ffb640 1 -- 172.21.15.92:0/2005016013 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1640318e0 con 0x7fe16c0af820 2023-10-14T10:33:29.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.839+0000 7fe169ffb640 1 -- 172.21.15.92:0/2005016013 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164031c50 con 0x7fe16c0af820 2023-10-14T10:33:29.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.840+0000 7fe1714e5640 1 -- 172.21.15.92:0/2005016013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c0af820 msgr2=0x7fe16c0c59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.840+0000 7fe1714e5640 1 --2- 172.21.15.92:0/2005016013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c0af820 0x7fe16c0c59d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe1640097a0 tx=0x7fe16402b820 comp rx=0 tx=0).stop 2023-10-14T10:33:29.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.840+0000 7fe1714e5640 1 -- 172.21.15.92:0/2005016013 shutdown_connections 2023-10-14T10:33:29.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.840+0000 7fe1714e5640 1 --2- 172.21.15.92:0/2005016013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c0af820 0x7fe16c0c59d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.840+0000 7fe1714e5640 1 --2- 172.21.15.92:0/2005016013 >> v2:172.21.15.8:3300/0 conn(0x7fe16c0a9170 0x7fe16c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.840+0000 7fe1714e5640 1 -- 172.21.15.92:0/2005016013 >> 172.21.15.92:0/2005016013 conn(0x7fe16c0ab600 msgr2=0x7fe16c0aba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:29.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.840+0000 7fe1714e5640 1 -- 172.21.15.92:0/2005016013 shutdown_connections 2023-10-14T10:33:29.846 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.840+0000 7fe1714e5640 1 -- 172.21.15.92:0/2005016013 wait complete. 2023-10-14T10:33:29.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.842+0000 7fe1714e5640 1 Processor -- start 2023-10-14T10:33:29.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.842+0000 7fe1714e5640 1 -- start start 2023-10-14T10:33:29.848 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.843+0000 7fe1714e5640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c06ab00 0x7fe16c157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.843+0000 7fe1714e5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe16c0a9170 0x7fe16c156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.843+0000 7fe1714e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe16c0af820 0x7fe16c1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:29.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.843+0000 7fe1714e5640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0bf9f0 con 0x7fe16c0a9170 2023-10-14T10:33:29.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.843+0000 7fe1714e5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c1eaa60 con 0x7fe16c0af820 2023-10-14T10:33:29.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.843+0000 7fe1714e5640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0c3950 con 0x7fe16c06ab00 2023-10-14T10:33:29.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.843+0000 7fe16affd640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c06ab00 0x7fe16c157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.843+0000 7fe16affd640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c06ab00 0x7fe16c157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:42698/0 (socket says 172.21.15.92:42698) 2023-10-14T10:33:29.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.843+0000 7fe16affd640 1 -- 172.21.15.92:0/1998429868 learned_addr learned my addr 172.21.15.92:0/1998429868 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:29.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.843+0000 7fe16b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe16c0af820 0x7fe16c1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.843+0000 7fe16a7fc640 1 --2- 172.21.15.92:0/1998429868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe16c0a9170 0x7fe16c156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:29.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.844+0000 7fe16affd640 1 -- 172.21.15.92:0/1998429868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe16c0af820 msgr2=0x7fe16c1571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.844+0000 7fe16affd640 1 --2- 172.21.15.92:0/1998429868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe16c0af820 0x7fe16c1571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.844+0000 7fe16affd640 1 -- 172.21.15.92:0/1998429868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe16c0a9170 msgr2=0x7fe16c156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.844+0000 7fe16affd640 1 --2- 172.21.15.92:0/1998429868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe16c0a9170 0x7fe16c156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.844+0000 7fe16affd640 1 -- 172.21.15.92:0/1998429868 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe164009400 con 0x7fe16c06ab00 2023-10-14T10:33:29.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.844+0000 7fe16affd640 1 --2- 172.21.15.92:0/1998429868 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c06ab00 0x7fe16c157d90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe15c002220 tx=0x7fe15c00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:29.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.844+0000 7fe1637fe640 1 -- 172.21.15.92:0/1998429868 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c015e90 con 0x7fe16c06ab00 2023-10-14T10:33:29.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.844+0000 7fe1637fe640 1 -- 172.21.15.92:0/1998429868 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15c00a710 con 0x7fe16c06ab00 2023-10-14T10:33:29.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.844+0000 7fe1714e5640 1 -- 172.21.15.92:0/1998429868 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16c157710 con 0x7fe16c06ab00 2023-10-14T10:33:29.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.844+0000 7fe1637fe640 1 -- 172.21.15.92:0/1998429868 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c00aaa0 con 0x7fe16c06ab00 2023-10-14T10:33:29.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.844+0000 7fe1714e5640 1 -- 172.21.15.92:0/1998429868 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16c0c3390 con 0x7fe16c06ab00 2023-10-14T10:33:29.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.845+0000 7fe1637fe640 1 -- 172.21.15.92:0/1998429868 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe15c01b070 con 0x7fe16c06ab00 2023-10-14T10:33:29.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.845+0000 7fe1637fe640 1 -- 172.21.15.92:0/1998429868 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe15c01ee20 con 0x7fe16c06ab00 2023-10-14T10:33:29.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.845+0000 7fe1714e5640 1 -- 172.21.15.92:0/1998429868 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16c0c0c70 con 0x7fe16c06ab00 2023-10-14T10:33:29.854 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.848+0000 7fe1637fe640 1 -- 172.21.15.92:0/1998429868 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe16c0c0c70 con 0x7fe16c06ab00 2023-10-14T10:33:29.888 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:29.887+0000 7fd524012040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T10:33:29.926 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.925+0000 7fe1714e5640 1 -- 172.21.15.92:0/1998429868 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1", "id": 4} v 0) v1 -- 0x7fe16c08a310 con 0x7fe16c06ab00 2023-10-14T10:33:29.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.931+0000 7fe1637fe640 1 -- 172.21.15.92:0/1998429868 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe16c151ae0 con 0x7fe16c06ab00 2023-10-14T10:33:29.932 INFO:teuthology.orchestra.run.smithi092.stdout:4 2023-10-14T10:33:29.933 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.932+0000 7fe1714e5640 1 -- 172.21.15.92:0/1998429868 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c06ab00 msgr2=0x7fe16c157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:29.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.932+0000 7fe1714e5640 1 --2- 172.21.15.92:0/1998429868 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c06ab00 0x7fe16c157d90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe15c002220 tx=0x7fe15c00a060 comp rx=0 tx=0).stop 2023-10-14T10:33:29.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.932+0000 7fe1714e5640 1 -- 172.21.15.92:0/1998429868 shutdown_connections 2023-10-14T10:33:29.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.932+0000 7fe1714e5640 1 --2- 172.21.15.92:0/1998429868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe16c0af820 0x7fe16c1571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.932+0000 7fe1714e5640 1 --2- 172.21.15.92:0/1998429868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe16c0a9170 0x7fe16c156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.932+0000 7fe1714e5640 1 --2- 172.21.15.92:0/1998429868 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe16c06ab00 0x7fe16c157d90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:29.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.932+0000 7fe1714e5640 1 -- 172.21.15.92:0/1998429868 >> 172.21.15.92:0/1998429868 conn(0x7fe16c0ab600 msgr2=0x7fe16c0ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:29.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.932+0000 7fe1714e5640 1 -- 172.21.15.92:0/1998429868 shutdown_connections 2023-10-14T10:33:29.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:29.932+0000 7fe1714e5640 1 -- 172.21.15.92:0/1998429868 wait complete. 2023-10-14T10:33:29.940 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:29.939+0000 7fd524012040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T10:33:29.949 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new b960328f-c14f-4f72-9c67-851a03aa12c9 5 2023-10-14T10:33:30.036 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:30.033+0000 7f0bb0034040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T10:33:30.061 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:30.060+0000 7fd524012040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T10:33:30.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.139+0000 7f5e2710f640 1 Processor -- start 2023-10-14T10:33:30.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.139+0000 7f5e2710f640 1 -- start start 2023-10-14T10:33:30.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.140+0000 7f5e2710f640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5e20151590 0x7f5e20155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.140+0000 7f5e2710f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5e200c4210 0x7f5e200c4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.140+0000 7f5e2710f640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e200ca6c0 con 0x7f5e20154a00 2023-10-14T10:33:30.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.140+0000 7f5e2710f640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e200c4f70 con 0x7f5e200c4210 2023-10-14T10:33:30.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.140+0000 7f5e2710f640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e20157a10 con 0x7f5e20151590 2023-10-14T10:33:30.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.141+0000 7f5e24eab640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5e20151590 0x7f5e20155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.141+0000 7f5e24eab640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5e20151590 0x7f5e20155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56304/0 (socket says 172.21.15.92:56304) 2023-10-14T10:33:30.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.141+0000 7f5e24eab640 1 -- 172.21.15.92:0/1208723870 learned_addr learned my addr 172.21.15.92:0/1208723870 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:30.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.141+0000 7f5e256ac640 1 --2- 172.21.15.92:0/1208723870 >> v2:172.21.15.8:3300/0 conn(0x7f5e200c4210 0x7f5e200c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.141+0000 7f5e24eab640 1 -- 172.21.15.92:0/1208723870 >> v2:172.21.15.8:3300/0 conn(0x7f5e200c4210 msgr2=0x7f5e200c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:30.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.141+0000 7f5e24eab640 1 --2- 172.21.15.92:0/1208723870 >> v2:172.21.15.8:3300/0 conn(0x7f5e200c4210 0x7f5e200c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.141+0000 7f5e24eab640 1 -- 172.21.15.92:0/1208723870 >> v1:172.21.15.8:6789/0 conn(0x7f5e20154a00 legacy=0x7f5e20157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:30.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.141+0000 7f5e24eab640 1 -- 172.21.15.92:0/1208723870 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2006c8f0 con 0x7f5e20151590 2023-10-14T10:33:30.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.141+0000 7f5e256ac640 1 --2- 172.21.15.92:0/1208723870 >> v2:172.21.15.8:3300/0 conn(0x7f5e200c4210 0x7f5e200c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:30.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.142+0000 7f5e24eab640 1 --2- 172.21.15.92:0/1208723870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20151590 0x7f5e20155470 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5e200c9d70 tx=0x7f5e1402b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33eb84c70706ef14 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:30.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.143+0000 7f5e1f7fe640 1 -- 172.21.15.92:0/1208723870 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14031750 con 0x7f5e20151590 2023-10-14T10:33:30.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.143+0000 7f5e1f7fe640 1 -- 172.21.15.92:0/1208723870 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e140318b0 con 0x7f5e20151590 2023-10-14T10:33:30.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.143+0000 7f5e1f7fe640 1 -- 172.21.15.92:0/1208723870 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14031c40 con 0x7f5e20151590 2023-10-14T10:33:30.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.143+0000 7f5e2710f640 1 -- 172.21.15.92:0/1208723870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20151590 msgr2=0x7f5e20155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.143+0000 7f5e2710f640 1 --2- 172.21.15.92:0/1208723870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20151590 0x7f5e20155470 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5e200c9d70 tx=0x7f5e1402b7f0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.143+0000 7f5e2710f640 1 -- 172.21.15.92:0/1208723870 shutdown_connections 2023-10-14T10:33:30.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.143+0000 7f5e2710f640 1 --2- 172.21.15.92:0/1208723870 >> v2:172.21.15.8:3300/0 conn(0x7f5e200c4210 0x7f5e200c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.143+0000 7f5e2710f640 1 --2- 172.21.15.92:0/1208723870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20151590 0x7f5e20155470 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.143+0000 7f5e2710f640 1 -- 172.21.15.92:0/1208723870 >> 172.21.15.92:0/1208723870 conn(0x7f5e20065ed0 msgr2=0x7f5e200662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:30.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.143+0000 7f5e2710f640 1 -- 172.21.15.92:0/1208723870 shutdown_connections 2023-10-14T10:33:30.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.143+0000 7f5e2710f640 1 -- 172.21.15.92:0/1208723870 wait complete. 2023-10-14T10:33:30.149 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:30.144+0000 7fd524012040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T10:33:30.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.145+0000 7f5e2710f640 1 Processor -- start 2023-10-14T10:33:30.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.145+0000 7f5e2710f640 1 -- start start 2023-10-14T10:33:30.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.146+0000 7f5e2710f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e200c4210 0x7f5e200c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.146+0000 7f5e2710f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e20151590 0x7f5e200aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.146+0000 7f5e2710f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20154a00 0x7f5e20152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.146+0000 7f5e2710f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200bd9f0 con 0x7f5e20151590 2023-10-14T10:33:30.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.146+0000 7f5e2710f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e201ea220 con 0x7f5e20154a00 2023-10-14T10:33:30.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.146+0000 7f5e2710f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200ab740 con 0x7f5e200c4210 2023-10-14T10:33:30.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.146+0000 7f5e24eab640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e200c4210 0x7f5e200c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.147+0000 7f5e24eab640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e200c4210 0x7f5e200c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:42710/0 (socket says 172.21.15.92:42710) 2023-10-14T10:33:30.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.147+0000 7f5e24eab640 1 -- 172.21.15.92:0/2081687963 learned_addr learned my addr 172.21.15.92:0/2081687963 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:30.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.147+0000 7f5e256ac640 1 --2- 172.21.15.92:0/2081687963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20154a00 0x7f5e20152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.147+0000 7f5e1ffff640 1 --2- 172.21.15.92:0/2081687963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e20151590 0x7f5e200aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.147+0000 7f5e24eab640 1 -- 172.21.15.92:0/2081687963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20154a00 msgr2=0x7f5e20152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.147+0000 7f5e24eab640 1 --2- 172.21.15.92:0/2081687963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20154a00 0x7f5e20152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.147+0000 7f5e24eab640 1 -- 172.21.15.92:0/2081687963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e20151590 msgr2=0x7f5e200aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.147+0000 7f5e24eab640 1 --2- 172.21.15.92:0/2081687963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e20151590 0x7f5e200aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.147+0000 7f5e24eab640 1 -- 172.21.15.92:0/2081687963 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e140094d0 con 0x7f5e200c4210 2023-10-14T10:33:30.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.147+0000 7f5e24eab640 1 --2- 172.21.15.92:0/2081687963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e200c4210 0x7f5e200c9240 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5e14000c00 tx=0x7f5e140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:30.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.148+0000 7f5e1d7fa640 1 -- 172.21.15.92:0/2081687963 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14033c80 con 0x7f5e200c4210 2023-10-14T10:33:30.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.148+0000 7f5e1d7fa640 1 -- 172.21.15.92:0/2081687963 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e14033de0 con 0x7f5e200c4210 2023-10-14T10:33:30.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.148+0000 7f5e1d7fa640 1 -- 172.21.15.92:0/2081687963 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1403c640 con 0x7f5e200c4210 2023-10-14T10:33:30.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.148+0000 7f5e2710f640 1 -- 172.21.15.92:0/2081687963 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e201487d0 con 0x7f5e200c4210 2023-10-14T10:33:30.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.148+0000 7f5e2710f640 1 -- 172.21.15.92:0/2081687963 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e201ea640 con 0x7f5e200c4210 2023-10-14T10:33:30.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.148+0000 7f5e1d7fa640 1 -- 172.21.15.92:0/2081687963 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5e1403a040 con 0x7f5e200c4210 2023-10-14T10:33:30.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.148+0000 7f5e1d7fa640 1 -- 172.21.15.92:0/2081687963 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f5e14048ca0 con 0x7f5e200c4210 2023-10-14T10:33:30.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.149+0000 7f5e2710f640 1 -- 172.21.15.92:0/2081687963 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2004e9b0 con 0x7f5e200c4210 2023-10-14T10:33:30.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.151+0000 7f5e1d7fa640 1 -- 172.21.15.92:0/2081687963 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5e1404d060 con 0x7f5e200c4210 2023-10-14T10:33:30.200 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:30.198+0000 7fd524012040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T10:33:30.203 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:30.202+0000 7f0bb0034040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T10:33:30.230 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.229+0000 7f5e2710f640 1 -- 172.21.15.92:0/2081687963 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b960328f-c14f-4f72-9c67-851a03aa12c9", "id": 5} v 0) v1 -- 0x7f5e2006cb50 con 0x7f5e200c4210 2023-10-14T10:33:30.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.235+0000 7f5e1d7fa640 1 -- 172.21.15.92:0/2081687963 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b960328f-c14f-4f72-9c67-851a03aa12c9", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5e140560b0 con 0x7f5e200c4210 2023-10-14T10:33:30.237 INFO:teuthology.orchestra.run.smithi092.stdout:5 2023-10-14T10:33:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.237+0000 7f5e2710f640 1 -- 172.21.15.92:0/2081687963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e200c4210 msgr2=0x7f5e200c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.237+0000 7f5e2710f640 1 --2- 172.21.15.92:0/2081687963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e200c4210 0x7f5e200c9240 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5e14000c00 tx=0x7f5e140046c0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.237+0000 7f5e2710f640 1 -- 172.21.15.92:0/2081687963 shutdown_connections 2023-10-14T10:33:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.237+0000 7f5e2710f640 1 --2- 172.21.15.92:0/2081687963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20154a00 0x7f5e20152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.237+0000 7f5e2710f640 1 --2- 172.21.15.92:0/2081687963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e20151590 0x7f5e200aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.237+0000 7f5e2710f640 1 --2- 172.21.15.92:0/2081687963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e200c4210 0x7f5e200c9240 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.237+0000 7f5e2710f640 1 -- 172.21.15.92:0/2081687963 >> 172.21.15.92:0/2081687963 conn(0x7f5e20065ed0 msgr2=0x7f5e200662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.237+0000 7f5e2710f640 1 -- 172.21.15.92:0/2081687963 shutdown_connections 2023-10-14T10:33:30.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.237+0000 7f5e2710f640 1 -- 172.21.15.92:0/2081687963 wait complete. 2023-10-14T10:33:30.255 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 3c3cff14-004c-4aa1-b9ce-240f0d1f78ff 6 2023-10-14T10:33:30.263 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:30.262+0000 7fd524012040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T10:33:30.320 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:30.319+0000 7fd524012040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T10:33:30.345 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:30.343+0000 7f0bb0034040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T10:33:30.401 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:30.398+0000 7f0bb0034040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T10:33:30.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.448+0000 7fa586ca3640 1 Processor -- start 2023-10-14T10:33:30.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.448+0000 7fa586ca3640 1 -- start start 2023-10-14T10:33:30.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.450+0000 7fa586ca3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa580151420 0x7fa5800c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.450+0000 7fa586ca3640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5800c4e30 con 0x7fa5800c43a0 2023-10-14T10:33:30.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.450+0000 7fa586ca3640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5800c5d00 con 0x7fa5800c5610 2023-10-14T10:33:30.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.450+0000 7fa586ca3640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5800c5450 con 0x7fa580151420 2023-10-14T10:33:30.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.450+0000 7fa585ca1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa580151420 0x7fa5800c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.450+0000 7fa585ca1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa580151420 0x7fa5800c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56324/0 (socket says 172.21.15.92:56324) 2023-10-14T10:33:30.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.450+0000 7fa585ca1640 1 -- 172.21.15.92:0/362337031 learned_addr learned my addr 172.21.15.92:0/362337031 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:30.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.451+0000 7fa585ca1640 1 -- 172.21.15.92:0/362337031 >> v1:172.21.15.92:6789/0 conn(0x7fa5800c5610 legacy=0x7fa58006ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.451+0000 7fa585ca1640 1 -- 172.21.15.92:0/362337031 >> v1:172.21.15.8:6789/0 conn(0x7fa5800c43a0 legacy=0x7fa5800c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:30.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.451+0000 7fa585ca1640 1 -- 172.21.15.92:0/362337031 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5800c5170 con 0x7fa580151420 2023-10-14T10:33:30.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.452+0000 7fa585ca1640 1 --2- 172.21.15.92:0/362337031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580151420 0x7fa5800c48f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009870 tx=0x7fa57c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee4af0c83ae3b860 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:30.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.452+0000 7fa584c9f640 1 -- 172.21.15.92:0/362337031 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c031870 con 0x7fa580151420 2023-10-14T10:33:30.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.452+0000 7fa584c9f640 1 -- 172.21.15.92:0/362337031 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c0319d0 con 0x7fa580151420 2023-10-14T10:33:30.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.452+0000 7fa584c9f640 1 -- 172.21.15.92:0/362337031 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c031d60 con 0x7fa580151420 2023-10-14T10:33:30.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.452+0000 7fa586ca3640 1 -- 172.21.15.92:0/362337031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580151420 msgr2=0x7fa5800c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.452+0000 7fa586ca3640 1 --2- 172.21.15.92:0/362337031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580151420 0x7fa5800c48f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009870 tx=0x7fa57c02b910 comp rx=0 tx=0).stop 2023-10-14T10:33:30.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.452+0000 7fa586ca3640 1 -- 172.21.15.92:0/362337031 shutdown_connections 2023-10-14T10:33:30.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.452+0000 7fa586ca3640 1 --2- 172.21.15.92:0/362337031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580151420 0x7fa5800c48f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.452+0000 7fa586ca3640 1 -- 172.21.15.92:0/362337031 >> 172.21.15.92:0/362337031 conn(0x7fa5800c96c0 msgr2=0x7fa5800c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:30.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.452+0000 7fa586ca3640 1 -- 172.21.15.92:0/362337031 shutdown_connections 2023-10-14T10:33:30.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.453+0000 7fa586ca3640 1 -- 172.21.15.92:0/362337031 wait complete. 2023-10-14T10:33:30.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.454+0000 7fa586ca3640 1 Processor -- start 2023-10-14T10:33:30.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.454+0000 7fa586ca3640 1 -- start start 2023-10-14T10:33:30.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.455+0000 7fa586ca3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5800c43a0 0x7fa5800c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.455+0000 7fa586ca3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5800c5610 0x7fa580152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.455+0000 7fa586ca3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa580151420 0x7fa580153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.455+0000 7fa586ca3640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa580144c20 con 0x7fa5800c43a0 2023-10-14T10:33:30.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.455+0000 7fa586ca3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800c2b60 con 0x7fa5800c5610 2023-10-14T10:33:30.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.455+0000 7fa586ca3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800c12b0 con 0x7fa580151420 2023-10-14T10:33:30.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.455+0000 7fa5854a0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5800c5610 0x7fa580152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.455+0000 7fa5864a2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa580151420 0x7fa580153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.455+0000 7fa5854a0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5800c5610 0x7fa580152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56334/0 (socket says 172.21.15.92:56334) 2023-10-14T10:33:30.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.455+0000 7fa5864a2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa580151420 0x7fa580153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:42724/0 (socket says 172.21.15.92:42724) 2023-10-14T10:33:30.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.455+0000 7fa5854a0640 1 -- 172.21.15.92:0/2045398813 learned_addr learned my addr 172.21.15.92:0/2045398813 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:30.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.455+0000 7fa585ca1640 1 --2- 172.21.15.92:0/2045398813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5800c43a0 0x7fa5800c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.456+0000 7fa5854a0640 1 -- 172.21.15.92:0/2045398813 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa580151420 msgr2=0x7fa580153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.456+0000 7fa5854a0640 1 --2- 172.21.15.92:0/2045398813 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa580151420 0x7fa580153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.456+0000 7fa5854a0640 1 -- 172.21.15.92:0/2045398813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5800c43a0 msgr2=0x7fa5800c0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.456+0000 7fa5854a0640 1 --2- 172.21.15.92:0/2045398813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5800c43a0 0x7fa5800c0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.456+0000 7fa5854a0640 1 -- 172.21.15.92:0/2045398813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c0094d0 con 0x7fa5800c5610 2023-10-14T10:33:30.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.456+0000 7fa5864a2640 1 --2- 172.21.15.92:0/2045398813 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa580151420 0x7fa580153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:33:30.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.456+0000 7fa5854a0640 1 --2- 172.21.15.92:0/2045398813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5800c5610 0x7fa580152bd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa57000c430 tx=0x7fa57000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:30.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.456+0000 7fa5767fc640 1 -- 172.21.15.92:0/2045398813 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa570011790 con 0x7fa5800c5610 2023-10-14T10:33:30.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.456+0000 7fa5767fc640 1 -- 172.21.15.92:0/2045398813 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5700118f0 con 0x7fa5800c5610 2023-10-14T10:33:30.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.456+0000 7fa586ca3640 1 -- 172.21.15.92:0/2045398813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5800c2f60 con 0x7fa5800c5610 2023-10-14T10:33:30.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.456+0000 7fa5767fc640 1 -- 172.21.15.92:0/2045398813 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa570011ce0 con 0x7fa5800c5610 2023-10-14T10:33:30.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.456+0000 7fa586ca3640 1 -- 172.21.15.92:0/2045398813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5800c1550 con 0x7fa5800c5610 2023-10-14T10:33:30.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.457+0000 7fa5767fc640 1 -- 172.21.15.92:0/2045398813 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa57001c760 con 0x7fa5800c5610 2023-10-14T10:33:30.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.457+0000 7fa5767fc640 1 -- 172.21.15.92:0/2045398813 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa570011e40 con 0x7fa5800c5610 2023-10-14T10:33:30.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.457+0000 7fa586ca3640 1 -- 172.21.15.92:0/2045398813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5800619f0 con 0x7fa5800c5610 2023-10-14T10:33:30.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.460+0000 7fa5767fc640 1 -- 172.21.15.92:0/2045398813 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa570012830 con 0x7fa5800c5610 2023-10-14T10:33:30.515 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:30.513+0000 7f0bb0034040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T10:33:30.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.539+0000 7fa586ca3640 1 -- 172.21.15.92:0/2045398813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3c3cff14-004c-4aa1-b9ce-240f0d1f78ff", "id": 6} v 0) v1 -- 0x7fa58006c520 con 0x7fa5800c5610 2023-10-14T10:33:30.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.548+0000 7fa5767fc640 1 -- 172.21.15.92:0/2045398813 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c3cff14-004c-4aa1-b9ce-240f0d1f78ff", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa57001ca10 con 0x7fa5800c5610 2023-10-14T10:33:30.550 INFO:teuthology.orchestra.run.smithi092.stdout:6 2023-10-14T10:33:30.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.549+0000 7fa586ca3640 1 -- 172.21.15.92:0/2045398813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5800c5610 msgr2=0x7fa580152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.549+0000 7fa586ca3640 1 --2- 172.21.15.92:0/2045398813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5800c5610 0x7fa580152bd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa57000c430 tx=0x7fa57000c8f0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.549+0000 7fa586ca3640 1 -- 172.21.15.92:0/2045398813 shutdown_connections 2023-10-14T10:33:30.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.549+0000 7fa586ca3640 1 --2- 172.21.15.92:0/2045398813 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa580151420 0x7fa580153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.549+0000 7fa586ca3640 1 --2- 172.21.15.92:0/2045398813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5800c5610 0x7fa580152bd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.549+0000 7fa586ca3640 1 --2- 172.21.15.92:0/2045398813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5800c43a0 0x7fa5800c0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.549+0000 7fa586ca3640 1 -- 172.21.15.92:0/2045398813 >> 172.21.15.92:0/2045398813 conn(0x7fa5800c96c0 msgr2=0x7fa58014f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:30.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.550+0000 7fa586ca3640 1 -- 172.21.15.92:0/2045398813 shutdown_connections 2023-10-14T10:33:30.553 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.550+0000 7fa586ca3640 1 -- 172.21.15.92:0/2045398813 wait complete. 2023-10-14T10:33:30.566 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new e7fd4171-2934-4a23-a5bb-2eea9f135d23 7 2023-10-14T10:33:30.632 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:30.629+0000 7f0bb0034040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T10:33:30.792 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:30.791+0000 7fd524012040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T10:33:30.797 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:30.795+0000 7f0bb0034040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T10:33:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.807+0000 7fefb8813640 1 Processor -- start 2023-10-14T10:33:30.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.807+0000 7fefb8813640 1 -- start start 2023-10-14T10:33:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.809+0000 7fefb8813640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fefb4151420 0x7fefb40c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.809+0000 7fefb8813640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb40c4e30 con 0x7fefb40c5610 2023-10-14T10:33:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.809+0000 7fefb8813640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb40c5d00 con 0x7fefb40c43a0 2023-10-14T10:33:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.809+0000 7fefb8813640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb40c5450 con 0x7fefb4151420 2023-10-14T10:33:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.809+0000 7fefabfff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fefb40c43a0 0x7fefb40c75c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43260/0 (socket says 172.21.15.92:43260) 2023-10-14T10:33:30.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.809+0000 7fefabfff640 1 -- 172.21.15.92:0/3739471892 learned_addr learned my addr 172.21.15.92:0/3739471892 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-10-14T10:33:30.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.809+0000 7fefb37fe640 1 --2- 172.21.15.92:0/3739471892 >> v2:172.21.15.8:3300/0 conn(0x7fefb4151420 0x7fefb40c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.809+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902859896 0 0) 0x7fefb40c5d00 con 0x7fefb40c43a0 2023-10-14T10:33:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.809+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefa0003520 con 0x7fefb40c43a0 2023-10-14T10:33:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 <== mon.1 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3195991026 0 0) 0x7fefa0003520 con 0x7fefb40c43a0 2023-10-14T10:33:30.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 >> v2:172.21.15.8:3300/0 conn(0x7fefb4151420 msgr2=0x7fefb40c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:30.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 --2- 172.21.15.92:0/3739471892 >> v2:172.21.15.8:3300/0 conn(0x7fefb4151420 0x7fefb40c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 >> v1:172.21.15.8:6789/0 conn(0x7fefb40c5610 legacy=0x7fefb406ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40c5170 con 0x7fefb40c43a0 2023-10-14T10:33:30.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 <== mon.1 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fef9c001670 con 0x7fefb40c43a0 2023-10-14T10:33:30.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 >> v1:172.21.15.92:6789/0 conn(0x7fefb40c43a0 legacy=0x7fefb40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 --2- 172.21.15.92:0/3739471892 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 0x7fefa0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 --2- 172.21.15.92:0/3739471892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa00047c0 0x7fefa0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 --2- 172.21.15.92:0/3739471892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefa00051d0 0x7fefa000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40c5450 con 0x7fefa00051d0 2023-10-14T10:33:30.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa000c120 con 0x7fefa00047c0 2023-10-14T10:33:30.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa000c2e0 con 0x7fefa00039c0 2023-10-14T10:33:30.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefabfff640 1 --2- 172.21.15.92:0/3739471892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa00047c0 0x7fefa0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.810+0000 7fefb37fe640 1 --2- 172.21.15.92:0/3739471892 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 0x7fefa0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.811+0000 7fefb37fe640 1 -- 172.21.15.92:0/3739471892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa00047c0 msgr2=0x7fefa0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:30.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.811+0000 7fefb37fe640 1 --2- 172.21.15.92:0/3739471892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefa00047c0 0x7fefa0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.811+0000 7fefb3fff640 1 --2- 172.21.15.92:0/3739471892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefa00051d0 0x7fefa000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.811+0000 7fefb37fe640 1 -- 172.21.15.92:0/3739471892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefa00051d0 msgr2=0x7fefa000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:30.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.811+0000 7fefb37fe640 1 --2- 172.21.15.92:0/3739471892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefa00051d0 0x7fefa000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.811+0000 7fefb37fe640 1 -- 172.21.15.92:0/3739471892 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa0003520 con 0x7fefa00039c0 2023-10-14T10:33:30.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.811+0000 7fefb3fff640 1 --2- 172.21.15.92:0/3739471892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefa00051d0 0x7fefa000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:30.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.811+0000 7fefb3fff640 1 -- 172.21.15.92:0/3739471892 reap_dead start 2023-10-14T10:33:30.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.812+0000 7fefb37fe640 1 --2- 172.21.15.92:0/3739471892 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 0x7fefa0003de0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009a90 tx=0x7fefa00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=882456f1f3014f25 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:30.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.812+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa402c680 con 0x7fefa00039c0 2023-10-14T10:33:30.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.812+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa402c7e0 con 0x7fefa00039c0 2023-10-14T10:33:30.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.812+0000 7fefb2ffd640 1 -- 172.21.15.92:0/3739471892 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa402cb70 con 0x7fefa00039c0 2023-10-14T10:33:30.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.813+0000 7fefb8813640 1 -- 172.21.15.92:0/3739471892 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 msgr2=0x7fefa0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.813+0000 7fefb8813640 1 --2- 172.21.15.92:0/3739471892 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 0x7fefa0003de0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009a90 tx=0x7fefa00057f0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.813+0000 7fefb8813640 1 -- 172.21.15.92:0/3739471892 shutdown_connections 2023-10-14T10:33:30.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.813+0000 7fefb8813640 1 --2- 172.21.15.92:0/3739471892 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 0x7fefa0003de0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.813+0000 7fefb8813640 1 -- 172.21.15.92:0/3739471892 >> 172.21.15.92:0/3739471892 conn(0x7fefb40c96c0 msgr2=0x7fefb40c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:30.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.813+0000 7fefb8813640 1 -- 172.21.15.92:0/3739471892 shutdown_connections 2023-10-14T10:33:30.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.813+0000 7fefb8813640 1 -- 172.21.15.92:0/3739471892 wait complete. 2023-10-14T10:33:30.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.815+0000 7fefb8813640 1 Processor -- start 2023-10-14T10:33:30.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.815+0000 7fefb8813640 1 -- start start 2023-10-14T10:33:30.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.815+0000 7fefb8813640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 0x7fefb40ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.815+0000 7fefb8813640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb41ecaa0 0x7fefb40c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb8813640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefb414dab0 0x7fefb40aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:30.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb8813640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40acd00 con 0x7fefb414dab0 2023-10-14T10:33:30.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb8813640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40acfe0 con 0x7fefb41ecaa0 2023-10-14T10:33:30.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb8813640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40ad2c0 con 0x7fefa00039c0 2023-10-14T10:33:30.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb37fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 0x7fefb40ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb37fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 0x7fefb40ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:42744/0 (socket says 172.21.15.92:42744) 2023-10-14T10:33:30.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb37fe640 1 -- 172.21.15.92:0/462688213 learned_addr learned my addr 172.21.15.92:0/462688213 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-10-14T10:33:30.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefabfff640 1 --2- 172.21.15.92:0/462688213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb41ecaa0 0x7fefb40c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb37fe640 1 -- 172.21.15.92:0/462688213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb41ecaa0 msgr2=0x7fefb40c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb3fff640 1 --2- 172.21.15.92:0/462688213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefb414dab0 0x7fefb40aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:30.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb37fe640 1 --2- 172.21.15.92:0/462688213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb41ecaa0 0x7fefb40c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb37fe640 1 -- 172.21.15.92:0/462688213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefb414dab0 msgr2=0x7fefb40aa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb37fe640 1 --2- 172.21.15.92:0/462688213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefb414dab0 0x7fefb40aa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb37fe640 1 -- 172.21.15.92:0/462688213 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40c8730 con 0x7fefa00039c0 2023-10-14T10:33:30.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.816+0000 7fefb37fe640 1 --2- 172.21.15.92:0/462688213 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 0x7fefb40ad7d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fefa402c220 tx=0x7fefa4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:30.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.817+0000 7fefb0ff9640 1 -- 172.21.15.92:0/462688213 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4003810 con 0x7fefa00039c0 2023-10-14T10:33:30.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.817+0000 7fefb0ff9640 1 -- 172.21.15.92:0/462688213 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa4003970 con 0x7fefa00039c0 2023-10-14T10:33:30.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.817+0000 7fefb8813640 1 -- 172.21.15.92:0/462688213 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb40c8b60 con 0x7fefa00039c0 2023-10-14T10:33:30.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.817+0000 7fefb0ff9640 1 -- 172.21.15.92:0/462688213 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4003d00 con 0x7fefa00039c0 2023-10-14T10:33:30.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.817+0000 7fefb8813640 1 -- 172.21.15.92:0/462688213 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb414df30 con 0x7fefa00039c0 2023-10-14T10:33:30.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.817+0000 7fefb0ff9640 1 -- 172.21.15.92:0/462688213 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fefa4047750 con 0x7fefa00039c0 2023-10-14T10:33:30.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.817+0000 7fefb0ff9640 1 -- 172.21.15.92:0/462688213 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fefa4034aa0 con 0x7fefa00039c0 2023-10-14T10:33:30.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.818+0000 7fefb8813640 1 -- 172.21.15.92:0/462688213 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb41ece80 con 0x7fefa00039c0 2023-10-14T10:33:30.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.820+0000 7fefb0ff9640 1 -- 172.21.15.92:0/462688213 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fefa4066b40 con 0x7fefa00039c0 2023-10-14T10:33:30.849 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:30.847+0000 7f0bb0034040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T10:33:30.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.898+0000 7fefb8813640 1 -- 172.21.15.92:0/462688213 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e7fd4171-2934-4a23-a5bb-2eea9f135d23", "id": 7} v 0) v1 -- 0x7fefb414d700 con 0x7fefa00039c0 2023-10-14T10:33:30.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.906+0000 7fefb0ff9640 1 -- 172.21.15.92:0/462688213 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e7fd4171-2934-4a23-a5bb-2eea9f135d23", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fefa4055030 con 0x7fefa00039c0 2023-10-14T10:33:30.907 INFO:teuthology.orchestra.run.smithi092.stdout:7 2023-10-14T10:33:30.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.907+0000 7fefb8813640 1 -- 172.21.15.92:0/462688213 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 msgr2=0x7fefb40ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:30.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.907+0000 7fefb8813640 1 --2- 172.21.15.92:0/462688213 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 0x7fefb40ad7d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fefa402c220 tx=0x7fefa4004730 comp rx=0 tx=0).stop 2023-10-14T10:33:30.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.908+0000 7fefb8813640 1 -- 172.21.15.92:0/462688213 shutdown_connections 2023-10-14T10:33:30.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.908+0000 7fefb8813640 1 --2- 172.21.15.92:0/462688213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fefb414dab0 0x7fefb40aa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.908+0000 7fefb8813640 1 --2- 172.21.15.92:0/462688213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb41ecaa0 0x7fefb40c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.908+0000 7fefb8813640 1 --2- 172.21.15.92:0/462688213 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fefa00039c0 0x7fefb40ad7d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:30.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.908+0000 7fefb8813640 1 -- 172.21.15.92:0/462688213 >> 172.21.15.92:0/462688213 conn(0x7fefb40c96c0 msgr2=0x7fefb40c9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:30.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.908+0000 7fefb8813640 1 -- 172.21.15.92:0/462688213 shutdown_connections 2023-10-14T10:33:30.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-10-14T10:33:30.908+0000 7fefb8813640 1 -- 172.21.15.92:0/462688213 wait complete. 2023-10-14T10:33:30.927 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-14T10:33:30.927 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-14T10:33:30.934 INFO:tasks.ceph.osd.0:Started 2023-10-14T10:33:30.935 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-14T10:33:30.935 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-14T10:33:30.942 INFO:tasks.ceph.osd.1:Started 2023-10-14T10:33:30.942 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-14T10:33:30.943 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-14T10:33:30.949 INFO:tasks.ceph.osd.2:Started 2023-10-14T10:33:30.949 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-14T10:33:30.950 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-14T10:33:30.956 INFO:tasks.ceph.osd.3:Started 2023-10-14T10:33:30.957 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-14T10:33:30.957 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-14T10:33:30.959 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:30.957+0000 7fd524012040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T10:33:30.964 INFO:tasks.ceph.osd.4:Started 2023-10-14T10:33:30.964 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-14T10:33:30.965 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-14T10:33:30.971 INFO:tasks.ceph.osd.5:Started 2023-10-14T10:33:30.972 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-14T10:33:30.972 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-14T10:33:30.980 INFO:tasks.ceph.osd.6:Started 2023-10-14T10:33:30.981 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-14T10:33:30.981 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-14T10:33:30.986 INFO:tasks.ceph.osd.7:Started 2023-10-14T10:33:30.987 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:33:31.049 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:31.047+0000 7f0bb0034040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T10:33:31.137 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:31.136+0000 7fd524012040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T10:33:31.197 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:31.195+0000 7fd524012040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T10:33:31.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.218+0000 7fee86e56640 1 Processor -- start 2023-10-14T10:33:31.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.218+0000 7fee86e56640 1 -- start start 2023-10-14T10:33:31.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee86e56640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fee8013b260 0x7fee800c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:31.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee86e56640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fee80071ff0 0x7fee80152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:31.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee86e56640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee800c1810 0x7fee8006d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:31.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee86e56640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee80152540 con 0x7fee80071ff0 2023-10-14T10:33:31.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee86e56640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee80152ea0 con 0x7fee8013b260 2023-10-14T10:33:31.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee86e56640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee80151ea0 con 0x7fee800c1810 2023-10-14T10:33:31.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee7ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fee80071ff0 0x7fee80152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:31.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee7ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fee80071ff0 0x7fee80152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53790/0 (socket says 172.21.15.8:53790) 2023-10-14T10:33:31.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee7ffff640 1 -- 172.21.15.8:0/1074467882 learned_addr learned my addr 172.21.15.8:0/1074467882 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:31.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee84bf2640 1 --2- 172.21.15.8:0/1074467882 >> v2:172.21.15.92:3300/0 conn(0x7fee8013b260 0x7fee800c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:31.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee853f3640 1 --2- 172.21.15.8:0/1074467882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee800c1810 0x7fee8006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:31.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee7ffff640 1 -- 172.21.15.8:0/1074467882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee800c1810 msgr2=0x7fee8006d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:31.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee7ffff640 1 --2- 172.21.15.8:0/1074467882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee800c1810 0x7fee8006d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:31.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee7ffff640 1 -- 172.21.15.8:0/1074467882 >> v2:172.21.15.92:3300/0 conn(0x7fee8013b260 msgr2=0x7fee800c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:31.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee7ffff640 1 --2- 172.21.15.8:0/1074467882 >> v2:172.21.15.92:3300/0 conn(0x7fee8013b260 0x7fee800c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:31.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.220+0000 7fee7ffff640 1 -- 172.21.15.8:0/1074467882 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee800c5d80 con 0x7fee80071ff0 2023-10-14T10:33:31.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.221+0000 7fee7ffff640 1 --2- 172.21.15.8:0/1074467882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee80071ff0 0x7fee80152960 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fee800c3050 tx=0x7fee6c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7f6a2910285bcb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:31.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.222+0000 7fee7f7fe640 1 -- 172.21.15.8:0/1074467882 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0317e0 con 0x7fee80071ff0 2023-10-14T10:33:31.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.222+0000 7fee7f7fe640 1 -- 172.21.15.8:0/1074467882 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c031940 con 0x7fee80071ff0 2023-10-14T10:33:31.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.222+0000 7fee7f7fe640 1 -- 172.21.15.8:0/1074467882 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c031cd0 con 0x7fee80071ff0 2023-10-14T10:33:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.222+0000 7fee86e56640 1 -- 172.21.15.8:0/1074467882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee80071ff0 msgr2=0x7fee80152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.222+0000 7fee86e56640 1 --2- 172.21.15.8:0/1074467882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee80071ff0 0x7fee80152960 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fee800c3050 tx=0x7fee6c02b880 comp rx=0 tx=0).stop 2023-10-14T10:33:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.222+0000 7fee86e56640 1 -- 172.21.15.8:0/1074467882 shutdown_connections 2023-10-14T10:33:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.223+0000 7fee86e56640 1 --2- 172.21.15.8:0/1074467882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee800c1810 0x7fee8006d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:31.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.223+0000 7fee86e56640 1 --2- 172.21.15.8:0/1074467882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee80071ff0 0x7fee80152960 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:31.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.223+0000 7fee86e56640 1 --2- 172.21.15.8:0/1074467882 >> v2:172.21.15.92:3300/0 conn(0x7fee8013b260 0x7fee800c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:31.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.223+0000 7fee86e56640 1 -- 172.21.15.8:0/1074467882 >> 172.21.15.8:0/1074467882 conn(0x7fee800a74d0 msgr2=0x7fee800a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:31.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.223+0000 7fee86e56640 1 -- 172.21.15.8:0/1074467882 shutdown_connections 2023-10-14T10:33:31.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.223+0000 7fee86e56640 1 -- 172.21.15.8:0/1074467882 wait complete. 2023-10-14T10:33:31.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.224+0000 7fee86e56640 1 Processor -- start 2023-10-14T10:33:31.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.224+0000 7fee86e56640 1 -- start start 2023-10-14T10:33:31.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.225+0000 7fee86e56640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee80071ff0 0x7fee801e8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:31.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.225+0000 7fee86e56640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee800c1810 0x7fee800bf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:31.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.225+0000 7fee86e56640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee8013b260 0x7fee801ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:31.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.225+0000 7fee86e56640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8013bc80 con 0x7fee800c1810 2023-10-14T10:33:31.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.225+0000 7fee86e56640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee801e93d0 con 0x7fee80071ff0 2023-10-14T10:33:31.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.225+0000 7fee86e56640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8013c440 con 0x7fee8013b260 2023-10-14T10:33:31.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.225+0000 7fee7ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee800c1810 0x7fee800bf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:31.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.226+0000 7fee7ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee800c1810 0x7fee800bf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53804/0 (socket says 172.21.15.8:53804) 2023-10-14T10:33:31.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.226+0000 7fee7ffff640 1 -- 172.21.15.8:0/3507255292 learned_addr learned my addr 172.21.15.8:0/3507255292 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:31.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.226+0000 7fee84bf2640 1 --2- 172.21.15.8:0/3507255292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee80071ff0 0x7fee801e8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:31.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.226+0000 7fee853f3640 1 --2- 172.21.15.8:0/3507255292 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee8013b260 0x7fee801ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:31.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.226+0000 7fee7ffff640 1 -- 172.21.15.8:0/3507255292 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee8013b260 msgr2=0x7fee801ecc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:31.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.226+0000 7fee7ffff640 1 --2- 172.21.15.8:0/3507255292 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee8013b260 0x7fee801ecc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:31.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.226+0000 7fee7ffff640 1 -- 172.21.15.8:0/3507255292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee80071ff0 msgr2=0x7fee801e8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:31.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.226+0000 7fee7ffff640 1 --2- 172.21.15.8:0/3507255292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee80071ff0 0x7fee801e8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:31.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.226+0000 7fee7ffff640 1 -- 172.21.15.8:0/3507255292 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c0094d0 con 0x7fee800c1810 2023-10-14T10:33:31.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.226+0000 7fee7ffff640 1 --2- 172.21.15.8:0/3507255292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee800c1810 0x7fee800bf280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fee6c000c00 tx=0x7fee6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:31.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.226+0000 7fee7d7fa640 1 -- 172.21.15.8:0/3507255292 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c032880 con 0x7fee800c1810 2023-10-14T10:33:31.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.227+0000 7fee7d7fa640 1 -- 172.21.15.8:0/3507255292 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c0329e0 con 0x7fee800c1810 2023-10-14T10:33:31.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.227+0000 7fee7d7fa640 1 -- 172.21.15.8:0/3507255292 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c032d90 con 0x7fee800c1810 2023-10-14T10:33:31.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.227+0000 7fee86e56640 1 -- 172.21.15.8:0/3507255292 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee801ec4a0 con 0x7fee800c1810 2023-10-14T10:33:31.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.227+0000 7fee86e56640 1 -- 172.21.15.8:0/3507255292 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee801ec740 con 0x7fee800c1810 2023-10-14T10:33:31.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.227+0000 7fee7d7fa640 1 -- 172.21.15.8:0/3507255292 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fee6c04e750 con 0x7fee800c1810 2023-10-14T10:33:31.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.227+0000 7fee7d7fa640 1 -- 172.21.15.8:0/3507255292 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fee6c045c80 con 0x7fee800c1810 2023-10-14T10:33:31.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.228+0000 7fee86e56640 1 -- 172.21.15.8:0/3507255292 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee801ec930 con 0x7fee800c1810 2023-10-14T10:33:31.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.230+0000 7fee7d7fa640 1 -- 172.21.15.8:0/3507255292 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fee6c02e070 con 0x7fee800c1810 2023-10-14T10:33:31.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.294+0000 7fee86e56640 1 -- 172.21.15.8:0/3507255292 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee80073b50 con 0x7fee800c1810 2023-10-14T10:33:31.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.295+0000 7fee7d7fa640 1 -- 172.21.15.8:0/3507255292 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fee6c04eb40 con 0x7fee800c1810 2023-10-14T10:33:31.298 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:31.298 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":10,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:30.899760+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:33:31.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.297+0000 7fee86e56640 1 -- 172.21.15.8:0/3507255292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee800c1810 msgr2=0x7fee800bf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:31.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.297+0000 7fee86e56640 1 --2- 172.21.15.8:0/3507255292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee800c1810 0x7fee800bf280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fee6c000c00 tx=0x7fee6c0046c0 comp rx=0 tx=0).stop 2023-10-14T10:33:31.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.297+0000 7fee86e56640 1 -- 172.21.15.8:0/3507255292 shutdown_connections 2023-10-14T10:33:31.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.297+0000 7fee86e56640 1 --2- 172.21.15.8:0/3507255292 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee8013b260 0x7fee801ecc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:31.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.297+0000 7fee86e56640 1 --2- 172.21.15.8:0/3507255292 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fee800c1810 0x7fee800bf280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:31.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.297+0000 7fee86e56640 1 --2- 172.21.15.8:0/3507255292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee80071ff0 0x7fee801e8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:31.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.297+0000 7fee86e56640 1 -- 172.21.15.8:0/3507255292 >> 172.21.15.8:0/3507255292 conn(0x7fee800a74d0 msgr2=0x7fee80137480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:31.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.297+0000 7fee86e56640 1 -- 172.21.15.8:0/3507255292 shutdown_connections 2023-10-14T10:33:31.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:31.297+0000 7fee86e56640 1 -- 172.21.15.8:0/3507255292 wait complete. 2023-10-14T10:33:31.315 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-14T10:33:31.315 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-14T10:33:31.316 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:31.314+0000 7fd524012040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T10:33:31.436 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:31.434+0000 7fd524012040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T10:33:31.598 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:31.596+0000 7fd524012040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T10:33:31.647 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:31.646+0000 7fd524012040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T10:33:31.657 INFO:tasks.ceph.osd.4.smithi092.stderr:2023-10-14T10:33:31.656+0000 7f43cf1fa500 -1 Falling back to public interface 2023-10-14T10:33:31.662 INFO:tasks.ceph.osd.5.smithi092.stderr:2023-10-14T10:33:31.661+0000 7f4684410500 -1 Falling back to public interface 2023-10-14T10:33:31.663 INFO:tasks.ceph.osd.6.smithi092.stderr:2023-10-14T10:33:31.662+0000 7ff3efe12500 -1 Falling back to public interface 2023-10-14T10:33:31.680 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-10-14T10:33:31.678+0000 7fd2006b4500 -1 Falling back to public interface 2023-10-14T10:33:31.688 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-10-14T10:33:31.686+0000 7f43106a5500 -1 Falling back to public interface 2023-10-14T10:33:31.689 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-10-14T10:33:31.686+0000 7f5ac54b4500 -1 Falling back to public interface 2023-10-14T10:33:31.691 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-10-14T10:33:31.690+0000 7f65726b6500 -1 Falling back to public interface 2023-10-14T10:33:31.703 INFO:tasks.ceph.osd.7.smithi092.stderr:2023-10-14T10:33:31.702+0000 7f5911014500 -1 Falling back to public interface 2023-10-14T10:33:31.810 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:31.809+0000 7fd524012040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T10:33:32.102 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:32.100+0000 7f0bb0034040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T10:33:32.122 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T10:33:32.292 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.290+0000 7f2873490640 1 Processor -- start 2023-10-14T10:33:32.293 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.290+0000 7f2873490640 1 -- start start 2023-10-14T10:33:32.294 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.291+0000 7f2873490640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f286c1516a0 0x7f286c0c6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:32.294 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.291+0000 7f2873490640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f286c06c970 0x7f286c154110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:32.294 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.291+0000 7f2873490640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286c0c4320 con 0x7f286c0c78a0 2023-10-14T10:33:32.295 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.291+0000 7f2873490640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286c0c48e0 con 0x7f286c1516a0 2023-10-14T10:33:32.295 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.291+0000 7f2873490640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286c158220 con 0x7f286c06c970 2023-10-14T10:33:32.295 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.292+0000 7f287122c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f286c1516a0 0x7f286c0c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:32.295 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.292+0000 7f287122c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f286c1516a0 0x7f286c0c6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53820/0 (socket says 172.21.15.8:53820) 2023-10-14T10:33:32.295 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.292+0000 7f2871a2d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f286c0c78a0 0x7f286c154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36632/0 (socket says 172.21.15.8:36632) 2023-10-14T10:33:32.296 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.292+0000 7f287122c640 1 -- 172.21.15.8:0/2278445655 learned_addr learned my addr 172.21.15.8:0/2278445655 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:32.296 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.292+0000 7f2870a2b640 1 --2- 172.21.15.8:0/2278445655 >> v2:172.21.15.92:3300/0 conn(0x7f286c06c970 0x7f286c154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:32.296 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.292+0000 7f287122c640 1 -- 172.21.15.8:0/2278445655 >> v2:172.21.15.92:3300/0 conn(0x7f286c06c970 msgr2=0x7f286c154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:32.296 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.292+0000 7f287122c640 1 --2- 172.21.15.8:0/2278445655 >> v2:172.21.15.92:3300/0 conn(0x7f286c06c970 0x7f286c154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:32.296 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.292+0000 7f287122c640 1 -- 172.21.15.8:0/2278445655 >> v1:172.21.15.8:6789/0 conn(0x7f286c0c78a0 legacy=0x7f286c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:32.297 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.292+0000 7f287122c640 1 -- 172.21.15.8:0/2278445655 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c1584e0 con 0x7f286c1516a0 2023-10-14T10:33:32.298 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.293+0000 7f287122c640 1 --2- 172.21.15.8:0/2278445655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286c1516a0 0x7f286c0c6790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f286c06c720 tx=0x7f286802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73651a6417bc8b84 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:32.298 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.294+0000 7f2863fff640 1 -- 172.21.15.8:0/2278445655 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28680317e0 con 0x7f286c1516a0 2023-10-14T10:33:32.298 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.294+0000 7f2863fff640 1 -- 172.21.15.8:0/2278445655 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2868031940 con 0x7f286c1516a0 2023-10-14T10:33:32.298 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.294+0000 7f2863fff640 1 -- 172.21.15.8:0/2278445655 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868031cd0 con 0x7f286c1516a0 2023-10-14T10:33:32.299 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.294+0000 7f2873490640 1 -- 172.21.15.8:0/2278445655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286c1516a0 msgr2=0x7f286c0c6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:32.299 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.294+0000 7f2873490640 1 --2- 172.21.15.8:0/2278445655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286c1516a0 0x7f286c0c6790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f286c06c720 tx=0x7f286802b880 comp rx=0 tx=0).stop 2023-10-14T10:33:32.299 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.294+0000 7f2873490640 1 -- 172.21.15.8:0/2278445655 shutdown_connections 2023-10-14T10:33:32.299 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.294+0000 7f2873490640 1 --2- 172.21.15.8:0/2278445655 >> v2:172.21.15.92:3300/0 conn(0x7f286c06c970 0x7f286c154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:32.299 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.294+0000 7f2873490640 1 --2- 172.21.15.8:0/2278445655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286c1516a0 0x7f286c0c6790 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:32.300 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.294+0000 7f2873490640 1 -- 172.21.15.8:0/2278445655 >> 172.21.15.8:0/2278445655 conn(0x7f286c0716f0 msgr2=0x7f286c071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:32.300 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.294+0000 7f2873490640 1 -- 172.21.15.8:0/2278445655 shutdown_connections 2023-10-14T10:33:32.300 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.294+0000 7f2873490640 1 -- 172.21.15.8:0/2278445655 wait complete. 2023-10-14T10:33:32.300 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.296+0000 7f2873490640 1 Processor -- start 2023-10-14T10:33:32.301 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.296+0000 7f2873490640 1 -- start start 2023-10-14T10:33:32.303 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.297+0000 7f2873490640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f286c06c970 0x7f286c153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:32.303 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.297+0000 7f2873490640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286c0c78a0 0x7f286c147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:32.303 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.297+0000 7f2873490640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f286c1516a0 0x7f286c147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:32.303 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.297+0000 7f2873490640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0ab7a0 con 0x7f286c0c78a0 2023-10-14T10:33:32.303 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.297+0000 7f2873490640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0c0550 con 0x7f286c1516a0 2023-10-14T10:33:32.304 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.297+0000 7f2873490640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0c0270 con 0x7f286c06c970 2023-10-14T10:33:32.304 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.297+0000 7f2870a2b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286c0c78a0 0x7f286c147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:32.304 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.297+0000 7f2870a2b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286c0c78a0 0x7f286c147a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53834/0 (socket says 172.21.15.8:53834) 2023-10-14T10:33:32.304 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.297+0000 7f2870a2b640 1 -- 172.21.15.8:0/3686191310 learned_addr learned my addr 172.21.15.8:0/3686191310 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:32.304 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.297+0000 7f287122c640 1 --2- 172.21.15.8:0/3686191310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f286c06c970 0x7f286c153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:32.305 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.297+0000 7f2871a2d640 1 --2- 172.21.15.8:0/3686191310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f286c1516a0 0x7f286c147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:32.305 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.298+0000 7f2870a2b640 1 -- 172.21.15.8:0/3686191310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f286c06c970 msgr2=0x7f286c153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:32.305 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.298+0000 7f2870a2b640 1 --2- 172.21.15.8:0/3686191310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f286c06c970 0x7f286c153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:32.305 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.298+0000 7f2870a2b640 1 -- 172.21.15.8:0/3686191310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f286c1516a0 msgr2=0x7f286c147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:32.305 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.298+0000 7f2870a2b640 1 --2- 172.21.15.8:0/3686191310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f286c1516a0 0x7f286c147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:32.306 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.298+0000 7f2870a2b640 1 -- 172.21.15.8:0/3686191310 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28680094d0 con 0x7f286c0c78a0 2023-10-14T10:33:32.306 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.298+0000 7f2871a2d640 1 --2- 172.21.15.8:0/3686191310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f286c1516a0 0x7f286c147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:32.306 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.298+0000 7f2870a2b640 1 --2- 172.21.15.8:0/3686191310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286c0c78a0 0x7f286c147a90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f285c00d5c0 tx=0x7f285c00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:32.306 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.298+0000 7f2861ffb640 1 -- 172.21.15.8:0/3686191310 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c0125f0 con 0x7f286c0c78a0 2023-10-14T10:33:32.306 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.298+0000 7f2861ffb640 1 -- 172.21.15.8:0/3686191310 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c012750 con 0x7f286c0c78a0 2023-10-14T10:33:32.307 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.298+0000 7f2861ffb640 1 -- 172.21.15.8:0/3686191310 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c012b00 con 0x7f286c0c78a0 2023-10-14T10:33:32.307 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.298+0000 7f2873490640 1 -- 172.21.15.8:0/3686191310 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286c0aaf00 con 0x7f286c0c78a0 2023-10-14T10:33:32.307 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.298+0000 7f2873490640 1 -- 172.21.15.8:0/3686191310 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286c148510 con 0x7f286c0c78a0 2023-10-14T10:33:32.307 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.299+0000 7f2861ffb640 1 -- 172.21.15.8:0/3686191310 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f285c01e460 con 0x7f286c0c78a0 2023-10-14T10:33:32.307 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.299+0000 7f2861ffb640 1 -- 172.21.15.8:0/3686191310 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f285c0144d0 con 0x7f286c0c78a0 2023-10-14T10:33:32.308 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.300+0000 7f2873490640 1 -- 172.21.15.8:0/3686191310 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286c0669f0 con 0x7f286c0c78a0 2023-10-14T10:33:32.308 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.302+0000 7f2861ffb640 1 -- 172.21.15.8:0/3686191310 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f285c01e710 con 0x7f286c0c78a0 2023-10-14T10:33:32.370 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.368+0000 7f2873490640 1 -- 172.21.15.8:0/3686191310 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f286c073b90 con 0x7f286c0c78a0 2023-10-14T10:33:32.370 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.369+0000 7f2861ffb640 1 -- 172.21.15.8:0/3686191310 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f285c01e910 con 0x7f286c0c78a0 2023-10-14T10:33:32.371 INFO:teuthology.misc.health.smithi008.stdout: 2023-10-14T10:33:32.371 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":10,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:30.899760+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:33:32.372 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.370+0000 7f2873490640 1 -- 172.21.15.8:0/3686191310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286c0c78a0 msgr2=0x7f286c147a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:32.372 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.370+0000 7f2873490640 1 --2- 172.21.15.8:0/3686191310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286c0c78a0 0x7f286c147a90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f285c00d5c0 tx=0x7f285c00da80 comp rx=0 tx=0).stop 2023-10-14T10:33:32.372 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.370+0000 7f2873490640 1 -- 172.21.15.8:0/3686191310 shutdown_connections 2023-10-14T10:33:32.373 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.370+0000 7f2873490640 1 --2- 172.21.15.8:0/3686191310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f286c1516a0 0x7f286c147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:32.373 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.370+0000 7f2873490640 1 --2- 172.21.15.8:0/3686191310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286c0c78a0 0x7f286c147a90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:32.373 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.370+0000 7f2873490640 1 --2- 172.21.15.8:0/3686191310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f286c06c970 0x7f286c153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:32.373 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.370+0000 7f2873490640 1 -- 172.21.15.8:0/3686191310 >> 172.21.15.8:0/3686191310 conn(0x7f286c0716f0 msgr2=0x7f286c14ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:32.373 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.370+0000 7f2873490640 1 -- 172.21.15.8:0/3686191310 shutdown_connections 2023-10-14T10:33:32.374 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:32.370+0000 7f2873490640 1 -- 172.21.15.8:0/3686191310 wait complete. 2023-10-14T10:33:32.385 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-14T10:33:32.428 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:32.426+0000 7f0bb0034040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T10:33:32.491 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:32.489+0000 7f0bb0034040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T10:33:32.610 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:32.608+0000 7f0bb0034040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T10:33:32.835 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:32.833+0000 7fd524012040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T10:33:33.137 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:33.134+0000 7fd524012040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T10:33:33.195 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:33.192+0000 7fd524012040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T10:33:33.306 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-10-14T10:33:33.304+0000 7fd524012040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T10:33:33.637 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:33.635+0000 7f0b50bf0640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-14T10:33:33.638 INFO:tasks.ceph.mgr.y.smithi008.stderr:2023-10-14T10:33:33.636+0000 7f0b50bf0640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-14T10:33:35.239 INFO:tasks.ceph.osd.5.smithi092.stderr:2023-10-14T10:33:35.237+0000 7f4684410500 -1 osd.5 0 log_to_monitors true 2023-10-14T10:33:35.253 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-10-14T10:33:35.252+0000 7f5ac54b4500 -1 osd.0 0 log_to_monitors true 2023-10-14T10:33:35.283 INFO:tasks.ceph.osd.6.smithi092.stderr:2023-10-14T10:33:35.281+0000 7ff3efe12500 -1 osd.6 0 log_to_monitors true 2023-10-14T10:33:35.303 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-10-14T10:33:35.301+0000 7f65726b6500 -1 osd.3 0 log_to_monitors true 2023-10-14T10:33:35.311 INFO:tasks.ceph.osd.7.smithi092.stderr:2023-10-14T10:33:35.309+0000 7f5911014500 -1 osd.7 0 log_to_monitors true 2023-10-14T10:33:35.462 INFO:tasks.ceph.osd.4.smithi092.stderr:2023-10-14T10:33:35.459+0000 7f43cf1fa500 -1 osd.4 0 log_to_monitors true 2023-10-14T10:33:35.501 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-10-14T10:33:35.499+0000 7f43106a5500 -1 osd.2 0 log_to_monitors true 2023-10-14T10:33:35.534 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-10-14T10:33:35.532+0000 7fd2006b4500 -1 osd.1 0 log_to_monitors true 2023-10-14T10:33:38.444 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-10-14T10:33:38.442+0000 7f5ac0c1d640 -1 osd.0 0 waiting for initial osdmap 2023-10-14T10:33:38.453 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-10-14T10:33:38.451+0000 7fd1fbe1d640 -1 osd.1 0 waiting for initial osdmap 2023-10-14T10:33:38.457 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-10-14T10:33:38.456+0000 7f656f65b640 -1 osd.3 0 waiting for initial osdmap 2023-10-14T10:33:38.462 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-10-14T10:33:38.460+0000 7f5ab924f640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T10:33:38.466 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-10-14T10:33:38.465+0000 7fd1f444f640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T10:33:38.476 INFO:tasks.ceph.osd.3.smithi008.stderr:2023-10-14T10:33:38.474+0000 7f6566453640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T10:33:38.479 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-10-14T10:33:38.477+0000 7f430be0e640 -1 osd.2 0 waiting for initial osdmap 2023-10-14T10:33:38.493 INFO:tasks.ceph.osd.2.smithi008.stderr:2023-10-14T10:33:38.491+0000 7f4304440640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T10:33:38.743 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:33:38.752 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:33:39.004 INFO:tasks.ceph.osd.5.smithi092.stderr:2023-10-14T10:33:39.002+0000 7f467f4ba640 -1 osd.5 0 waiting for initial osdmap 2023-10-14T10:33:39.023 INFO:tasks.ceph.osd.4.smithi092.stderr:2023-10-14T10:33:39.021+0000 7f43cc19d640 -1 osd.4 0 waiting for initial osdmap 2023-10-14T10:33:39.024 INFO:tasks.ceph.osd.5.smithi092.stderr:2023-10-14T10:33:39.022+0000 7f4677aec640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T10:33:39.039 INFO:tasks.ceph.osd.4.smithi092.stderr:2023-10-14T10:33:39.037+0000 7f43c2f95640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T10:33:39.047 INFO:tasks.ceph.osd.7.smithi092.stderr:2023-10-14T10:33:39.045+0000 7f590c1d9640 -1 osd.7 0 waiting for initial osdmap 2023-10-14T10:33:39.070 INFO:tasks.ceph.osd.7.smithi092.stderr:2023-10-14T10:33:39.068+0000 7f590480b640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T10:33:39.089 INFO:tasks.ceph.osd.6.smithi092.stderr:2023-10-14T10:33:39.087+0000 7ff3ec8a4640 -1 osd.6 0 waiting for initial osdmap 2023-10-14T10:33:39.105 INFO:tasks.ceph.osd.6.smithi092.stderr:2023-10-14T10:33:39.103+0000 7ff3e369c640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T10:33:39.189 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T10:33:39.387 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.385+0000 7f48c0890640 1 Processor -- start 2023-10-14T10:33:39.387 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.385+0000 7f48c0890640 1 -- start start 2023-10-14T10:33:39.389 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.387+0000 7f48c0890640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f48bc151700 0x7f48bc0c0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:39.389 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.387+0000 7f48c0890640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48bc0c0000 0x7f48bc157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:39.389 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.387+0000 7f48c0890640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0c1680 con 0x7f48bc0c05e0 2023-10-14T10:33:39.389 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.387+0000 7f48c0890640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc151ae0 con 0x7f48bc151700 2023-10-14T10:33:39.390 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.387+0000 7f48c0890640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc154ab0 con 0x7f48bc0c0000 2023-10-14T10:33:39.390 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.387+0000 7f48bb7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f48bc151700 0x7f48bc0c0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:39.390 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.387+0000 7f48bbfff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f48bc0c05e0 0x7f48bc157ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53104/0 (socket says 172.21.15.8:53104) 2023-10-14T10:33:39.390 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.387+0000 7f48bbfff640 1 -- 172.21.15.8:0/931376276 learned_addr learned my addr 172.21.15.8:0/931376276 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:39.395 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.387+0000 7f48b2ffd640 1 --2- 172.21.15.8:0/931376276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48bc0c0000 0x7f48bc157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:39.395 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.388+0000 7f48bb7fe640 1 -- 172.21.15.8:0/931376276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48bc0c0000 msgr2=0x7f48bc157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:39.395 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.388+0000 7f48bb7fe640 1 --2- 172.21.15.8:0/931376276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48bc0c0000 0x7f48bc157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.395 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.388+0000 7f48bb7fe640 1 -- 172.21.15.8:0/931376276 >> v1:172.21.15.8:6789/0 conn(0x7f48bc0c05e0 legacy=0x7f48bc157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:39.395 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.388+0000 7f48bb7fe640 1 -- 172.21.15.8:0/931376276 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc154fe0 con 0x7f48bc151700 2023-10-14T10:33:39.396 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.389+0000 7f48bb7fe640 1 --2- 172.21.15.8:0/931376276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48bc151700 0x7f48bc0c0b30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0097a0 tx=0x7f48ac02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6fc5af20785107 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:39.396 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.389+0000 7f48baffd640 1 -- 172.21.15.8:0/931376276 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac02f050 con 0x7f48bc151700 2023-10-14T10:33:39.396 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.389+0000 7f48baffd640 1 -- 172.21.15.8:0/931376276 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac031700 con 0x7f48bc151700 2023-10-14T10:33:39.396 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.389+0000 7f48baffd640 1 -- 172.21.15.8:0/931376276 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac031a90 con 0x7f48bc151700 2023-10-14T10:33:39.396 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.390+0000 7f48c0890640 1 -- 172.21.15.8:0/931376276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48bc151700 msgr2=0x7f48bc0c0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:39.397 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.390+0000 7f48c0890640 1 --2- 172.21.15.8:0/931376276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48bc151700 0x7f48bc0c0b30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0097a0 tx=0x7f48ac02b7a0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.397 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.390+0000 7f48c0890640 1 -- 172.21.15.8:0/931376276 shutdown_connections 2023-10-14T10:33:39.397 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.390+0000 7f48c0890640 1 --2- 172.21.15.8:0/931376276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48bc0c0000 0x7f48bc157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.397 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.390+0000 7f48c0890640 1 --2- 172.21.15.8:0/931376276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48bc151700 0x7f48bc0c0b30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.397 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.390+0000 7f48c0890640 1 -- 172.21.15.8:0/931376276 >> 172.21.15.8:0/931376276 conn(0x7f48bc069de0 msgr2=0x7f48bc06a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:39.398 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.390+0000 7f48c0890640 1 -- 172.21.15.8:0/931376276 shutdown_connections 2023-10-14T10:33:39.398 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.390+0000 7f48c0890640 1 -- 172.21.15.8:0/931376276 wait complete. 2023-10-14T10:33:39.398 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.392+0000 7f48c0890640 1 Processor -- start 2023-10-14T10:33:39.398 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.392+0000 7f48c0890640 1 -- start start 2023-10-14T10:33:39.401 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.394+0000 7f48c0890640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48bc0c0000 0x7f48bc1ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:39.401 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.394+0000 7f48c0890640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48bc0c05e0 0x7f48bc0c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:39.401 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.394+0000 7f48c0890640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48bc151700 0x7f48bc0a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:39.401 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.394+0000 7f48c0890640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0aa290 con 0x7f48bc151700 2023-10-14T10:33:39.402 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.394+0000 7f48c0890640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc1ecb90 con 0x7f48bc0c05e0 2023-10-14T10:33:39.402 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.394+0000 7f48c0890640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc1ec510 con 0x7f48bc0c0000 2023-10-14T10:33:39.402 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.394+0000 7f48bbfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48bc151700 0x7f48bc0a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:39.402 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.394+0000 7f48bbfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48bc151700 0x7f48bc0a81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53188/0 (socket says 172.21.15.8:53188) 2023-10-14T10:33:39.403 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.394+0000 7f48bbfff640 1 -- 172.21.15.8:0/3340919716 learned_addr learned my addr 172.21.15.8:0/3340919716 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:39.403 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.394+0000 7f48bb7fe640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48bc0c0000 0x7f48bc1ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:39.403 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.394+0000 7f48b2ffd640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48bc0c05e0 0x7f48bc0c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:39.403 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.395+0000 7f48bbfff640 1 -- 172.21.15.8:0/3340919716 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48bc0c0000 msgr2=0x7f48bc1ecfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:39.403 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.395+0000 7f48bbfff640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48bc0c0000 0x7f48bc1ecfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.404 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.395+0000 7f48bbfff640 1 -- 172.21.15.8:0/3340919716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48bc0c05e0 msgr2=0x7f48bc0c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:39.404 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.395+0000 7f48bbfff640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48bc0c05e0 0x7f48bc0c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.404 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.395+0000 7f48bbfff640 1 -- 172.21.15.8:0/3340919716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac009400 con 0x7f48bc151700 2023-10-14T10:33:39.404 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.395+0000 7f48bbfff640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48bc151700 0x7f48bc0a81e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48b400cbc0 tx=0x7f48b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:39.404 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.395+0000 7f48b8ff9640 1 -- 172.21.15.8:0/3340919716 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400ad40 con 0x7f48bc151700 2023-10-14T10:33:39.405 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.395+0000 7f48b8ff9640 1 -- 172.21.15.8:0/3340919716 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b4012400 con 0x7f48bc151700 2023-10-14T10:33:39.405 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.395+0000 7f48b8ff9640 1 -- 172.21.15.8:0/3340919716 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400aea0 con 0x7f48bc151700 2023-10-14T10:33:39.405 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.395+0000 7f48c0890640 1 -- 172.21.15.8:0/3340919716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc0bbb80 con 0x7f48bc151700 2023-10-14T10:33:39.405 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.395+0000 7f48c0890640 1 -- 172.21.15.8:0/3340919716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc0bc140 con 0x7f48bc151700 2023-10-14T10:33:39.406 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.397+0000 7f48c0890640 1 -- 172.21.15.8:0/3340919716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc1eccd0 con 0x7f48bc151700 2023-10-14T10:33:39.406 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.397+0000 7f48b8ff9640 1 -- 172.21.15.8:0/3340919716 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f48b4007070 con 0x7f48bc151700 2023-10-14T10:33:39.406 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.399+0000 7f48b8ff9640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f489c06ae10 0x7f489c06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:39.406 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.399+0000 7f48b8ff9640 1 -- 172.21.15.8:0/3340919716 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f48b40885e0 con 0x7f48bc151700 2023-10-14T10:33:39.406 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.399+0000 7f48bb7fe640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f489c06ae10 0x7f489c06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:39.407 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.400+0000 7f48bb7fe640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f489c06ae10 0x7f489c06d2d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f48ac035000 tx=0x7f48ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:39.407 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.404+0000 7f48b8ff9640 1 -- 172.21.15.8:0/3340919716 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f48bc1eccd0 con 0x7f48bc151700 2023-10-14T10:33:39.612 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.610+0000 7f48c0890640 1 -- 172.21.15.8:0/3340919716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48bc1eccd0 con 0x7f48bc151700 2023-10-14T10:33:39.613 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.612+0000 7f48b8ff9640 1 -- 172.21.15.8:0/3340919716 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10776 (secure 0 0 0) 0x7f48bc1eccd0 con 0x7f48bc151700 2023-10-14T10:33:39.614 INFO:teuthology.misc.health.smithi008.stdout: 2023-10-14T10:33:39.614 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":13,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:39.460010+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:33:39.616 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.614+0000 7f48c0890640 1 -- 172.21.15.8:0/3340919716 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f489c06ae10 msgr2=0x7f489c06d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:39.617 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.614+0000 7f48c0890640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f489c06ae10 0x7f489c06d2d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f48ac035000 tx=0x7f48ac008030 comp rx=0 tx=0).stop 2023-10-14T10:33:39.617 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.614+0000 7f48c0890640 1 -- 172.21.15.8:0/3340919716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48bc151700 msgr2=0x7f48bc0a81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:39.617 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.614+0000 7f48c0890640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48bc151700 0x7f48bc0a81e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48b400cbc0 tx=0x7f48b400a430 comp rx=0 tx=0).stop 2023-10-14T10:33:39.617 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.614+0000 7f48c0890640 1 -- 172.21.15.8:0/3340919716 shutdown_connections 2023-10-14T10:33:39.618 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.614+0000 7f48c0890640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f489c06ae10 0x7f489c06d2d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.618 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.614+0000 7f48c0890640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48bc151700 0x7f48bc0a81e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.618 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.614+0000 7f48c0890640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48bc0c05e0 0x7f48bc0c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.619 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.614+0000 7f48c0890640 1 --2- 172.21.15.8:0/3340919716 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48bc0c0000 0x7f48bc1ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.619 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.614+0000 7f48c0890640 1 -- 172.21.15.8:0/3340919716 >> 172.21.15.8:0/3340919716 conn(0x7f48bc069de0 msgr2=0x7f48bc150010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:39.619 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.614+0000 7f48c0890640 1 -- 172.21.15.8:0/3340919716 shutdown_connections 2023-10-14T10:33:39.619 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T10:33:39.614+0000 7f48c0890640 1 -- 172.21.15.8:0/3340919716 wait complete. 2023-10-14T10:33:39.630 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-14T10:33:39.630 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T10:33:39.630 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T10:33:39.631 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T10:33:39.637 INFO:tasks.ceph.mds.a:Started 2023-10-14T10:33:39.637 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T10:33:39.637 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T10:33:39.643 INFO:tasks.ceph.mds.c:Started 2023-10-14T10:33:39.643 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T10:33:39.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T10:33:39.653 INFO:tasks.ceph.mds.b:Started 2023-10-14T10:33:39.653 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T10:33:39.653 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T10:33:39.663 INFO:tasks.ceph.mds.d:Started 2023-10-14T10:33:39.663 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-14T10:33:39.664 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:33:39.791 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2023-10-14T10:33:39.800 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2023-10-14T10:33:39.818 INFO:tasks.ceph.mds.d.smithi092.stdout:starting mds.d at 2023-10-14T10:33:39.818 INFO:tasks.ceph.mds.b.smithi092.stdout:starting mds.b at 2023-10-14T10:33:39.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.844+0000 7f921d675640 1 Processor -- start 2023-10-14T10:33:39.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.844+0000 7f921d675640 1 -- start start 2023-10-14T10:33:39.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.845+0000 7f921d675640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f92180c50f0 0x7f92180c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:39.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.845+0000 7f921d675640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92181543b0 con 0x7f921806b5d0 2023-10-14T10:33:39.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.845+0000 7f921d675640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92181518a0 con 0x7f92181514c0 2023-10-14T10:33:39.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.845+0000 7f921d675640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921806c3c0 con 0x7f92180c50f0 2023-10-14T10:33:39.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.845+0000 7f920ffff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f921806b5d0 0x7f9218154840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53124/0 (socket says 172.21.15.8:53124) 2023-10-14T10:33:39.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.845+0000 7f920ffff640 1 -- 172.21.15.8:0/1307272466 learned_addr learned my addr 172.21.15.8:0/1307272466 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:39.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.846+0000 7f921ce74640 1 --2- 172.21.15.8:0/1307272466 >> v2:172.21.15.92:3300/0 conn(0x7f92180c50f0 0x7f92180c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:39.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.846+0000 7f92177fe640 1 -- 172.21.15.8:0/1307272466 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148169186 0 0) 0x7f92181543b0 con 0x7f921806b5d0 2023-10-14T10:33:39.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.846+0000 7f92177fe640 1 -- 172.21.15.8:0/1307272466 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9204003520 con 0x7f921806b5d0 2023-10-14T10:33:39.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.846+0000 7f92177fe640 1 -- 172.21.15.8:0/1307272466 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657664691 0 0) 0x7f92181518a0 con 0x7f92181514c0 2023-10-14T10:33:39.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.846+0000 7f92177fe640 1 -- 172.21.15.8:0/1307272466 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92181543b0 con 0x7f92181514c0 2023-10-14T10:33:39.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.846+0000 7f921ce74640 1 -- 172.21.15.8:0/1307272466 >> v1:172.21.15.92:6789/0 conn(0x7f92181514c0 legacy=0x7f92180c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:39.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.846+0000 7f921ce74640 1 -- 172.21.15.8:0/1307272466 >> v1:172.21.15.8:6789/0 conn(0x7f921806b5d0 legacy=0x7f9218154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:39.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.846+0000 7f92177fe640 1 -- 172.21.15.8:0/1307272466 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3229221861 0 0) 0x7f9204003520 con 0x7f921806b5d0 2023-10-14T10:33:39.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.846+0000 7f921ce74640 1 -- 172.21.15.8:0/1307272466 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92180c5890 con 0x7f92180c50f0 2023-10-14T10:33:39.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.847+0000 7f921ce74640 1 --2- 172.21.15.8:0/1307272466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92180c50f0 0x7f92180c4550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9210009dc0 tx=0x7f921002bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98b10e913da512ba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:39.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.847+0000 7f92177fe640 1 -- 172.21.15.8:0/1307272466 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200001670 con 0x7f92180c50f0 2023-10-14T10:33:39.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.847+0000 7f92177fe640 1 -- 172.21.15.8:0/1307272466 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921002c8a0 con 0x7f92180c50f0 2023-10-14T10:33:39.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.847+0000 7f92177fe640 1 -- 172.21.15.8:0/1307272466 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921002cc30 con 0x7f92180c50f0 2023-10-14T10:33:39.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.848+0000 7f921d675640 1 -- 172.21.15.8:0/1307272466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92180c50f0 msgr2=0x7f92180c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:39.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.848+0000 7f921d675640 1 --2- 172.21.15.8:0/1307272466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92180c50f0 0x7f92180c4550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9210009dc0 tx=0x7f921002bd70 comp rx=0 tx=0).stop 2023-10-14T10:33:39.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.848+0000 7f921d675640 1 -- 172.21.15.8:0/1307272466 shutdown_connections 2023-10-14T10:33:39.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.848+0000 7f921d675640 1 --2- 172.21.15.8:0/1307272466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92180c50f0 0x7f92180c4550 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.848+0000 7f921d675640 1 -- 172.21.15.8:0/1307272466 >> 172.21.15.8:0/1307272466 conn(0x7f92180c60b0 msgr2=0x7f92180c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.848+0000 7f921d675640 1 -- 172.21.15.8:0/1307272466 shutdown_connections 2023-10-14T10:33:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.848+0000 7f921d675640 1 -- 172.21.15.8:0/1307272466 wait complete. 2023-10-14T10:33:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.850+0000 7f921d675640 1 Processor -- start 2023-10-14T10:33:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.850+0000 7f921d675640 1 -- start start 2023-10-14T10:33:39.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.850+0000 7f921d675640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f921806b5d0 0x7f92181ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:39.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f921d675640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92180c50f0 0x7f9218157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f921d675640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f92181514c0 0x7f9218157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f921d675640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181ecf80 con 0x7f921806b5d0 2023-10-14T10:33:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f921d675640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181ecca0 con 0x7f92180c50f0 2023-10-14T10:33:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f921d675640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92180a95e0 con 0x7f92181514c0 2023-10-14T10:33:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f9217fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f921806b5d0 0x7f92181ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:39.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f9217fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f921806b5d0 0x7f92181ec2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53210/0 (socket says 172.21.15.8:53210) 2023-10-14T10:33:39.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f9217fff640 1 -- 172.21.15.8:0/4151610060 learned_addr learned my addr 172.21.15.8:0/4151610060 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:39.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f920ffff640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92180c50f0 0x7f9218157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:39.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f921ce74640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f92181514c0 0x7f9218157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:39.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f9217fff640 1 -- 172.21.15.8:0/4151610060 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f92181514c0 msgr2=0x7f9218157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:39.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f9217fff640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f92181514c0 0x7f9218157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f9217fff640 1 -- 172.21.15.8:0/4151610060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92180c50f0 msgr2=0x7f9218157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:39.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f9217fff640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92180c50f0 0x7f9218157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:39.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.851+0000 7f9217fff640 1 -- 172.21.15.8:0/4151610060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9210009a70 con 0x7f921806b5d0 2023-10-14T10:33:39.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.852+0000 7f9217fff640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f921806b5d0 0x7f92181ec2b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f920800c430 tx=0x7f920800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.852+0000 7f92157fa640 1 -- 172.21.15.8:0/4151610060 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92080052d0 con 0x7f921806b5d0 2023-10-14T10:33:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.852+0000 7f92157fa640 1 -- 172.21.15.8:0/4151610060 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9208005450 con 0x7f921806b5d0 2023-10-14T10:33:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.852+0000 7f92157fa640 1 -- 172.21.15.8:0/4151610060 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208003830 con 0x7f921806b5d0 2023-10-14T10:33:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.852+0000 7f921d675640 1 -- 172.21.15.8:0/4151610060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9218153750 con 0x7f921806b5d0 2023-10-14T10:33:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.852+0000 7f921d675640 1 -- 172.21.15.8:0/4151610060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9218155220 con 0x7f921806b5d0 2023-10-14T10:33:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.853+0000 7f921d675640 1 -- 172.21.15.8:0/4151610060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9218155470 con 0x7f921806b5d0 2023-10-14T10:33:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.854+0000 7f92157fa640 1 -- 172.21.15.8:0/4151610060 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f9208003990 con 0x7f921806b5d0 2023-10-14T10:33:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.855+0000 7f92157fa640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f91f806ade0 0x7f91f806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.855+0000 7f92157fa640 1 -- 172.21.15.8:0/4151610060 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f9208088610 con 0x7f921806b5d0 2023-10-14T10:33:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.855+0000 7f920ffff640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f91f806ade0 0x7f91f806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.856+0000 7f920ffff640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f91f806ade0 0x7f91f806d2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f921814bb00 tx=0x7f9200001a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:39.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:39.859+0000 7f92157fa640 1 -- 172.21.15.8:0/4151610060 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9218155470 con 0x7f921806b5d0 2023-10-14T10:33:40.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.046+0000 7f921d675640 1 -- 172.21.15.8:0/4151610060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9218155470 con 0x7f921806b5d0 2023-10-14T10:33:40.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.047+0000 7f92157fa640 1 -- 172.21.15.8:0/4151610060 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10776 (secure 0 0 0) 0x7f9218155470 con 0x7f921806b5d0 2023-10-14T10:33:40.050 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:40.050 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":13,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:39.460010+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:33:40.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.050+0000 7f921d675640 1 -- 172.21.15.8:0/4151610060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f91f806ade0 msgr2=0x7f91f806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:40.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.050+0000 7f921d675640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f91f806ade0 0x7f91f806d2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f921814bb00 tx=0x7f9200001a50 comp rx=0 tx=0).stop 2023-10-14T10:33:40.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.050+0000 7f921d675640 1 -- 172.21.15.8:0/4151610060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f921806b5d0 msgr2=0x7f92181ec2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.050+0000 7f921d675640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f921806b5d0 0x7f92181ec2b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f920800c430 tx=0x7f920800c8f0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.050+0000 7f921d675640 1 -- 172.21.15.8:0/4151610060 shutdown_connections 2023-10-14T10:33:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.050+0000 7f921d675640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f91f806ade0 0x7f91f806d2a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.050+0000 7f921d675640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f92181514c0 0x7f9218157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.050+0000 7f921d675640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92180c50f0 0x7f9218157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.050+0000 7f921d675640 1 --2- 172.21.15.8:0/4151610060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f921806b5d0 0x7f92181ec2b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.050+0000 7f921d675640 1 -- 172.21.15.8:0/4151610060 >> 172.21.15.8:0/4151610060 conn(0x7f92180c60b0 msgr2=0x7f92180c4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.050+0000 7f921d675640 1 -- 172.21.15.8:0/4151610060 shutdown_connections 2023-10-14T10:33:40.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.050+0000 7f921d675640 1 -- 172.21.15.8:0/4151610060 wait complete. 2023-10-14T10:33:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-10-14T10:33:40.069 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:33:40.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.286+0000 7fe4abfff640 1 Processor -- start 2023-10-14T10:33:40.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.286+0000 7fe4abfff640 1 -- start start 2023-10-14T10:33:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.287+0000 7fe4abfff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ac14abb0 0x7fe4ac151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:40.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.287+0000 7fe4abfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4ac0a9610 0x7fe4ac0c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.287+0000 7fe4abfff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe4ac0c2650 0x7fe4ac06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4abfff640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac0a9280 con 0x7fe4ac0a9610 2023-10-14T10:33:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4abfff640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac071650 con 0x7fe4ac0c2650 2023-10-14T10:33:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4abfff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0aa6f0 con 0x7fe4ac14abb0 2023-10-14T10:33:40.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4aa7fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4ac0a9610 0x7fe4ac0c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:40.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4aa7fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe4ac0a9610 0x7fe4ac0c2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53224/0 (socket says 172.21.15.8:53224) 2023-10-14T10:33:40.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4aa7fc640 1 -- 172.21.15.8:0/3443861043 learned_addr learned my addr 172.21.15.8:0/3443861043 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:40.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4aaffd640 1 --2- 172.21.15.8:0/3443861043 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ac14abb0 0x7fe4ac151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:40.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4ab7fe640 1 --2- 172.21.15.8:0/3443861043 >> v2:172.21.15.92:3300/0 conn(0x7fe4ac0c2650 0x7fe4ac06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:40.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4aa7fc640 1 -- 172.21.15.8:0/3443861043 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ac14abb0 msgr2=0x7fe4ac151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4aa7fc640 1 --2- 172.21.15.8:0/3443861043 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ac14abb0 0x7fe4ac151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4aa7fc640 1 -- 172.21.15.8:0/3443861043 >> v2:172.21.15.92:3300/0 conn(0x7fe4ac0c2650 msgr2=0x7fe4ac06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4aa7fc640 1 --2- 172.21.15.8:0/3443861043 >> v2:172.21.15.92:3300/0 conn(0x7fe4ac0c2650 0x7fe4ac06faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.288+0000 7fe4aa7fc640 1 -- 172.21.15.8:0/3443861043 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac0a81e0 con 0x7fe4ac0a9610 2023-10-14T10:33:40.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.289+0000 7fe4aa7fc640 1 --2- 172.21.15.8:0/3443861043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4ac0a9610 0x7fe4ac0c2110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0c15d0 tx=0x7fe49c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5dc9ec6d70936cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.290+0000 7fe4a9ffb640 1 -- 172.21.15.8:0/3443861043 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c02ca70 con 0x7fe4ac0a9610 2023-10-14T10:33:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.290+0000 7fe4a9ffb640 1 -- 172.21.15.8:0/3443861043 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c02cbd0 con 0x7fe4ac0a9610 2023-10-14T10:33:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.290+0000 7fe4a9ffb640 1 -- 172.21.15.8:0/3443861043 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0343f0 con 0x7fe4ac0a9610 2023-10-14T10:33:40.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.290+0000 7fe4abfff640 1 -- 172.21.15.8:0/3443861043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4ac0a9610 msgr2=0x7fe4ac0c2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.290+0000 7fe4abfff640 1 --2- 172.21.15.8:0/3443861043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4ac0a9610 0x7fe4ac0c2110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac0c15d0 tx=0x7fe49c02bed0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.290+0000 7fe4abfff640 1 -- 172.21.15.8:0/3443861043 shutdown_connections 2023-10-14T10:33:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.290+0000 7fe4abfff640 1 --2- 172.21.15.8:0/3443861043 >> v2:172.21.15.92:3300/0 conn(0x7fe4ac0c2650 0x7fe4ac06faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.290+0000 7fe4abfff640 1 --2- 172.21.15.8:0/3443861043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4ac0a9610 0x7fe4ac0c2110 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.290+0000 7fe4abfff640 1 --2- 172.21.15.8:0/3443861043 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ac14abb0 0x7fe4ac151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.290+0000 7fe4abfff640 1 -- 172.21.15.8:0/3443861043 >> 172.21.15.8:0/3443861043 conn(0x7fe4ac06a200 msgr2=0x7fe4ac06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.291+0000 7fe4abfff640 1 -- 172.21.15.8:0/3443861043 shutdown_connections 2023-10-14T10:33:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.291+0000 7fe4abfff640 1 -- 172.21.15.8:0/3443861043 wait complete. 2023-10-14T10:33:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.292+0000 7fe4abfff640 1 Processor -- start 2023-10-14T10:33:40.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.292+0000 7fe4abfff640 1 -- start start 2023-10-14T10:33:40.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.293+0000 7fe4abfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4ac0a9610 0x7fe4ac0be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.293+0000 7fe4abfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4ac0c2650 0x7fe4ac1460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.293+0000 7fe4abfff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ac14abb0 0x7fe4ac146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.293+0000 7fe4abfff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac1daf90 con 0x7fe4ac0a9610 2023-10-14T10:33:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.293+0000 7fe4abfff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac1ed010 con 0x7fe4ac0c2650 2023-10-14T10:33:40.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.293+0000 7fe4abfff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac1ed2f0 con 0x7fe4ac14abb0 2023-10-14T10:33:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.293+0000 7fe4aaffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4ac0a9610 0x7fe4ac0be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.293+0000 7fe4aaffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4ac0a9610 0x7fe4ac0be7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53232/0 (socket says 172.21.15.8:53232) 2023-10-14T10:33:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.293+0000 7fe4aaffd640 1 -- 172.21.15.8:0/970148058 learned_addr learned my addr 172.21.15.8:0/970148058 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:40.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.294+0000 7fe4aaffd640 1 -- 172.21.15.8:0/970148058 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ac14abb0 msgr2=0x7fe4ac146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.294+0000 7fe4aaffd640 1 --2- 172.21.15.8:0/970148058 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ac14abb0 0x7fe4ac146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.294+0000 7fe4aaffd640 1 -- 172.21.15.8:0/970148058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4ac0c2650 msgr2=0x7fe4ac1460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.294+0000 7fe4aaffd640 1 --2- 172.21.15.8:0/970148058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4ac0c2650 0x7fe4ac1460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.294+0000 7fe4aaffd640 1 -- 172.21.15.8:0/970148058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c009b30 con 0x7fe4ac0a9610 2023-10-14T10:33:40.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.294+0000 7fe4aaffd640 1 --2- 172.21.15.8:0/970148058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4ac0a9610 0x7fe4ac0be7d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe49400d800 tx=0x7fe49400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:40.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.294+0000 7fe4a37fe640 1 -- 172.21.15.8:0/970148058 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400b6c0 con 0x7fe4ac0a9610 2023-10-14T10:33:40.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.294+0000 7fe4a37fe640 1 -- 172.21.15.8:0/970148058 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400b820 con 0x7fe4ac0a9610 2023-10-14T10:33:40.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.294+0000 7fe4a37fe640 1 -- 172.21.15.8:0/970148058 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400bbb0 con 0x7fe4ac0a9610 2023-10-14T10:33:40.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.294+0000 7fe4abfff640 1 -- 172.21.15.8:0/970148058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac1db1e0 con 0x7fe4ac0a9610 2023-10-14T10:33:40.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.294+0000 7fe4abfff640 1 -- 172.21.15.8:0/970148058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac0bed10 con 0x7fe4ac0a9610 2023-10-14T10:33:40.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.296+0000 7fe4abfff640 1 -- 172.21.15.8:0/970148058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ac1ed4b0 con 0x7fe4ac0a9610 2023-10-14T10:33:40.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.296+0000 7fe4a37fe640 1 -- 172.21.15.8:0/970148058 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fe49400bd10 con 0x7fe4ac0a9610 2023-10-14T10:33:40.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.297+0000 7fe4a37fe640 1 --2- 172.21.15.8:0/970148058 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe48c06ade0 0x7fe48c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:40.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.297+0000 7fe4a37fe640 1 -- 172.21.15.8:0/970148058 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fe4940896c0 con 0x7fe4ac0a9610 2023-10-14T10:33:40.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.298+0000 7fe4aa7fc640 1 --2- 172.21.15.8:0/970148058 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe48c06ade0 0x7fe48c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:40.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.298+0000 7fe4aa7fc640 1 --2- 172.21.15.8:0/970148058 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe48c06ade0 0x7fe48c06d2a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe49c035000 tx=0x7fe49c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:40.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.302+0000 7fe4a37fe640 1 -- 172.21.15.8:0/970148058 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4ac1ed4b0 con 0x7fe4ac0a9610 2023-10-14T10:33:40.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.535+0000 7fe4abfff640 1 -- 172.21.15.8:0/970148058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4ac1ed4b0 con 0x7fe4ac0a9610 2023-10-14T10:33:40.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.535+0000 7fe4a37fe640 1 -- 172.21.15.8:0/970148058 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1318 (secure 0 0 0) 0x7fe4ac1ed4b0 con 0x7fe4ac0a9610 2023-10-14T10:33:40.538 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:40.538 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/524862170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":524862170},{"type":"v1","addr":"172.21.15.8:6835","nonce":524862170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-14T10:33:40.538 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 2 2023-10-14T10:33:40.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.538+0000 7fe4abfff640 1 -- 172.21.15.8:0/970148058 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe48c06ade0 msgr2=0x7fe48c06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:40.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.538+0000 7fe4abfff640 1 --2- 172.21.15.8:0/970148058 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe48c06ade0 0x7fe48c06d2a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe49c035000 tx=0x7fe49c02e000 comp rx=0 tx=0).stop 2023-10-14T10:33:40.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.538+0000 7fe4abfff640 1 -- 172.21.15.8:0/970148058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4ac0a9610 msgr2=0x7fe4ac0be7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:40.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.538+0000 7fe4abfff640 1 --2- 172.21.15.8:0/970148058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4ac0a9610 0x7fe4ac0be7d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe49400d800 tx=0x7fe49400dcc0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.538+0000 7fe4abfff640 1 -- 172.21.15.8:0/970148058 shutdown_connections 2023-10-14T10:33:40.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.538+0000 7fe4abfff640 1 --2- 172.21.15.8:0/970148058 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe48c06ade0 0x7fe48c06d2a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.538+0000 7fe4abfff640 1 --2- 172.21.15.8:0/970148058 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ac14abb0 0x7fe4ac146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.538+0000 7fe4abfff640 1 --2- 172.21.15.8:0/970148058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4ac0c2650 0x7fe4ac1460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.538+0000 7fe4abfff640 1 --2- 172.21.15.8:0/970148058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4ac0a9610 0x7fe4ac0be7d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:40.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.538+0000 7fe4abfff640 1 -- 172.21.15.8:0/970148058 >> 172.21.15.8:0/970148058 conn(0x7fe4ac06a200 msgr2=0x7fe4ac06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:40.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.538+0000 7fe4abfff640 1 -- 172.21.15.8:0/970148058 shutdown_connections 2023-10-14T10:33:40.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:40.538+0000 7fe4abfff640 1 -- 172.21.15.8:0/970148058 wait complete. 2023-10-14T10:33:42.559 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:33:42.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.793+0000 7f22f1943640 1 Processor -- start 2023-10-14T10:33:42.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.793+0000 7f22f1943640 1 -- start start 2023-10-14T10:33:42.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.795+0000 7f22f1943640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22ec0a9610 0x7f22ec151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:42.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.795+0000 7f22f1943640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f22ec06faf0 0x7f22ec06ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:42.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.795+0000 7f22f1943640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ec071650 con 0x7f22ec14abb0 2023-10-14T10:33:42.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.795+0000 7f22f1943640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec0a9280 con 0x7f22ec06faf0 2023-10-14T10:33:42.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.795+0000 7f22f1943640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec0aa6f0 con 0x7f22ec0a9610 2023-10-14T10:33:42.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.795+0000 7f22f0941640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f22ec14abb0 0x7f22ec0c2110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53138/0 (socket says 172.21.15.8:53138) 2023-10-14T10:33:42.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.795+0000 7f22f0941640 1 -- 172.21.15.8:0/2462625368 learned_addr learned my addr 172.21.15.8:0/2462625368 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:42.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.795+0000 7f22f1142640 1 --2- 172.21.15.8:0/2462625368 >> v2:172.21.15.8:3300/0 conn(0x7f22ec06faf0 0x7f22ec06ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:42.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.796+0000 7f22ebfff640 1 --2- 172.21.15.8:0/2462625368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22ec0a9610 0x7f22ec151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:42.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.796+0000 7f22eb7fe640 1 -- 172.21.15.8:0/2462625368 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636035264 0 0) 0x7f22ec071650 con 0x7f22ec14abb0 2023-10-14T10:33:42.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.796+0000 7f22eb7fe640 1 -- 172.21.15.8:0/2462625368 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22dc003520 con 0x7f22ec14abb0 2023-10-14T10:33:42.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.796+0000 7f22f1142640 1 -- 172.21.15.8:0/2462625368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22ec0a9610 msgr2=0x7f22ec151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:42.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.796+0000 7f22f1142640 1 --2- 172.21.15.8:0/2462625368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22ec0a9610 0x7f22ec151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:42.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.796+0000 7f22f1142640 1 -- 172.21.15.8:0/2462625368 >> v1:172.21.15.8:6789/0 conn(0x7f22ec14abb0 legacy=0x7f22ec0c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:42.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.796+0000 7f22f1142640 1 -- 172.21.15.8:0/2462625368 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0a81e0 con 0x7f22ec06faf0 2023-10-14T10:33:42.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.797+0000 7f22f1142640 1 --2- 172.21.15.8:0/2462625368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22ec06faf0 0x7f22ec06ff80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009d90 tx=0x7f22e402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348c19366166e674 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:42.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.797+0000 7f22eb7fe640 1 -- 172.21.15.8:0/2462625368 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e402cc60 con 0x7f22ec06faf0 2023-10-14T10:33:42.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.797+0000 7f22eb7fe640 1 -- 172.21.15.8:0/2462625368 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e402cdc0 con 0x7f22ec06faf0 2023-10-14T10:33:42.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.797+0000 7f22eb7fe640 1 -- 172.21.15.8:0/2462625368 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4034660 con 0x7f22ec06faf0 2023-10-14T10:33:42.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.798+0000 7f22f1943640 1 -- 172.21.15.8:0/2462625368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22ec06faf0 msgr2=0x7f22ec06ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:42.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.798+0000 7f22f1943640 1 --2- 172.21.15.8:0/2462625368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22ec06faf0 0x7f22ec06ff80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009d90 tx=0x7f22e402beb0 comp rx=0 tx=0).stop 2023-10-14T10:33:42.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.798+0000 7f22f1943640 1 -- 172.21.15.8:0/2462625368 shutdown_connections 2023-10-14T10:33:42.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.798+0000 7f22f1943640 1 --2- 172.21.15.8:0/2462625368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22ec06faf0 0x7f22ec06ff80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:42.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.798+0000 7f22f1943640 1 --2- 172.21.15.8:0/2462625368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22ec0a9610 0x7f22ec151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:42.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.798+0000 7f22f1943640 1 -- 172.21.15.8:0/2462625368 >> 172.21.15.8:0/2462625368 conn(0x7f22ec06a200 msgr2=0x7f22ec06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:42.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.798+0000 7f22f1943640 1 -- 172.21.15.8:0/2462625368 shutdown_connections 2023-10-14T10:33:42.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.798+0000 7f22f1943640 1 -- 172.21.15.8:0/2462625368 wait complete. 2023-10-14T10:33:42.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.800+0000 7f22f1943640 1 Processor -- start 2023-10-14T10:33:42.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.800+0000 7f22f1943640 1 -- start start 2023-10-14T10:33:42.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.801+0000 7f22f1943640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22ec06faf0 0x7f22ec0bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.801+0000 7f22f1943640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22ec0a9610 0x7f22ec147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.801+0000 7f22f1943640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22ec14abb0 0x7f22ec148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.801+0000 7f22f1943640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec14e080 con 0x7f22ec14abb0 2023-10-14T10:33:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.801+0000 7f22f1943640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec1e7bd0 con 0x7f22ec0a9610 2023-10-14T10:33:42.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.801+0000 7f22f1943640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec14fb70 con 0x7f22ec06faf0 2023-10-14T10:33:42.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.802+0000 7f22f1142640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22ec14abb0 0x7f22ec148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:42.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.802+0000 7f22f1142640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22ec14abb0 0x7f22ec148230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53248/0 (socket says 172.21.15.8:53248) 2023-10-14T10:33:42.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.802+0000 7f22f1142640 1 -- 172.21.15.8:0/117741720 learned_addr learned my addr 172.21.15.8:0/117741720 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:42.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.802+0000 7f22f0941640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22ec06faf0 0x7f22ec0bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:42.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.802+0000 7f22ebfff640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22ec0a9610 0x7f22ec147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.802+0000 7f22f1142640 1 -- 172.21.15.8:0/117741720 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22ec06faf0 msgr2=0x7f22ec0bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.802+0000 7f22f1142640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22ec06faf0 0x7f22ec0bfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.802+0000 7f22f1142640 1 -- 172.21.15.8:0/117741720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22ec0a9610 msgr2=0x7f22ec147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.802+0000 7f22f1142640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22ec0a9610 0x7f22ec147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:42.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.802+0000 7f22f1142640 1 -- 172.21.15.8:0/117741720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e4009a70 con 0x7f22ec14abb0 2023-10-14T10:33:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.802+0000 7f22f0941640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22ec06faf0 0x7f22ec0bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.802+0000 7f22f1142640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22ec14abb0 0x7f22ec148230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009eb0 tx=0x7f22e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.803+0000 7f22e97fa640 1 -- 172.21.15.8:0/117741720 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4040650 con 0x7f22ec14abb0 2023-10-14T10:33:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.803+0000 7f22e97fa640 1 -- 172.21.15.8:0/117741720 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e40407b0 con 0x7f22ec14abb0 2023-10-14T10:33:42.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.803+0000 7f22f1943640 1 -- 172.21.15.8:0/117741720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec148770 con 0x7f22ec14abb0 2023-10-14T10:33:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.803+0000 7f22e97fa640 1 -- 172.21.15.8:0/117741720 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4040b60 con 0x7f22ec14abb0 2023-10-14T10:33:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.803+0000 7f22f1943640 1 -- 172.21.15.8:0/117741720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec1e78f0 con 0x7f22ec14abb0 2023-10-14T10:33:42.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.804+0000 7f22f1943640 1 -- 172.21.15.8:0/117741720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ec04e9b0 con 0x7f22ec14abb0 2023-10-14T10:33:42.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.805+0000 7f22e97fa640 1 -- 172.21.15.8:0/117741720 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f22e4040cc0 con 0x7f22ec14abb0 2023-10-14T10:33:42.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.806+0000 7f22e97fa640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f22d006ade0 0x7f22d006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:42.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.807+0000 7f22e97fa640 1 -- 172.21.15.8:0/117741720 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f22e40abf10 con 0x7f22ec14abb0 2023-10-14T10:33:42.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.807+0000 7f22f0941640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f22d006ade0 0x7f22d006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:42.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.807+0000 7f22f0941640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f22d006ade0 0x7f22d006d2a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22e0007fd0 tx=0x7f22e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:42.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:42.811+0000 7f22e97fa640 1 -- 172.21.15.8:0/117741720 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22e40773e0 con 0x7f22ec14abb0 2023-10-14T10:33:43.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.071+0000 7f22f1943640 1 -- 172.21.15.8:0/117741720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22ec0c0ae0 con 0x7f22ec14abb0 2023-10-14T10:33:43.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.072+0000 7f22e97fa640 1 -- 172.21.15.8:0/117741720 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3685 (secure 0 0 0) 0x7f22e4009450 con 0x7f22ec14abb0 2023-10-14T10:33:43.075 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:43.075 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3003490368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3003490368},{"type":"v1","addr":"172.21.15.92:6834","nonce":3003490368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3352501671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":3352501671},{"type":"v1","addr":"172.21.15.92:6835","nonce":3352501671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4157669185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4157669185},{"type":"v1","addr":"172.21.15.8:6837","nonce":4157669185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/524862170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":524862170},{"type":"v1","addr":"172.21.15.8:6835","nonce":524862170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-14T10:33:43.075 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2023-10-14T10:33:43.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.075+0000 7f22f1943640 1 -- 172.21.15.8:0/117741720 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f22d006ade0 msgr2=0x7f22d006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.075+0000 7f22f1943640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f22d006ade0 0x7f22d006d2a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22e0007fd0 tx=0x7f22e0009040 comp rx=0 tx=0).stop 2023-10-14T10:33:43.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.075+0000 7f22f1943640 1 -- 172.21.15.8:0/117741720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22ec14abb0 msgr2=0x7f22ec148230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.075+0000 7f22f1943640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22ec14abb0 0x7f22ec148230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009eb0 tx=0x7f22e4004a40 comp rx=0 tx=0).stop 2023-10-14T10:33:43.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.075+0000 7f22f1943640 1 -- 172.21.15.8:0/117741720 shutdown_connections 2023-10-14T10:33:43.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.075+0000 7f22f1943640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f22d006ade0 0x7f22d006d2a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.075+0000 7f22f1943640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22ec14abb0 0x7f22ec148230 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.075+0000 7f22f1943640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22ec0a9610 0x7f22ec147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.075+0000 7f22f1943640 1 --2- 172.21.15.8:0/117741720 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22ec06faf0 0x7f22ec0bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.075+0000 7f22f1943640 1 -- 172.21.15.8:0/117741720 >> 172.21.15.8:0/117741720 conn(0x7f22ec06a200 msgr2=0x7f22ec06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:43.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.075+0000 7f22f1943640 1 -- 172.21.15.8:0/117741720 shutdown_connections 2023-10-14T10:33:43.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.075+0000 7f22f1943640 1 -- 172.21.15.8:0/117741720 wait complete. 2023-10-14T10:33:43.095 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:33:43.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.289+0000 7fb045db7640 1 Processor -- start 2023-10-14T10:33:43.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.289+0000 7fb045db7640 1 -- start start 2023-10-14T10:33:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.291+0000 7fb045db7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb040151590 0x7fb040155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.291+0000 7fb045db7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb040154a00 0x7fb040157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.291+0000 7fb045db7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb0400c4210 0x7fb0400c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.291+0000 7fb045db7640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0400c4f70 con 0x7fb0400c4210 2023-10-14T10:33:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.291+0000 7fb045db7640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0400ca6c0 con 0x7fb040151590 2023-10-14T10:33:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.291+0000 7fb045db7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb040157a10 con 0x7fb040154a00 2023-10-14T10:33:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.291+0000 7fb03ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb0400c4210 0x7fb0400c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.291+0000 7fb03ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb0400c4210 0x7fb0400c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53260/0 (socket says 172.21.15.8:53260) 2023-10-14T10:33:43.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.291+0000 7fb03ffff640 1 -- 172.21.15.8:0/1483152548 learned_addr learned my addr 172.21.15.8:0/1483152548 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.292+0000 7fb03f7fe640 1 --2- 172.21.15.8:0/1483152548 >> v2:172.21.15.92:3300/0 conn(0x7fb040151590 0x7fb040155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.292+0000 7fb037fff640 1 --2- 172.21.15.8:0/1483152548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb040154a00 0x7fb040157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.292+0000 7fb03ffff640 1 -- 172.21.15.8:0/1483152548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb040154a00 msgr2=0x7fb040157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:43.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.292+0000 7fb03ffff640 1 --2- 172.21.15.8:0/1483152548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb040154a00 0x7fb040157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.292+0000 7fb03ffff640 1 -- 172.21.15.8:0/1483152548 >> v2:172.21.15.92:3300/0 conn(0x7fb040151590 msgr2=0x7fb040155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:43.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.292+0000 7fb03ffff640 1 --2- 172.21.15.8:0/1483152548 >> v2:172.21.15.92:3300/0 conn(0x7fb040151590 0x7fb040155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.292+0000 7fb03ffff640 1 -- 172.21.15.8:0/1483152548 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04006c8f0 con 0x7fb0400c4210 2023-10-14T10:33:43.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.293+0000 7fb03ffff640 1 --2- 172.21.15.8:0/1483152548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0400c4210 0x7fb0400c46a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb0400c9d70 tx=0x7fb03802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e19efa3f938ee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:43.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.294+0000 7fb03effd640 1 -- 172.21.15.8:0/1483152548 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03802c950 con 0x7fb0400c4210 2023-10-14T10:33:43.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.294+0000 7fb03effd640 1 -- 172.21.15.8:0/1483152548 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03802cab0 con 0x7fb0400c4210 2023-10-14T10:33:43.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.294+0000 7fb03effd640 1 -- 172.21.15.8:0/1483152548 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03802ce40 con 0x7fb0400c4210 2023-10-14T10:33:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.294+0000 7fb045db7640 1 -- 172.21.15.8:0/1483152548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0400c4210 msgr2=0x7fb0400c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.294+0000 7fb045db7640 1 --2- 172.21.15.8:0/1483152548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0400c4210 0x7fb0400c46a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb0400c9d70 tx=0x7fb03802bdb0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.295+0000 7fb045db7640 1 -- 172.21.15.8:0/1483152548 shutdown_connections 2023-10-14T10:33:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.295+0000 7fb045db7640 1 --2- 172.21.15.8:0/1483152548 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0400c4210 0x7fb0400c46a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.295+0000 7fb045db7640 1 --2- 172.21.15.8:0/1483152548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb040154a00 0x7fb040157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.295+0000 7fb045db7640 1 --2- 172.21.15.8:0/1483152548 >> v2:172.21.15.92:3300/0 conn(0x7fb040151590 0x7fb040155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.295+0000 7fb045db7640 1 -- 172.21.15.8:0/1483152548 >> 172.21.15.8:0/1483152548 conn(0x7fb040065ed0 msgr2=0x7fb0400662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:43.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.295+0000 7fb045db7640 1 -- 172.21.15.8:0/1483152548 shutdown_connections 2023-10-14T10:33:43.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.295+0000 7fb045db7640 1 -- 172.21.15.8:0/1483152548 wait complete. 2023-10-14T10:33:43.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.296+0000 7fb045db7640 1 Processor -- start 2023-10-14T10:33:43.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.297+0000 7fb045db7640 1 -- start start 2023-10-14T10:33:43.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.297+0000 7fb045db7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0400c4210 0x7fb0401ec570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.297+0000 7fb045db7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb040151590 0x7fb04014aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.297+0000 7fb045db7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb040154a00 0x7fb04014af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.297+0000 7fb045db7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400c0330 con 0x7fb040154a00 2023-10-14T10:33:43.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.297+0000 7fb045db7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400bfd50 con 0x7fb0400c4210 2023-10-14T10:33:43.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.297+0000 7fb045db7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400bf610 con 0x7fb040151590 2023-10-14T10:33:43.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.298+0000 7fb03ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb040154a00 0x7fb04014af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.298+0000 7fb03ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb040154a00 0x7fb04014af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53270/0 (socket says 172.21.15.8:53270) 2023-10-14T10:33:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.298+0000 7fb03ffff640 1 -- 172.21.15.8:0/2877351632 learned_addr learned my addr 172.21.15.8:0/2877351632 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.298+0000 7fb03f7fe640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0400c4210 0x7fb0401ec570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.298+0000 7fb037fff640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb040151590 0x7fb04014aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.298+0000 7fb03ffff640 1 -- 172.21.15.8:0/2877351632 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb040151590 msgr2=0x7fb04014aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.298+0000 7fb03ffff640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb040151590 0x7fb04014aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.298+0000 7fb03ffff640 1 -- 172.21.15.8:0/2877351632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0400c4210 msgr2=0x7fb0401ec570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.298+0000 7fb03ffff640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0400c4210 0x7fb0401ec570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.298+0000 7fb03ffff640 1 -- 172.21.15.8:0/2877351632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038009b30 con 0x7fb040154a00 2023-10-14T10:33:43.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.298+0000 7fb03f7fe640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0400c4210 0x7fb0401ec570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:43.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.299+0000 7fb03ffff640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb040154a00 0x7fb04014af80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb038036040 tx=0x7fb038004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:43.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.299+0000 7fb03cff9640 1 -- 172.21.15.8:0/2877351632 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038009510 con 0x7fb040154a00 2023-10-14T10:33:43.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.299+0000 7fb03cff9640 1 -- 172.21.15.8:0/2877351632 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03803e450 con 0x7fb040154a00 2023-10-14T10:33:43.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.299+0000 7fb03cff9640 1 -- 172.21.15.8:0/2877351632 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03803e7e0 con 0x7fb040154a00 2023-10-14T10:33:43.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.299+0000 7fb045db7640 1 -- 172.21.15.8:0/2877351632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04014b4c0 con 0x7fb040154a00 2023-10-14T10:33:43.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.299+0000 7fb045db7640 1 -- 172.21.15.8:0/2877351632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0400bffc0 con 0x7fb040154a00 2023-10-14T10:33:43.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.300+0000 7fb045db7640 1 -- 172.21.15.8:0/2877351632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb040073b50 con 0x7fb040154a00 2023-10-14T10:33:43.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.302+0000 7fb03cff9640 1 -- 172.21.15.8:0/2877351632 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fb03803e940 con 0x7fb040154a00 2023-10-14T10:33:43.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.303+0000 7fb03cff9640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb02006ade0 0x7fb02006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.303+0000 7fb03cff9640 1 -- 172.21.15.8:0/2877351632 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0380abff0 con 0x7fb040154a00 2023-10-14T10:33:43.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.303+0000 7fb03f7fe640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb02006ade0 0x7fb02006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.304+0000 7fb03f7fe640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb02006ade0 0x7fb02006d2a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb030006fd0 tx=0x7fb030008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:43.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.308+0000 7fb03cff9640 1 -- 172.21.15.8:0/2877351632 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0380774e0 con 0x7fb040154a00 2023-10-14T10:33:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.522+0000 7fb045db7640 1 -- 172.21.15.8:0/2877351632 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb04006cb50 con 0x7fb040154a00 2023-10-14T10:33:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.523+0000 7fb03cff9640 1 -- 172.21.15.8:0/2877351632 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12718 (secure 0 0 0) 0x7fb038043090 con 0x7fb040154a00 2023-10-14T10:33:43.525 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:43.525 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:43.492217+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:33:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.525+0000 7fb045db7640 1 -- 172.21.15.8:0/2877351632 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb02006ade0 msgr2=0x7fb02006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.525+0000 7fb045db7640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb02006ade0 0x7fb02006d2a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb030006fd0 tx=0x7fb030008040 comp rx=0 tx=0).stop 2023-10-14T10:33:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.525+0000 7fb045db7640 1 -- 172.21.15.8:0/2877351632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb040154a00 msgr2=0x7fb04014af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.525+0000 7fb045db7640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb040154a00 0x7fb04014af80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb038036040 tx=0x7fb038004a40 comp rx=0 tx=0).stop 2023-10-14T10:33:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.525+0000 7fb045db7640 1 -- 172.21.15.8:0/2877351632 shutdown_connections 2023-10-14T10:33:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.525+0000 7fb045db7640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb02006ade0 0x7fb02006d2a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.525+0000 7fb045db7640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb040154a00 0x7fb04014af80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.525+0000 7fb045db7640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb040151590 0x7fb04014aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.525+0000 7fb045db7640 1 --2- 172.21.15.8:0/2877351632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0400c4210 0x7fb0401ec570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.525+0000 7fb045db7640 1 -- 172.21.15.8:0/2877351632 >> 172.21.15.8:0/2877351632 conn(0x7fb040065ed0 msgr2=0x7fb0401542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.525+0000 7fb045db7640 1 -- 172.21.15.8:0/2877351632 shutdown_connections 2023-10-14T10:33:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.525+0000 7fb045db7640 1 -- 172.21.15.8:0/2877351632 wait complete. 2023-10-14T10:33:43.545 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:33:43.546 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:33:43.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.739+0000 7f82ab032640 1 Processor -- start 2023-10-14T10:33:43.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.739+0000 7f82ab032640 1 -- start start 2023-10-14T10:33:43.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.740+0000 7f82ab032640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f82a4151740 0x7f82a40c4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.741+0000 7f82ab032640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82a406c0a0 0x7f82a40c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.741+0000 7f82ab032640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a4157680 con 0x7f82a40c78f0 2023-10-14T10:33:43.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.741+0000 7f82ab032640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a4151b20 con 0x7f82a4151740 2023-10-14T10:33:43.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.741+0000 7f82ab032640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41578f0 con 0x7f82a406c0a0 2023-10-14T10:33:43.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.741+0000 7f82a95cf640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82a406c0a0 0x7f82a40c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.741+0000 7f82a8dce640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f82a4151740 0x7f82a40c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.741+0000 7f82a8dce640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f82a4151740 0x7f82a40c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:36312/0 (socket says 172.21.15.8:36312) 2023-10-14T10:33:43.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.741+0000 7f82a95cf640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82a406c0a0 0x7f82a40c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:41118/0 (socket says 172.21.15.8:41118) 2023-10-14T10:33:43.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.741+0000 7f82a8dce640 1 -- 172.21.15.8:0/3743525980 learned_addr learned my addr 172.21.15.8:0/3743525980 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:43.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.741+0000 7f82a3fff640 1 --1- 172.21.15.8:0/3743525980 >> v1:172.21.15.92:6789/0 conn(0x7f82a40c78f0 0x7f82a406b990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:47928/0 (socket says 172.21.15.8:47928) 2023-10-14T10:33:43.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.742+0000 7f82a8dce640 1 -- 172.21.15.8:0/3743525980 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82a406c0a0 msgr2=0x7f82a40c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:43.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.742+0000 7f82a8dce640 1 --2- 172.21.15.8:0/3743525980 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82a406c0a0 0x7f82a40c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.742+0000 7f82a8dce640 1 -- 172.21.15.8:0/3743525980 >> v1:172.21.15.92:6789/0 conn(0x7f82a40c78f0 legacy=0x7f82a406b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.742+0000 7f82a8dce640 1 -- 172.21.15.8:0/3743525980 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a4157bd0 con 0x7f82a4151740 2023-10-14T10:33:43.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.744+0000 7f82a8dce640 1 --2- 172.21.15.8:0/3743525980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82a4151740 0x7f82a40c4230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8298009870 tx=0x7f829802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b29d623b2ac55a75 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:43.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.744+0000 7f82a37fe640 1 -- 172.21.15.8:0/3743525980 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298030840 con 0x7f82a4151740 2023-10-14T10:33:43.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.745+0000 7f82a37fe640 1 -- 172.21.15.8:0/3743525980 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82980309a0 con 0x7f82a4151740 2023-10-14T10:33:43.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.745+0000 7f82a37fe640 1 -- 172.21.15.8:0/3743525980 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298030d30 con 0x7f82a4151740 2023-10-14T10:33:43.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.745+0000 7f82ab032640 1 -- 172.21.15.8:0/3743525980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82a4151740 msgr2=0x7f82a40c4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.745+0000 7f82ab032640 1 --2- 172.21.15.8:0/3743525980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82a4151740 0x7f82a40c4230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8298009870 tx=0x7f829802b980 comp rx=0 tx=0).stop 2023-10-14T10:33:43.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.745+0000 7f82ab032640 1 -- 172.21.15.8:0/3743525980 shutdown_connections 2023-10-14T10:33:43.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.745+0000 7f82ab032640 1 --2- 172.21.15.8:0/3743525980 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82a406c0a0 0x7f82a40c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.745+0000 7f82ab032640 1 --2- 172.21.15.8:0/3743525980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82a4151740 0x7f82a40c4230 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.745+0000 7f82ab032640 1 -- 172.21.15.8:0/3743525980 >> 172.21.15.8:0/3743525980 conn(0x7f82a40ab440 msgr2=0x7f82a40ab850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:43.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.745+0000 7f82ab032640 1 -- 172.21.15.8:0/3743525980 shutdown_connections 2023-10-14T10:33:43.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.746+0000 7f82ab032640 1 -- 172.21.15.8:0/3743525980 wait complete. 2023-10-14T10:33:43.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.747+0000 7f82ab032640 1 Processor -- start 2023-10-14T10:33:43.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.748+0000 7f82ab032640 1 -- start start 2023-10-14T10:33:43.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.748+0000 7f82ab032640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82a406c0a0 0x7f82a41501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82ab032640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82a40c78f0 0x7f82a40ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82ab032640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82a4151740 0x7f82a40aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82ab032640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40af190 con 0x7f82a406c0a0 2023-10-14T10:33:43.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82ab032640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a4156b30 con 0x7f82a40c78f0 2023-10-14T10:33:43.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82ab032640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a4155f20 con 0x7f82a4151740 2023-10-14T10:33:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82a8dce640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82a406c0a0 0x7f82a41501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82a8dce640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82a406c0a0 0x7f82a41501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53284/0 (socket says 172.21.15.8:53284) 2023-10-14T10:33:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82a8dce640 1 -- 172.21.15.8:0/3714600360 learned_addr learned my addr 172.21.15.8:0/3714600360 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82a95cf640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82a4151740 0x7f82a40aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82a3fff640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82a40c78f0 0x7f82a40ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82a8dce640 1 -- 172.21.15.8:0/3714600360 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82a4151740 msgr2=0x7f82a40aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82a8dce640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82a4151740 0x7f82a40aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82a8dce640 1 -- 172.21.15.8:0/3714600360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82a40c78f0 msgr2=0x7f82a40ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82a8dce640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82a40c78f0 0x7f82a40ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82a8dce640 1 -- 172.21.15.8:0/3714600360 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980094d0 con 0x7f82a406c0a0 2023-10-14T10:33:43.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.749+0000 7f82a3fff640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82a40c78f0 0x7f82a40ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:43.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.750+0000 7f82a8dce640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82a406c0a0 0x7f82a41501d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8298000c00 tx=0x7f8298004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:43.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.750+0000 7f82a17fa640 1 -- 172.21.15.8:0/3714600360 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298039a90 con 0x7f82a406c0a0 2023-10-14T10:33:43.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.750+0000 7f82a17fa640 1 -- 172.21.15.8:0/3714600360 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8298039bf0 con 0x7f82a406c0a0 2023-10-14T10:33:43.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.750+0000 7f82ab032640 1 -- 172.21.15.8:0/3714600360 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a4156200 con 0x7f82a406c0a0 2023-10-14T10:33:43.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.750+0000 7f82a17fa640 1 -- 172.21.15.8:0/3714600360 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298043410 con 0x7f82a406c0a0 2023-10-14T10:33:43.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.750+0000 7f82ab032640 1 -- 172.21.15.8:0/3714600360 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a41567c0 con 0x7f82a406c0a0 2023-10-14T10:33:43.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.752+0000 7f82ab032640 1 -- 172.21.15.8:0/3714600360 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a40c5700 con 0x7f82a406c0a0 2023-10-14T10:33:43.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.752+0000 7f82a17fa640 1 -- 172.21.15.8:0/3714600360 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f829802f390 con 0x7f82a406c0a0 2023-10-14T10:33:43.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.753+0000 7f82a17fa640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f828806ae10 0x7f828806d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:43.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.754+0000 7f82a17fa640 1 -- 172.21.15.8:0/3714600360 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f82980ab270 con 0x7f82a406c0a0 2023-10-14T10:33:43.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.754+0000 7f82a3fff640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f828806ae10 0x7f828806d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:43.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.755+0000 7f82a3fff640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f828806ae10 0x7f828806d2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82a414c760 tx=0x7f8290009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:43.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.758+0000 7f82a17fa640 1 -- 172.21.15.8:0/3714600360 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8298076760 con 0x7f82a406c0a0 2023-10-14T10:33:43.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.962+0000 7f82ab032640 1 -- 172.21.15.8:0/3714600360 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82a4156950 con 0x7f82a406c0a0 2023-10-14T10:33:43.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.963+0000 7f82a17fa640 1 -- 172.21.15.8:0/3714600360 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8298079d80 con 0x7f82a406c0a0 2023-10-14T10:33:43.965 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:33:43.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.965+0000 7f82ab032640 1 -- 172.21.15.8:0/3714600360 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f828806ae10 msgr2=0x7f828806d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.965+0000 7f82ab032640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f828806ae10 0x7f828806d2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82a414c760 tx=0x7f8290009040 comp rx=0 tx=0).stop 2023-10-14T10:33:43.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.965+0000 7f82ab032640 1 -- 172.21.15.8:0/3714600360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82a406c0a0 msgr2=0x7f82a41501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:43.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.965+0000 7f82ab032640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82a406c0a0 0x7f82a41501d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8298000c00 tx=0x7f8298004730 comp rx=0 tx=0).stop 2023-10-14T10:33:43.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.965+0000 7f82ab032640 1 -- 172.21.15.8:0/3714600360 shutdown_connections 2023-10-14T10:33:43.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.965+0000 7f82ab032640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f828806ae10 0x7f828806d2d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.965+0000 7f82ab032640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82a4151740 0x7f82a40aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.965+0000 7f82ab032640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82a40c78f0 0x7f82a40ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.965+0000 7f82ab032640 1 --2- 172.21.15.8:0/3714600360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82a406c0a0 0x7f82a41501d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:43.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.965+0000 7f82ab032640 1 -- 172.21.15.8:0/3714600360 >> 172.21.15.8:0/3714600360 conn(0x7f82a40ab440 msgr2=0x7f82a40c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:43.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.966+0000 7f82ab032640 1 -- 172.21.15.8:0/3714600360 shutdown_connections 2023-10-14T10:33:43.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:43.966+0000 7f82ab032640 1 -- 172.21.15.8:0/3714600360 wait complete. 2023-10-14T10:33:43.987 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T10:33:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.185+0000 7f64bc810640 1 Processor -- start 2023-10-14T10:33:44.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.185+0000 7f64bc810640 1 -- start start 2023-10-14T10:33:44.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.186+0000 7f64bc810640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f64b8155470 0x7f64b8157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:44.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.186+0000 7f64bc810640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f64b80c4210 0x7f64b80c4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:44.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.186+0000 7f64bc810640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b80ca6c0 con 0x7f64b8151590 2023-10-14T10:33:44.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.186+0000 7f64bc810640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b80c4f70 con 0x7f64b80c4210 2023-10-14T10:33:44.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.186+0000 7f64bc810640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b8157a10 con 0x7f64b8155470 2023-10-14T10:33:44.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.186+0000 7f64b6d9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f64b80c4210 0x7f64b80c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:44.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.186+0000 7f64b6d9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f64b80c4210 0x7f64b80c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53292/0 (socket says 172.21.15.8:53292) 2023-10-14T10:33:44.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.186+0000 7f64b6d9d640 1 -- 172.21.15.8:0/3981503416 learned_addr learned my addr 172.21.15.8:0/3981503416 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:44.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.187+0000 7f64b6d9d640 1 -- 172.21.15.8:0/3981503416 >> v2:172.21.15.92:3300/0 conn(0x7f64b8155470 msgr2=0x7f64b8157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.187+0000 7f64b5d9b640 1 --2- 172.21.15.8:0/3981503416 >> v2:172.21.15.92:3300/0 conn(0x7f64b8155470 0x7f64b8157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.187+0000 7f64b6d9d640 1 --2- 172.21.15.8:0/3981503416 >> v2:172.21.15.92:3300/0 conn(0x7f64b8155470 0x7f64b8157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.187+0000 7f64b6d9d640 1 -- 172.21.15.8:0/3981503416 >> v1:172.21.15.92:6789/0 conn(0x7f64b8151590 legacy=0x7f64b8154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.187+0000 7f64b6d9d640 1 -- 172.21.15.8:0/3981503416 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b81558b0 con 0x7f64b80c4210 2023-10-14T10:33:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.187+0000 7f64b5d9b640 1 --2- 172.21.15.8:0/3981503416 >> v2:172.21.15.92:3300/0 conn(0x7f64b8155470 0x7f64b8157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.188+0000 7f64b6d9d640 1 --2- 172.21.15.8:0/3981503416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b80c4210 0x7f64b80c4640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f64b80c07c0 tx=0x7f64b002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad37e123aa9bc45 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.188+0000 7f64b559a640 1 -- 172.21.15.8:0/3981503416 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b002c960 con 0x7f64b80c4210 2023-10-14T10:33:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.188+0000 7f64b559a640 1 -- 172.21.15.8:0/3981503416 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b002cac0 con 0x7f64b80c4210 2023-10-14T10:33:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.188+0000 7f64b559a640 1 -- 172.21.15.8:0/3981503416 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b002ce50 con 0x7f64b80c4210 2023-10-14T10:33:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.189+0000 7f64bc810640 1 -- 172.21.15.8:0/3981503416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b80c4210 msgr2=0x7f64b80c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.189+0000 7f64bc810640 1 --2- 172.21.15.8:0/3981503416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b80c4210 0x7f64b80c4640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f64b80c07c0 tx=0x7f64b002bdc0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.189+0000 7f64bc810640 1 -- 172.21.15.8:0/3981503416 shutdown_connections 2023-10-14T10:33:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.189+0000 7f64bc810640 1 --2- 172.21.15.8:0/3981503416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b80c4210 0x7f64b80c4640 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.189+0000 7f64bc810640 1 --2- 172.21.15.8:0/3981503416 >> v2:172.21.15.92:3300/0 conn(0x7f64b8155470 0x7f64b8157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.189+0000 7f64bc810640 1 -- 172.21.15.8:0/3981503416 >> 172.21.15.8:0/3981503416 conn(0x7f64b8065ed0 msgr2=0x7f64b80662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.189+0000 7f64bc810640 1 -- 172.21.15.8:0/3981503416 shutdown_connections 2023-10-14T10:33:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.189+0000 7f64bc810640 1 -- 172.21.15.8:0/3981503416 wait complete. 2023-10-14T10:33:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.191+0000 7f64bc810640 1 Processor -- start 2023-10-14T10:33:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.191+0000 7f64bc810640 1 -- start start 2023-10-14T10:33:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.192+0000 7f64bc810640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64b80c4210 0x7f64b8148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.192+0000 7f64bc810640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b8151590 0x7f64b8148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.192+0000 7f64bc810640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b8155470 0x7f64b81521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.192+0000 7f64bc810640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b8149480 con 0x7f64b8151590 2023-10-14T10:33:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.192+0000 7f64bc810640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b81e9e80 con 0x7f64b8155470 2023-10-14T10:33:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.192+0000 7f64bc810640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80aa5b0 con 0x7f64b80c4210 2023-10-14T10:33:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.192+0000 7f64b5d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b8151590 0x7f64b8148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.192+0000 7f64b5d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b8151590 0x7f64b8148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53298/0 (socket says 172.21.15.8:53298) 2023-10-14T10:33:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.192+0000 7f64b5d9b640 1 -- 172.21.15.8:0/1498785083 learned_addr learned my addr 172.21.15.8:0/1498785083 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.193+0000 7f64b5d9b640 1 -- 172.21.15.8:0/1498785083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64b80c4210 msgr2=0x7f64b8148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.193+0000 7f64b5d9b640 1 --2- 172.21.15.8:0/1498785083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64b80c4210 0x7f64b8148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.193+0000 7f64b5d9b640 1 -- 172.21.15.8:0/1498785083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b8155470 msgr2=0x7f64b81521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.193+0000 7f64b5d9b640 1 --2- 172.21.15.8:0/1498785083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b8155470 0x7f64b81521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.193+0000 7f64b5d9b640 1 -- 172.21.15.8:0/1498785083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b0009b30 con 0x7f64b8151590 2023-10-14T10:33:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.193+0000 7f64b5d9b640 1 --2- 172.21.15.8:0/1498785083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b8151590 0x7f64b8148b80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00c7f0 tx=0x7f64ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.193+0000 7f64a6ffd640 1 -- 172.21.15.8:0/1498785083 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac007820 con 0x7f64b8151590 2023-10-14T10:33:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.193+0000 7f64a6ffd640 1 -- 172.21.15.8:0/1498785083 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac007980 con 0x7f64b8151590 2023-10-14T10:33:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.193+0000 7f64bc810640 1 -- 172.21.15.8:0/1498785083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b8151e80 con 0x7f64b8151590 2023-10-14T10:33:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.193+0000 7f64a6ffd640 1 -- 172.21.15.8:0/1498785083 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac007cf0 con 0x7f64b8151590 2023-10-14T10:33:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.193+0000 7f64bc810640 1 -- 172.21.15.8:0/1498785083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b81e9ba0 con 0x7f64b8151590 2023-10-14T10:33:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.195+0000 7f64bc810640 1 -- 172.21.15.8:0/1498785083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b81e9a00 con 0x7f64b8151590 2023-10-14T10:33:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.196+0000 7f64a6ffd640 1 -- 172.21.15.8:0/1498785083 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f64ac0113f0 con 0x7f64b8151590 2023-10-14T10:33:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.198+0000 7f64a6ffd640 1 --2- 172.21.15.8:0/1498785083 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f649806ade0 0x7f649806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.198+0000 7f64a6ffd640 1 -- 172.21.15.8:0/1498785083 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f64ac089460 con 0x7f64b8151590 2023-10-14T10:33:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.198+0000 7f64b659c640 1 --2- 172.21.15.8:0/1498785083 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f649806ade0 0x7f649806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:44.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.199+0000 7f64b659c640 1 --2- 172.21.15.8:0/1498785083 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f649806ade0 0x7f649806d2a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f64a8006fd0 tx=0x7f64a8006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:44.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.202+0000 7f64a6ffd640 1 -- 172.21.15.8:0/1498785083 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f64b81e9a00 con 0x7f64b8151590 2023-10-14T10:33:44.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.399+0000 7f64bc810640 1 -- 172.21.15.8:0/1498785083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f64b81e9a00 con 0x7f64b8151590 2023-10-14T10:33:44.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.399+0000 7f64a6ffd640 1 -- 172.21.15.8:0/1498785083 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f64b81e9a00 con 0x7f64b8151590 2023-10-14T10:33:44.402 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:44.402 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2023-10-14T10:33:44.402 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:33:44.402 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2023-10-14T10:33:44.403 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2023-10-14T10:33:44.403 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:33:44.403 INFO:teuthology.orchestra.run.smithi008.stdout:] 2023-10-14T10:33:44.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.402+0000 7f64bc810640 1 -- 172.21.15.8:0/1498785083 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f649806ade0 msgr2=0x7f649806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:44.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.402+0000 7f64bc810640 1 --2- 172.21.15.8:0/1498785083 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f649806ade0 0x7f649806d2a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f64a8006fd0 tx=0x7f64a8006bc0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.402+0000 7f64bc810640 1 -- 172.21.15.8:0/1498785083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b8151590 msgr2=0x7f64b8148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:44.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.402+0000 7f64bc810640 1 --2- 172.21.15.8:0/1498785083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b8151590 0x7f64b8148b80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00c7f0 tx=0x7f64ac00ccb0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.402+0000 7f64bc810640 1 -- 172.21.15.8:0/1498785083 shutdown_connections 2023-10-14T10:33:44.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.402+0000 7f64bc810640 1 --2- 172.21.15.8:0/1498785083 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f649806ade0 0x7f649806d2a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.402+0000 7f64bc810640 1 --2- 172.21.15.8:0/1498785083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b8155470 0x7f64b81521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.402+0000 7f64bc810640 1 --2- 172.21.15.8:0/1498785083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b8151590 0x7f64b8148b80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.402+0000 7f64bc810640 1 --2- 172.21.15.8:0/1498785083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64b80c4210 0x7f64b8148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.402+0000 7f64bc810640 1 -- 172.21.15.8:0/1498785083 >> 172.21.15.8:0/1498785083 conn(0x7f64b8065ed0 msgr2=0x7f64b814b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:44.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.403+0000 7f64bc810640 1 -- 172.21.15.8:0/1498785083 shutdown_connections 2023-10-14T10:33:44.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.403+0000 7f64bc810640 1 -- 172.21.15.8:0/1498785083 wait complete. 2023-10-14T10:33:44.422 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T10:33:44.422 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T10:33:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.648+0000 7f7a63d5e640 1 Processor -- start 2023-10-14T10:33:44.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.648+0000 7f7a63d5e640 1 -- start start 2023-10-14T10:33:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.649+0000 7f7a63d5e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7a5c1540b0 0x7f7a5c0c7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.649+0000 7f7a63d5e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a5c06c310 0x7f7a5c0c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.650+0000 7f7a63d5e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5c06be80 con 0x7f7a5c1515a0 2023-10-14T10:33:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.650+0000 7f7a63d5e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c0c5320 con 0x7f7a5c1540b0 2023-10-14T10:33:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.650+0000 7f7a63d5e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0c6950 con 0x7f7a5c06c310 2023-10-14T10:33:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.650+0000 7f7a622fb640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a5c06c310 0x7f7a5c0c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.650+0000 7f7a61afa640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f7a5c1515a0 0x7f7a5c0c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:47942/0 (socket says 172.21.15.8:47942) 2023-10-14T10:33:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.650+0000 7f7a61afa640 1 -- 172.21.15.8:0/2477075845 learned_addr learned my addr 172.21.15.8:0/2477075845 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.650+0000 7f7a612f9640 1 --2- 172.21.15.8:0/2477075845 >> v2:172.21.15.92:3300/0 conn(0x7f7a5c1540b0 0x7f7a5c0c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:44.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.651+0000 7f7a612f9640 1 -- 172.21.15.8:0/2477075845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a5c06c310 msgr2=0x7f7a5c0c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:44.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.651+0000 7f7a612f9640 1 --2- 172.21.15.8:0/2477075845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a5c06c310 0x7f7a5c0c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.651+0000 7f7a612f9640 1 -- 172.21.15.8:0/2477075845 >> v1:172.21.15.92:6789/0 conn(0x7f7a5c1515a0 legacy=0x7f7a5c0c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:44.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.651+0000 7f7a612f9640 1 -- 172.21.15.8:0/2477075845 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0c6b40 con 0x7f7a5c1540b0 2023-10-14T10:33:44.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.652+0000 7f7a612f9640 1 --2- 172.21.15.8:0/2477075845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a5c1540b0 0x7f7a5c0c7950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0097d0 tx=0x7f7a4c02b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2973aa462bb935f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.653+0000 7f7a60af8640 1 -- 172.21.15.8:0/2477075845 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c031770 con 0x7f7a5c1540b0 2023-10-14T10:33:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.653+0000 7f7a60af8640 1 -- 172.21.15.8:0/2477075845 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c0318d0 con 0x7f7a5c1540b0 2023-10-14T10:33:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.653+0000 7f7a60af8640 1 -- 172.21.15.8:0/2477075845 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c031c60 con 0x7f7a5c1540b0 2023-10-14T10:33:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.653+0000 7f7a63d5e640 1 -- 172.21.15.8:0/2477075845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a5c1540b0 msgr2=0x7f7a5c0c7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.653+0000 7f7a63d5e640 1 --2- 172.21.15.8:0/2477075845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a5c1540b0 0x7f7a5c0c7950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0097d0 tx=0x7f7a4c02b810 comp rx=0 tx=0).stop 2023-10-14T10:33:44.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.653+0000 7f7a63d5e640 1 -- 172.21.15.8:0/2477075845 shutdown_connections 2023-10-14T10:33:44.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.653+0000 7f7a63d5e640 1 --2- 172.21.15.8:0/2477075845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a5c06c310 0x7f7a5c0c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.653+0000 7f7a63d5e640 1 --2- 172.21.15.8:0/2477075845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a5c1540b0 0x7f7a5c0c7950 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.653+0000 7f7a63d5e640 1 -- 172.21.15.8:0/2477075845 >> 172.21.15.8:0/2477075845 conn(0x7f7a5c0ab3c0 msgr2=0x7f7a5c0ab7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:44.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.654+0000 7f7a63d5e640 1 -- 172.21.15.8:0/2477075845 shutdown_connections 2023-10-14T10:33:44.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.654+0000 7f7a63d5e640 1 -- 172.21.15.8:0/2477075845 wait complete. 2023-10-14T10:33:44.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.655+0000 7f7a63d5e640 1 Processor -- start 2023-10-14T10:33:44.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.656+0000 7f7a63d5e640 1 -- start start 2023-10-14T10:33:44.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.657+0000 7f7a63d5e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a5c06c310 0x7f7a5c0c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:44.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.657+0000 7f7a63d5e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c1515a0 0x7f7a5c14e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:44.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.657+0000 7f7a63d5e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a5c1540b0 0x7f7a5c0c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:44.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.657+0000 7f7a63d5e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0c9be0 con 0x7f7a5c1515a0 2023-10-14T10:33:44.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.657+0000 7f7a63d5e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c14e740 con 0x7f7a5c06c310 2023-10-14T10:33:44.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.657+0000 7f7a63d5e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0c3770 con 0x7f7a5c1540b0 2023-10-14T10:33:44.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.657+0000 7f7a612f9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c1515a0 0x7f7a5c14e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:44.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.657+0000 7f7a612f9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c1515a0 0x7f7a5c14e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53312/0 (socket says 172.21.15.8:53312) 2023-10-14T10:33:44.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.657+0000 7f7a612f9640 1 -- 172.21.15.8:0/1494526693 learned_addr learned my addr 172.21.15.8:0/1494526693 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:44.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.657+0000 7f7a622fb640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a5c1540b0 0x7f7a5c0c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:44.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.657+0000 7f7a61afa640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a5c06c310 0x7f7a5c0c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:44.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.658+0000 7f7a612f9640 1 -- 172.21.15.8:0/1494526693 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a5c1540b0 msgr2=0x7f7a5c0c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:44.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.658+0000 7f7a612f9640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a5c1540b0 0x7f7a5c0c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.658+0000 7f7a612f9640 1 -- 172.21.15.8:0/1494526693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a5c06c310 msgr2=0x7f7a5c0c12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:44.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.658+0000 7f7a612f9640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a5c06c310 0x7f7a5c0c12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:44.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.658+0000 7f7a612f9640 1 -- 172.21.15.8:0/1494526693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c009400 con 0x7f7a5c1515a0 2023-10-14T10:33:44.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.658+0000 7f7a612f9640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c1515a0 0x7f7a5c14e200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c034040 tx=0x7f7a4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:44.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.658+0000 7f7a527fc640 1 -- 172.21.15.8:0/1494526693 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c032810 con 0x7f7a5c1515a0 2023-10-14T10:33:44.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.658+0000 7f7a527fc640 1 -- 172.21.15.8:0/1494526693 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c032990 con 0x7f7a5c1515a0 2023-10-14T10:33:44.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.658+0000 7f7a527fc640 1 -- 172.21.15.8:0/1494526693 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c032d40 con 0x7f7a5c1515a0 2023-10-14T10:33:44.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.658+0000 7f7a63d5e640 1 -- 172.21.15.8:0/1494526693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c0c2b60 con 0x7f7a5c1515a0 2023-10-14T10:33:44.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.658+0000 7f7a63d5e640 1 -- 172.21.15.8:0/1494526693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c0c3120 con 0x7f7a5c1515a0 2023-10-14T10:33:44.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.660+0000 7f7a63d5e640 1 -- 172.21.15.8:0/1494526693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c0c3900 con 0x7f7a5c1515a0 2023-10-14T10:33:44.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.660+0000 7f7a527fc640 1 -- 172.21.15.8:0/1494526693 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f7a4c04e440 con 0x7f7a5c1515a0 2023-10-14T10:33:44.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.661+0000 7f7a527fc640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7a4006ade0 0x7f7a4006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:44.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.661+0000 7f7a527fc640 1 -- 172.21.15.8:0/1494526693 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a4c0aaf50 con 0x7f7a5c1515a0 2023-10-14T10:33:44.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.662+0000 7f7a61afa640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7a4006ade0 0x7f7a4006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:44.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.662+0000 7f7a61afa640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7a4006ade0 0x7f7a4006d2a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7a58005c00 tx=0x7f7a58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:44.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.666+0000 7f7a527fc640 1 -- 172.21.15.8:0/1494526693 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a4c076670 con 0x7f7a5c1515a0 2023-10-14T10:33:44.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:44.861+0000 7f7a63d5e640 1 -- 172.21.15.8:0/1494526693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7a5c073b50 con 0x7f7a5c1515a0 2023-10-14T10:33:45.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.888+0000 7f7a527fc640 1 -- 172.21.15.8:0/1494526693 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7a4c079c90 con 0x7f7a5c1515a0 2023-10-14T10:33:45.890 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2023-10-14T10:33:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.891+0000 7f7a63d5e640 1 -- 172.21.15.8:0/1494526693 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7a4006ade0 msgr2=0x7f7a4006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:45.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.891+0000 7f7a63d5e640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7a4006ade0 0x7f7a4006d2a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7a58005c00 tx=0x7f7a58009040 comp rx=0 tx=0).stop 2023-10-14T10:33:45.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.891+0000 7f7a63d5e640 1 -- 172.21.15.8:0/1494526693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c1515a0 msgr2=0x7f7a5c14e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:45.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.891+0000 7f7a63d5e640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c1515a0 0x7f7a5c14e200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c034040 tx=0x7f7a4c0046c0 comp rx=0 tx=0).stop 2023-10-14T10:33:45.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.891+0000 7f7a63d5e640 1 -- 172.21.15.8:0/1494526693 shutdown_connections 2023-10-14T10:33:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.891+0000 7f7a63d5e640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7a4006ade0 0x7f7a4006d2a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.891+0000 7f7a63d5e640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a5c1540b0 0x7f7a5c0c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.891+0000 7f7a63d5e640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a5c1515a0 0x7f7a5c14e200 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.891+0000 7f7a63d5e640 1 --2- 172.21.15.8:0/1494526693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a5c06c310 0x7f7a5c0c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:45.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.891+0000 7f7a63d5e640 1 -- 172.21.15.8:0/1494526693 >> 172.21.15.8:0/1494526693 conn(0x7f7a5c0ab3c0 msgr2=0x7f7a5c0a9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:45.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.892+0000 7f7a63d5e640 1 -- 172.21.15.8:0/1494526693 shutdown_connections 2023-10-14T10:33:45.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:45.892+0000 7f7a63d5e640 1 -- 172.21.15.8:0/1494526693 wait complete. 2023-10-14T10:33:45.923 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T10:33:46.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.121+0000 7f4869a9a640 1 Processor -- start 2023-10-14T10:33:46.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.121+0000 7f4869a9a640 1 -- start start 2023-10-14T10:33:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.123+0000 7f4869a9a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4864139470 0x7f4864154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.123+0000 7f4869a9a640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48641550e0 con 0x7f4864152090 2023-10-14T10:33:46.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.123+0000 7f4869a9a640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4864139850 con 0x7f486406b740 2023-10-14T10:33:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.123+0000 7f4869a9a640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4864151190 con 0x7f4864139470 2023-10-14T10:33:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.124+0000 7f4863fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4864152090 0x7f48641515b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53152/0 (socket says 172.21.15.8:53152) 2023-10-14T10:33:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.124+0000 7f4863fff640 1 -- 172.21.15.8:0/2724121465 learned_addr learned my addr 172.21.15.8:0/2724121465 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.124+0000 7f4868a98640 1 --2- 172.21.15.8:0/2724121465 >> v2:172.21.15.8:3300/0 conn(0x7f4864139470 0x7f4864154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.124+0000 7f4868a98640 1 -- 172.21.15.8:0/2724121465 >> v1:172.21.15.92:6789/0 conn(0x7f486406b740 legacy=0x7f486415b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.124+0000 7f4868a98640 1 -- 172.21.15.8:0/2724121465 >> v1:172.21.15.8:6789/0 conn(0x7f4864152090 legacy=0x7f48641515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.124+0000 7f4868a98640 1 -- 172.21.15.8:0/2724121465 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864139e10 con 0x7f4864139470 2023-10-14T10:33:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.125+0000 7f4868a98640 1 --2- 172.21.15.8:0/2724121465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4864139470 0x7f4864154ba0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f48580097a0 tx=0x7f485802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25aa0d76e848f86 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.126+0000 7f48637fe640 1 -- 172.21.15.8:0/2724121465 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485802e070 con 0x7f4864139470 2023-10-14T10:33:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.126+0000 7f48637fe640 1 -- 172.21.15.8:0/2724121465 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48580315a0 con 0x7f4864139470 2023-10-14T10:33:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.126+0000 7f48637fe640 1 -- 172.21.15.8:0/2724121465 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858031930 con 0x7f4864139470 2023-10-14T10:33:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.126+0000 7f4869a9a640 1 -- 172.21.15.8:0/2724121465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4864139470 msgr2=0x7f4864154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.126+0000 7f4869a9a640 1 --2- 172.21.15.8:0/2724121465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4864139470 0x7f4864154ba0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f48580097a0 tx=0x7f485802b840 comp rx=0 tx=0).stop 2023-10-14T10:33:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.126+0000 7f4869a9a640 1 -- 172.21.15.8:0/2724121465 shutdown_connections 2023-10-14T10:33:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.126+0000 7f4869a9a640 1 --2- 172.21.15.8:0/2724121465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4864139470 0x7f4864154ba0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.126+0000 7f4869a9a640 1 -- 172.21.15.8:0/2724121465 >> 172.21.15.8:0/2724121465 conn(0x7f48640c1d70 msgr2=0x7f48640c2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.126+0000 7f4869a9a640 1 -- 172.21.15.8:0/2724121465 shutdown_connections 2023-10-14T10:33:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.126+0000 7f4869a9a640 1 -- 172.21.15.8:0/2724121465 wait complete. 2023-10-14T10:33:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.128+0000 7f4869a9a640 1 Processor -- start 2023-10-14T10:33:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.128+0000 7f4869a9a640 1 -- start start 2023-10-14T10:33:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.129+0000 7f4869a9a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f486406b740 0x7f486414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:46.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.129+0000 7f4869a9a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4864139470 0x7f48640aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.129+0000 7f4869a9a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4864152090 0x7f486414d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.129+0000 7f4869a9a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48640c34d0 con 0x7f4864139470 2023-10-14T10:33:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.129+0000 7f4869a9a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48641ecf50 con 0x7f4864152090 2023-10-14T10:33:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.129+0000 7f4869a9a640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48641ed230 con 0x7f486406b740 2023-10-14T10:33:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.130+0000 7f4863fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4864139470 0x7f48640aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.130+0000 7f4863fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4864139470 0x7f48640aa750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53330/0 (socket says 172.21.15.8:53330) 2023-10-14T10:33:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.130+0000 7f4863fff640 1 -- 172.21.15.8:0/2773974789 learned_addr learned my addr 172.21.15.8:0/2773974789 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.130+0000 7f4869299640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4864152090 0x7f486414d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.130+0000 7f4863fff640 1 -- 172.21.15.8:0/2773974789 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f486406b740 msgr2=0x7f486414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.130+0000 7f4863fff640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f486406b740 0x7f486414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.130+0000 7f4863fff640 1 -- 172.21.15.8:0/2773974789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4864152090 msgr2=0x7f486414d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.130+0000 7f4863fff640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4864152090 0x7f486414d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.130+0000 7f4863fff640 1 -- 172.21.15.8:0/2773974789 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4858009400 con 0x7f4864139470 2023-10-14T10:33:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.130+0000 7f4863fff640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4864139470 0x7f48640aa750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f485000c480 tx=0x7f485000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.131+0000 7f48617fa640 1 -- 172.21.15.8:0/2773974789 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850005ce0 con 0x7f4864139470 2023-10-14T10:33:46.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.131+0000 7f48617fa640 1 -- 172.21.15.8:0/2773974789 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4850005e40 con 0x7f4864139470 2023-10-14T10:33:46.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.131+0000 7f48617fa640 1 -- 172.21.15.8:0/2773974789 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48500072f0 con 0x7f4864139470 2023-10-14T10:33:46.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.131+0000 7f4869a9a640 1 -- 172.21.15.8:0/2773974789 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48641ed510 con 0x7f4864139470 2023-10-14T10:33:46.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.131+0000 7f4869a9a640 1 -- 172.21.15.8:0/2773974789 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486414e2f0 con 0x7f4864139470 2023-10-14T10:33:46.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.132+0000 7f4869a9a640 1 -- 172.21.15.8:0/2773974789 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486404e9b0 con 0x7f4864139470 2023-10-14T10:33:46.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.133+0000 7f48617fa640 1 -- 172.21.15.8:0/2773974789 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4850007510 con 0x7f4864139470 2023-10-14T10:33:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.134+0000 7f48617fa640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f484806ae70 0x7f484806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.134+0000 7f48617fa640 1 -- 172.21.15.8:0/2773974789 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4850088960 con 0x7f4864139470 2023-10-14T10:33:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.134+0000 7f4868a98640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f484806ae70 0x7f484806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.135+0000 7f4868a98640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f484806ae70 0x7f484806d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4858036000 tx=0x7f4858030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:46.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.139+0000 7f48617fa640 1 -- 172.21.15.8:0/2773974789 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4850053c90 con 0x7f4864139470 2023-10-14T10:33:46.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.340+0000 7f4869a9a640 1 -- 172.21.15.8:0/2773974789 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f48640c0d50 con 0x7f4864139470 2023-10-14T10:33:46.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.904+0000 7f48617fa640 1 -- 172.21.15.8:0/2773974789 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4850017020 con 0x7f4864139470 2023-10-14T10:33:46.907 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2023-10-14T10:33:46.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.910+0000 7f4869a9a640 1 -- 172.21.15.8:0/2773974789 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f484806ae70 msgr2=0x7f484806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:46.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.910+0000 7f4869a9a640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f484806ae70 0x7f484806d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4858036000 tx=0x7f4858030000 comp rx=0 tx=0).stop 2023-10-14T10:33:46.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.910+0000 7f4869a9a640 1 -- 172.21.15.8:0/2773974789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4864139470 msgr2=0x7f48640aa750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:46.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.910+0000 7f4869a9a640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4864139470 0x7f48640aa750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f485000c480 tx=0x7f485000c940 comp rx=0 tx=0).stop 2023-10-14T10:33:46.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.912+0000 7f4869a9a640 1 -- 172.21.15.8:0/2773974789 shutdown_connections 2023-10-14T10:33:46.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.912+0000 7f4869a9a640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f484806ae70 0x7f484806d330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:46.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.912+0000 7f4869a9a640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4864152090 0x7f486414d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:46.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.912+0000 7f4869a9a640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4864139470 0x7f48640aa750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:46.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.912+0000 7f4869a9a640 1 --2- 172.21.15.8:0/2773974789 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f486406b740 0x7f486414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:46.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.912+0000 7f4869a9a640 1 -- 172.21.15.8:0/2773974789 >> 172.21.15.8:0/2773974789 conn(0x7f48640c1d70 msgr2=0x7f4864150280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:46.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.913+0000 7f4869a9a640 1 -- 172.21.15.8:0/2773974789 shutdown_connections 2023-10-14T10:33:46.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:46.914+0000 7f4869a9a640 1 -- 172.21.15.8:0/2773974789 wait complete. 2023-10-14T10:33:46.949 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T10:33:47.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.142+0000 7f627ac52640 1 Processor -- start 2023-10-14T10:33:47.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.142+0000 7f627ac52640 1 -- start start 2023-10-14T10:33:47.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.143+0000 7f627ac52640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62740aa690 0x7f62740bff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:47.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.143+0000 7f627ac52640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6274157cf0 0x7f6274158180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:47.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.143+0000 7f627ac52640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62740bfc30 con 0x7f62741540b0 2023-10-14T10:33:47.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.144+0000 7f627ac52640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62740bf370 con 0x7f6274157cf0 2023-10-14T10:33:47.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.144+0000 7f627ac52640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62740bf670 con 0x7f62740aa690 2023-10-14T10:33:47.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.144+0000 7f6273fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f62741540b0 0x7f62740c57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34326/0 (socket says 172.21.15.8:34326) 2023-10-14T10:33:47.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.144+0000 7f6273fff640 1 -- 172.21.15.8:0/1380052783 learned_addr learned my addr 172.21.15.8:0/1380052783 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:47.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.144+0000 7f62789ee640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62740aa690 0x7f62740bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:47.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.144+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127782382 0 0) 0x7f62740bfc30 con 0x7f62741540b0 2023-10-14T10:33:47.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.144+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6264003520 con 0x7f62741540b0 2023-10-14T10:33:47.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.144+0000 7f62791ef640 1 --2- 172.21.15.8:0/1380052783 >> v2:172.21.15.92:3300/0 conn(0x7f6274157cf0 0x7f6274158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:47.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 223001502 0 0) 0x7f6264003520 con 0x7f62741540b0 2023-10-14T10:33:47.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62740aa690 msgr2=0x7f62740bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:47.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62740aa690 0x7f62740bff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:47.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 >> v2:172.21.15.92:3300/0 conn(0x7f6274157cf0 msgr2=0x7f6274158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:47.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 --2- 172.21.15.8:0/1380052783 >> v2:172.21.15.92:3300/0 conn(0x7f6274157cf0 0x7f6274158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:47.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62740bf950 con 0x7f62741540b0 2023-10-14T10:33:47.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f6260001670 con 0x7f62741540b0 2023-10-14T10:33:47.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 >> v1:172.21.15.8:6789/0 conn(0x7f62741540b0 legacy=0x7f62740c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:47.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6264003970 0x7f6264003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:47.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62740aa690 0x7f62640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:47.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6264004d00 0x7f6264005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:47.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740bf370 con 0x7f6264004d00 2023-10-14T10:33:47.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740bf670 con 0x7f6264003970 2023-10-14T10:33:47.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626400ba00 con 0x7f62740aa690 2023-10-14T10:33:47.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62791ef640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6264004d00 0x7f6264005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:47.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f6273fff640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62740aa690 0x7f62640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:47.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.145+0000 7f62791ef640 1 -- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62740aa690 msgr2=0x7f62640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:47.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.146+0000 7f62789ee640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6264003970 0x7f6264003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:47.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.146+0000 7f62791ef640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62740aa690 0x7f62640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:47.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.146+0000 7f62791ef640 1 -- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6264003970 msgr2=0x7f6264003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:47.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.146+0000 7f62791ef640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6264003970 0x7f6264003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:47.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.146+0000 7f62791ef640 1 -- 172.21.15.8:0/1380052783 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6264003520 con 0x7f6264004d00 2023-10-14T10:33:47.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.146+0000 7f6273fff640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62740aa690 0x7f62640047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:47.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.146+0000 7f62789ee640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6264003970 0x7f6264003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:47.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.147+0000 7f62791ef640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6264004d00 0x7f6264005180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f626c009fc0 tx=0x7f62640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4534d048080fb15 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:47.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.147+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c02cc60 con 0x7f6264004d00 2023-10-14T10:33:47.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.147+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c00f040 con 0x7f6264004d00 2023-10-14T10:33:47.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.147+0000 7f62737fe640 1 -- 172.21.15.8:0/1380052783 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c034440 con 0x7f6264004d00 2023-10-14T10:33:47.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.147+0000 7f627ac52640 1 -- 172.21.15.8:0/1380052783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6264004d00 msgr2=0x7f6264005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:47.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.147+0000 7f627ac52640 1 --2- 172.21.15.8:0/1380052783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6264004d00 0x7f6264005180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f626c009fc0 tx=0x7f62640057f0 comp rx=0 tx=0).stop 2023-10-14T10:33:47.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.147+0000 7f62791ef640 1 -- 172.21.15.8:0/1380052783 reap_dead start 2023-10-14T10:33:47.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.148+0000 7f627ac52640 1 -- 172.21.15.8:0/1380052783 shutdown_connections 2023-10-14T10:33:47.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.148+0000 7f627ac52640 1 -- 172.21.15.8:0/1380052783 >> 172.21.15.8:0/1380052783 conn(0x7f62740a74d0 msgr2=0x7f62740a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:47.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.148+0000 7f627ac52640 1 -- 172.21.15.8:0/1380052783 shutdown_connections 2023-10-14T10:33:47.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.148+0000 7f627ac52640 1 -- 172.21.15.8:0/1380052783 wait complete. 2023-10-14T10:33:47.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.149+0000 7f627ac52640 1 Processor -- start 2023-10-14T10:33:47.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.150+0000 7f627ac52640 1 -- start start 2023-10-14T10:33:47.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.150+0000 7f627ac52640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6264004d00 0x7f62741ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:47.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.150+0000 7f627ac52640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6274071630 0x7f62741e9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:47.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f627ac52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f627411eca0 0x7f627406a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:47.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f627ac52640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62741211f0 con 0x7f6264004d00 2023-10-14T10:33:47.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f627ac52640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740721e0 con 0x7f627411eca0 2023-10-14T10:33:47.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f627ac52640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62741eda30 con 0x7f6274071630 2023-10-14T10:33:47.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f62789ee640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6264004d00 0x7f62741ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:47.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f62789ee640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6264004d00 0x7f62741ed4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46726/0 (socket says 172.21.15.8:46726) 2023-10-14T10:33:47.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f62789ee640 1 -- 172.21.15.8:0/2649257448 learned_addr learned my addr 172.21.15.8:0/2649257448 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:47.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f62789ee640 1 -- 172.21.15.8:0/2649257448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6274071630 msgr2=0x7f62741e9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:47.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f62789ee640 1 --2- 172.21.15.8:0/2649257448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6274071630 0x7f62741e9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:47.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f62789ee640 1 -- 172.21.15.8:0/2649257448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f627411eca0 msgr2=0x7f627406a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:47.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f62789ee640 1 --2- 172.21.15.8:0/2649257448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f627411eca0 0x7f627406a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:47.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f62789ee640 1 -- 172.21.15.8:0/2649257448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62740a9de0 con 0x7f6264004d00 2023-10-14T10:33:47.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.151+0000 7f62789ee640 1 --2- 172.21.15.8:0/2649257448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6264004d00 0x7f62741ed4f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62680108b0 tx=0x7f6268010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:47.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.152+0000 7f62717fa640 1 -- 172.21.15.8:0/2649257448 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800ea80 con 0x7f6264004d00 2023-10-14T10:33:47.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.152+0000 7f62717fa640 1 -- 172.21.15.8:0/2649257448 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626800ebe0 con 0x7f6264004d00 2023-10-14T10:33:47.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.152+0000 7f62717fa640 1 -- 172.21.15.8:0/2649257448 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626801c400 con 0x7f6264004d00 2023-10-14T10:33:47.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.152+0000 7f627ac52640 1 -- 172.21.15.8:0/2649257448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62741ea510 con 0x7f6264004d00 2023-10-14T10:33:47.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.152+0000 7f627ac52640 1 -- 172.21.15.8:0/2649257448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6274071f00 con 0x7f6264004d00 2023-10-14T10:33:47.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.153+0000 7f627ac52640 1 -- 172.21.15.8:0/2649257448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6274152980 con 0x7f6264004d00 2023-10-14T10:33:47.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.154+0000 7f62717fa640 1 -- 172.21.15.8:0/2649257448 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f626801c560 con 0x7f6264004d00 2023-10-14T10:33:47.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.155+0000 7f62717fa640 1 --2- 172.21.15.8:0/2649257448 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f625806aea0 0x7f625806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:47.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.155+0000 7f62717fa640 1 -- 172.21.15.8:0/2649257448 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f6268089a80 con 0x7f6264004d00 2023-10-14T10:33:47.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.155+0000 7f6273fff640 1 --2- 172.21.15.8:0/2649257448 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f625806aea0 0x7f625806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:47.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.156+0000 7f6273fff640 1 --2- 172.21.15.8:0/2649257448 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f625806aea0 0x7f625806d360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6260001200 tx=0x7f6260009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:47.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.160+0000 7f62717fa640 1 -- 172.21.15.8:0/2649257448 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6268054c30 con 0x7f6264004d00 2023-10-14T10:33:47.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.395+0000 7f627ac52640 1 -- 172.21.15.8:0/2649257448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f627404e9b0 con 0x7f6264004d00 2023-10-14T10:33:47.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.908+0000 7f62717fa640 1 -- 172.21.15.8:0/2649257448 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6268058250 con 0x7f6264004d00 2023-10-14T10:33:47.910 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 2 and data pool 3 2023-10-14T10:33:47.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.911+0000 7f627ac52640 1 -- 172.21.15.8:0/2649257448 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f625806aea0 msgr2=0x7f625806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:47.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.911+0000 7f627ac52640 1 --2- 172.21.15.8:0/2649257448 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f625806aea0 0x7f625806d360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6260001200 tx=0x7f6260009040 comp rx=0 tx=0).stop 2023-10-14T10:33:47.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.911+0000 7f627ac52640 1 -- 172.21.15.8:0/2649257448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6264004d00 msgr2=0x7f62741ed4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:47.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.911+0000 7f627ac52640 1 --2- 172.21.15.8:0/2649257448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6264004d00 0x7f62741ed4f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62680108b0 tx=0x7f6268010d70 comp rx=0 tx=0).stop 2023-10-14T10:33:47.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.911+0000 7f627ac52640 1 -- 172.21.15.8:0/2649257448 shutdown_connections 2023-10-14T10:33:47.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.911+0000 7f627ac52640 1 --2- 172.21.15.8:0/2649257448 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f625806aea0 0x7f625806d360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:47.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.911+0000 7f627ac52640 1 --2- 172.21.15.8:0/2649257448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f627411eca0 0x7f627406a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:47.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.911+0000 7f627ac52640 1 --2- 172.21.15.8:0/2649257448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6274071630 0x7f62741e9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:47.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.911+0000 7f627ac52640 1 --2- 172.21.15.8:0/2649257448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6264004d00 0x7f62741ed4f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:47.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.911+0000 7f627ac52640 1 -- 172.21.15.8:0/2649257448 >> 172.21.15.8:0/2649257448 conn(0x7f62740a74d0 msgr2=0x7f6274150340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:47.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.911+0000 7f627ac52640 1 -- 172.21.15.8:0/2649257448 shutdown_connections 2023-10-14T10:33:47.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:47.912+0000 7f627ac52640 1 -- 172.21.15.8:0/2649257448 wait complete. 2023-10-14T10:33:47.940 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:33:48.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.126+0000 7f7a057e9640 1 Processor -- start 2023-10-14T10:33:48.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.127+0000 7f7a057e9640 1 -- start start 2023-10-14T10:33:48.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.128+0000 7f7a057e9640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000a9610 0x7f7a00151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.128+0000 7f7a057e9640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7a0006faf0 0x7f7a0006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.128+0000 7f7a057e9640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a00071650 con 0x7f7a0014abb0 2023-10-14T10:33:48.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.128+0000 7f7a057e9640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a000a9280 con 0x7f7a0006faf0 2023-10-14T10:33:48.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.128+0000 7f7a057e9640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000aa6f0 con 0x7f7a000a9610 2023-10-14T10:33:48.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.128+0000 7f79fffff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7a0014abb0 0x7f7a000c2110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34338/0 (socket says 172.21.15.8:34338) 2023-10-14T10:33:48.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.128+0000 7f79fffff640 1 -- 172.21.15.8:0/539537957 learned_addr learned my addr 172.21.15.8:0/539537957 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:48.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.129+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163027383 0 0) 0x7f7a00071650 con 0x7f7a0014abb0 2023-10-14T10:33:48.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.129+0000 7f7a04fe8640 1 --2- 172.21.15.8:0/539537957 >> v2:172.21.15.92:3300/0 conn(0x7f7a0006faf0 0x7f7a0006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.129+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79ec003520 con 0x7f7a0014abb0 2023-10-14T10:33:48.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.129+0000 7f79f7fff640 1 --2- 172.21.15.8:0/539537957 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000a9610 0x7f7a00151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.129+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2658825225 0 0) 0x7f79ec003520 con 0x7f7a0014abb0 2023-10-14T10:33:48.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.129+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000a9610 msgr2=0x7f7a00151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:48.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.129+0000 7f79ff7fe640 1 --2- 172.21.15.8:0/539537957 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000a9610 0x7f7a00151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.129+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 >> v2:172.21.15.92:3300/0 conn(0x7f7a0006faf0 msgr2=0x7f7a0006ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:48.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.129+0000 7f79ff7fe640 1 --2- 172.21.15.8:0/539537957 >> v2:172.21.15.92:3300/0 conn(0x7f7a0006faf0 0x7f7a0006ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.129+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a000a81e0 con 0x7f7a0014abb0 2023-10-14T10:33:48.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.129+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f79f0001670 con 0x7f7a0014abb0 2023-10-14T10:33:48.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.129+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 >> v1:172.21.15.8:6789/0 conn(0x7f7a0014abb0 legacy=0x7f7a000c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f79ff7fe640 1 --2- 172.21.15.8:0/539537957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec003970 0x7f79ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f79ff7fe640 1 --2- 172.21.15.8:0/539537957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79ec0047c0 0x7f79ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f79ff7fe640 1 --2- 172.21.15.8:0/539537957 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000a9610 0x7f79ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000a9280 con 0x7f79ec003970 2023-10-14T10:33:48.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000aa6f0 con 0x7f79ec0047c0 2023-10-14T10:33:48.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec00ba00 con 0x7f7a000a9610 2023-10-14T10:33:48.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f79fffff640 1 --2- 172.21.15.8:0/539537957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec003970 0x7f79ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f7a04fe8640 1 --2- 172.21.15.8:0/539537957 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000a9610 0x7f79ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f79fffff640 1 -- 172.21.15.8:0/539537957 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000a9610 msgr2=0x7f79ec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:48.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f79fffff640 1 --2- 172.21.15.8:0/539537957 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000a9610 0x7f79ec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f79fffff640 1 -- 172.21.15.8:0/539537957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79ec0047c0 msgr2=0x7f79ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:48.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f79fffff640 1 --2- 172.21.15.8:0/539537957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79ec0047c0 0x7f79ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f79fffff640 1 -- 172.21.15.8:0/539537957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec003520 con 0x7f79ec003970 2023-10-14T10:33:48.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.130+0000 7f7a04fe8640 1 --2- 172.21.15.8:0/539537957 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000a9610 0x7f79ec005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:48.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.131+0000 7f79fffff640 1 --2- 172.21.15.8:0/539537957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec003970 0x7f79ec003d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79f000c190 tx=0x7f79ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca602d89b72f14d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:48.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.132+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0005ad0 con 0x7f79ec003970 2023-10-14T10:33:48.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.132+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f0005c50 con 0x7f79ec003970 2023-10-14T10:33:48.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.132+0000 7f79ff7fe640 1 -- 172.21.15.8:0/539537957 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f002c830 con 0x7f79ec003970 2023-10-14T10:33:48.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.132+0000 7f7a057e9640 1 -- 172.21.15.8:0/539537957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec003970 msgr2=0x7f79ec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.132+0000 7f7a057e9640 1 --2- 172.21.15.8:0/539537957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec003970 0x7f79ec003d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79f000c190 tx=0x7f79ec0057f0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.132+0000 7f7a04fe8640 1 -- 172.21.15.8:0/539537957 reap_dead start 2023-10-14T10:33:48.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.132+0000 7f7a057e9640 1 -- 172.21.15.8:0/539537957 shutdown_connections 2023-10-14T10:33:48.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.132+0000 7f7a057e9640 1 -- 172.21.15.8:0/539537957 >> 172.21.15.8:0/539537957 conn(0x7f7a0006a200 msgr2=0x7f7a0006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:48.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.132+0000 7f7a057e9640 1 -- 172.21.15.8:0/539537957 shutdown_connections 2023-10-14T10:33:48.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.132+0000 7f7a057e9640 1 -- 172.21.15.8:0/539537957 wait complete. 2023-10-14T10:33:48.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.134+0000 7f7a057e9640 1 Processor -- start 2023-10-14T10:33:48.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.134+0000 7f7a057e9640 1 -- start start 2023-10-14T10:33:48.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.135+0000 7f7a057e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79ec003970 0x7f7a000bb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.135+0000 7f7a057e9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0006caf0 0x7f7a000bd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.135+0000 7f7a057e9640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000bdd30 0x7f7a000ba150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.135+0000 7f7a057e9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000bbd70 con 0x7f7a0006caf0 2023-10-14T10:33:48.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.135+0000 7f7a057e9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000a9ef0 con 0x7f79ec003970 2023-10-14T10:33:48.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.135+0000 7f7a057e9640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a001eb0a0 con 0x7f7a000bdd30 2023-10-14T10:33:48.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.136+0000 7f79f7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0006caf0 0x7f7a000bd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.136+0000 7f79f7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0006caf0 0x7f7a000bd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46738/0 (socket says 172.21.15.8:46738) 2023-10-14T10:33:48.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.136+0000 7f79f7fff640 1 -- 172.21.15.8:0/648117117 learned_addr learned my addr 172.21.15.8:0/648117117 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:48.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.136+0000 7f79fffff640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79ec003970 0x7f7a000bb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.136+0000 7f7a04fe8640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000bdd30 0x7f7a000ba150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.136+0000 7f79f7fff640 1 -- 172.21.15.8:0/648117117 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000bdd30 msgr2=0x7f7a000ba150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.136+0000 7f79f7fff640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000bdd30 0x7f7a000ba150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.136+0000 7f79f7fff640 1 -- 172.21.15.8:0/648117117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79ec003970 msgr2=0x7f7a000bb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.136+0000 7f79f7fff640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79ec003970 0x7f7a000bb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.136+0000 7f79f7fff640 1 -- 172.21.15.8:0/648117117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a001eac10 con 0x7f7a0006caf0 2023-10-14T10:33:48.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.136+0000 7f79f7fff640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0006caf0 0x7f7a000bd7f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f79e800d830 tx=0x7f79e800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:48.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.137+0000 7f79fd7fa640 1 -- 172.21.15.8:0/648117117 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e800b660 con 0x7f7a0006caf0 2023-10-14T10:33:48.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.137+0000 7f79fd7fa640 1 -- 172.21.15.8:0/648117117 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e800b7e0 con 0x7f7a0006caf0 2023-10-14T10:33:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.137+0000 7f7a057e9640 1 -- 172.21.15.8:0/648117117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a000be1b0 con 0x7f7a0006caf0 2023-10-14T10:33:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.137+0000 7f79fd7fa640 1 -- 172.21.15.8:0/648117117 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e800bb90 con 0x7f7a0006caf0 2023-10-14T10:33:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.137+0000 7f7a057e9640 1 -- 172.21.15.8:0/648117117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a001ea5c0 con 0x7f7a0006caf0 2023-10-14T10:33:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.138+0000 7f7a057e9640 1 -- 172.21.15.8:0/648117117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a001eada0 con 0x7f7a0006caf0 2023-10-14T10:33:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.139+0000 7f79fd7fa640 1 -- 172.21.15.8:0/648117117 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f79e800bcf0 con 0x7f7a0006caf0 2023-10-14T10:33:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.140+0000 7f79fd7fa640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79e006aea0 0x7f79e006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.140+0000 7f79fd7fa640 1 -- 172.21.15.8:0/648117117 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79e8089cc0 con 0x7f7a0006caf0 2023-10-14T10:33:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.141+0000 7f79fffff640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79e006aea0 0x7f79e006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.141+0000 7f79fffff640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79e006aea0 0x7f79e006d360 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79f0034000 tx=0x7f79f0007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:48.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.145+0000 7f79fd7fa640 1 -- 172.21.15.8:0/648117117 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79e8054d60 con 0x7f7a0006caf0 2023-10-14T10:33:48.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.339+0000 7f7a057e9640 1 -- 172.21.15.8:0/648117117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a0004e9b0 con 0x7f7a0006caf0 2023-10-14T10:33:48.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.341+0000 7f79fd7fa640 1 -- 172.21.15.8:0/648117117 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16386 (secure 0 0 0) 0x7f79e8018090 con 0x7f7a0006caf0 2023-10-14T10:33:48.343 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:48.344 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:47.397428+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:33:48.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.343+0000 7f7a057e9640 1 -- 172.21.15.8:0/648117117 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79e006aea0 msgr2=0x7f79e006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.343+0000 7f7a057e9640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79e006aea0 0x7f79e006d360 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79f0034000 tx=0x7f79f0007000 comp rx=0 tx=0).stop 2023-10-14T10:33:48.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.344+0000 7f7a057e9640 1 -- 172.21.15.8:0/648117117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0006caf0 msgr2=0x7f7a000bd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.344+0000 7f7a057e9640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0006caf0 0x7f7a000bd7f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f79e800d830 tx=0x7f79e800dcf0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.344+0000 7f7a057e9640 1 -- 172.21.15.8:0/648117117 shutdown_connections 2023-10-14T10:33:48.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.344+0000 7f7a057e9640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79e006aea0 0x7f79e006d360 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.344+0000 7f7a057e9640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a000bdd30 0x7f7a000ba150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.344+0000 7f7a057e9640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0006caf0 0x7f7a000bd7f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.344+0000 7f7a057e9640 1 --2- 172.21.15.8:0/648117117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79ec003970 0x7f7a000bb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.344+0000 7f7a057e9640 1 -- 172.21.15.8:0/648117117 >> 172.21.15.8:0/648117117 conn(0x7f7a0006a200 msgr2=0x7f7a000c4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:48.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.344+0000 7f7a057e9640 1 -- 172.21.15.8:0/648117117 shutdown_connections 2023-10-14T10:33:48.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.344+0000 7f7a057e9640 1 -- 172.21.15.8:0/648117117 wait complete. 2023-10-14T10:33:48.366 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:33:48.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.588+0000 7fe0c759e640 1 Processor -- start 2023-10-14T10:33:48.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.588+0000 7fe0c759e640 1 -- start start 2023-10-14T10:33:48.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.590+0000 7fe0c759e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0c80aa470 0x7fe0c81506c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.590+0000 7fe0c759e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c80a9310 con 0x7fe0c80c0600 2023-10-14T10:33:48.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.590+0000 7fe0c759e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c806fdd0 con 0x7fe0c81502e0 2023-10-14T10:33:48.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.590+0000 7fe0c759e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c80a9660 con 0x7fe0c80aa470 2023-10-14T10:33:48.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.590+0000 7fe0bffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0c80aa470 0x7fe0c81506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.590+0000 7fe0bffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0c80aa470 0x7fe0c81506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46740/0 (socket says 172.21.15.8:46740) 2023-10-14T10:33:48.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.590+0000 7fe0bffff640 1 -- 172.21.15.8:0/3850322488 learned_addr learned my addr 172.21.15.8:0/3850322488 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.591+0000 7fe0bffff640 1 -- 172.21.15.8:0/3850322488 >> v1:172.21.15.92:6789/0 conn(0x7fe0c81502e0 legacy=0x7fe0c8070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.591+0000 7fe0bffff640 1 -- 172.21.15.8:0/3850322488 >> v1:172.21.15.8:6789/0 conn(0x7fe0c80c0600 legacy=0x7fe0c815abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.591+0000 7fe0bffff640 1 -- 172.21.15.8:0/3850322488 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c806faf0 con 0x7fe0c80aa470 2023-10-14T10:33:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.592+0000 7fe0bffff640 1 --2- 172.21.15.8:0/3850322488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c80aa470 0x7fe0c81506c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000bb10 tx=0x7fe0b002e290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f82efbcfcc5642 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.592+0000 7fe0c5d9b640 1 -- 172.21.15.8:0/3850322488 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0036640 con 0x7fe0c80aa470 2023-10-14T10:33:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.592+0000 7fe0c5d9b640 1 -- 172.21.15.8:0/3850322488 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b00367a0 con 0x7fe0c80aa470 2023-10-14T10:33:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.592+0000 7fe0c5d9b640 1 -- 172.21.15.8:0/3850322488 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0036b30 con 0x7fe0c80aa470 2023-10-14T10:33:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.593+0000 7fe0c759e640 1 -- 172.21.15.8:0/3850322488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c80aa470 msgr2=0x7fe0c81506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.593+0000 7fe0c759e640 1 --2- 172.21.15.8:0/3850322488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c80aa470 0x7fe0c81506c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000bb10 tx=0x7fe0b002e290 comp rx=0 tx=0).stop 2023-10-14T10:33:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.593+0000 7fe0c759e640 1 -- 172.21.15.8:0/3850322488 shutdown_connections 2023-10-14T10:33:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.593+0000 7fe0c759e640 1 --2- 172.21.15.8:0/3850322488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c80aa470 0x7fe0c81506c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.593+0000 7fe0c759e640 1 -- 172.21.15.8:0/3850322488 >> 172.21.15.8:0/3850322488 conn(0x7fe0c806a200 msgr2=0x7fe0c806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.593+0000 7fe0c759e640 1 -- 172.21.15.8:0/3850322488 shutdown_connections 2023-10-14T10:33:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.593+0000 7fe0c759e640 1 -- 172.21.15.8:0/3850322488 wait complete. 2023-10-14T10:33:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.595+0000 7fe0c759e640 1 Processor -- start 2023-10-14T10:33:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.595+0000 7fe0c759e640 1 -- start start 2023-10-14T10:33:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.596+0000 7fe0c759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c80c0600 0x7fe0c814ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.596+0000 7fe0c759e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c81502e0 0x7fe0c806b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.596+0000 7fe0c759e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0c81dc580 0x7fe0c814e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.596+0000 7fe0c759e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c80c4b00 con 0x7fe0c81502e0 2023-10-14T10:33:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.596+0000 7fe0c759e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c81e9bc0 con 0x7fe0c80c0600 2023-10-14T10:33:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.596+0000 7fe0c759e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c81e9e60 con 0x7fe0c81dc580 2023-10-14T10:33:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.596+0000 7fe0bffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c81502e0 0x7fe0c806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.596+0000 7fe0bffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c81502e0 0x7fe0c806b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46752/0 (socket says 172.21.15.8:46752) 2023-10-14T10:33:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.596+0000 7fe0bffff640 1 -- 172.21.15.8:0/3792331839 learned_addr learned my addr 172.21.15.8:0/3792331839 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.597+0000 7fe0c659c640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c80c0600 0x7fe0c814ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.597+0000 7fe0c6d9d640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0c81dc580 0x7fe0c814e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.597+0000 7fe0bffff640 1 -- 172.21.15.8:0/3792331839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0c81dc580 msgr2=0x7fe0c814e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.597+0000 7fe0bffff640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0c81dc580 0x7fe0c814e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.597+0000 7fe0bffff640 1 -- 172.21.15.8:0/3792331839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c80c0600 msgr2=0x7fe0c814ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.597+0000 7fe0bffff640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c80c0600 0x7fe0c814ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.597+0000 7fe0bffff640 1 -- 172.21.15.8:0/3792331839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b000b770 con 0x7fe0c81502e0 2023-10-14T10:33:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.597+0000 7fe0bffff640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c81502e0 0x7fe0c806b900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0b002e2d0 tx=0x7fe0b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.597+0000 7fe0beffd640 1 -- 172.21.15.8:0/3792331839 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0034b80 con 0x7fe0c81502e0 2023-10-14T10:33:48.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.597+0000 7fe0beffd640 1 -- 172.21.15.8:0/3792331839 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0034ce0 con 0x7fe0c81502e0 2023-10-14T10:33:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.597+0000 7fe0beffd640 1 -- 172.21.15.8:0/3792331839 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0041680 con 0x7fe0c81502e0 2023-10-14T10:33:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.597+0000 7fe0c759e640 1 -- 172.21.15.8:0/3792331839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c814aa40 con 0x7fe0c81502e0 2023-10-14T10:33:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.598+0000 7fe0c759e640 1 -- 172.21.15.8:0/3792331839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c814e890 con 0x7fe0c81502e0 2023-10-14T10:33:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.599+0000 7fe0c759e640 1 -- 172.21.15.8:0/3792331839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c804e9b0 con 0x7fe0c81502e0 2023-10-14T10:33:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.600+0000 7fe0beffd640 1 -- 172.21.15.8:0/3792331839 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe0b00403e0 con 0x7fe0c81502e0 2023-10-14T10:33:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.600+0000 7fe0beffd640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe0a806aea0 0x7fe0a806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.601+0000 7fe0beffd640 1 -- 172.21.15.8:0/3792331839 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0b002ee40 con 0x7fe0c81502e0 2023-10-14T10:33:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.601+0000 7fe0c659c640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe0a806aea0 0x7fe0a806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.601+0000 7fe0c659c640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe0a806aea0 0x7fe0a806d360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe0c81dcc80 tx=0x7fe0b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.605+0000 7fe0beffd640 1 -- 172.21.15.8:0/3792331839 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0b0076ab0 con 0x7fe0c81502e0 2023-10-14T10:33:48.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.802+0000 7fe0c759e640 1 -- 172.21.15.8:0/3792331839 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0c80a9b80 con 0x7fe0c81502e0 2023-10-14T10:33:48.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.804+0000 7fe0beffd640 1 -- 172.21.15.8:0/3792331839 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7fe0b003b020 con 0x7fe0c81502e0 2023-10-14T10:33:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:48.808 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:33:48.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.807+0000 7fe0c759e640 1 -- 172.21.15.8:0/3792331839 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe0a806aea0 msgr2=0x7fe0a806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.807+0000 7fe0c759e640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe0a806aea0 0x7fe0a806d360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe0c81dcc80 tx=0x7fe0b8009040 comp rx=0 tx=0).stop 2023-10-14T10:33:48.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.807+0000 7fe0c759e640 1 -- 172.21.15.8:0/3792331839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c81502e0 msgr2=0x7fe0c806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:48.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.807+0000 7fe0c759e640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c81502e0 0x7fe0c806b900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0b002e2d0 tx=0x7fe0b00046c0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.807+0000 7fe0c759e640 1 -- 172.21.15.8:0/3792331839 shutdown_connections 2023-10-14T10:33:48.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.807+0000 7fe0c759e640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe0a806aea0 0x7fe0a806d360 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.807+0000 7fe0c759e640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0c81dc580 0x7fe0c814e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.807+0000 7fe0c759e640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0c81502e0 0x7fe0c806b900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.807+0000 7fe0c759e640 1 --2- 172.21.15.8:0/3792331839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0c80c0600 0x7fe0c814ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:48.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.807+0000 7fe0c759e640 1 -- 172.21.15.8:0/3792331839 >> 172.21.15.8:0/3792331839 conn(0x7fe0c806a200 msgr2=0x7fe0c80be560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:48.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.808+0000 7fe0c759e640 1 -- 172.21.15.8:0/3792331839 shutdown_connections 2023-10-14T10:33:48.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:48.808+0000 7fe0c759e640 1 -- 172.21.15.8:0/3792331839 wait complete. 2023-10-14T10:33:48.830 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T10:33:49.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.054+0000 7f8233f4e640 1 Processor -- start 2023-10-14T10:33:49.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.054+0000 7f8233f4e640 1 -- start start 2023-10-14T10:33:49.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.055+0000 7f8233f4e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f822c151820 0x7f822c0c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:49.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.055+0000 7f8233f4e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822c0c0350 con 0x7f822c06d770 2023-10-14T10:33:49.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.056+0000 7f8233f4e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822c151c00 con 0x7f822c06e680 2023-10-14T10:33:49.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.056+0000 7f8233f4e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822c06e290 con 0x7f822c151820 2023-10-14T10:33:49.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.056+0000 7f8231cea640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f822c151820 0x7f822c0c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:49.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.056+0000 7f8231cea640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f822c151820 0x7f822c0c1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46760/0 (socket says 172.21.15.8:46760) 2023-10-14T10:33:49.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.056+0000 7f8231cea640 1 -- 172.21.15.8:0/1204858679 learned_addr learned my addr 172.21.15.8:0/1204858679 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:49.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.056+0000 7f8231cea640 1 -- 172.21.15.8:0/1204858679 >> v1:172.21.15.92:6789/0 conn(0x7f822c06e680 legacy=0x7f822c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:49.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.056+0000 7f8231cea640 1 -- 172.21.15.8:0/1204858679 >> v1:172.21.15.8:6789/0 conn(0x7f822c06d770 legacy=0x7f822c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:49.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.056+0000 7f8231cea640 1 -- 172.21.15.8:0/1204858679 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c0b9310 con 0x7f822c151820 2023-10-14T10:33:49.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.058+0000 7f8231cea640 1 --2- 172.21.15.8:0/1204858679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f822c151820 0x7f822c0c1dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8228009870 tx=0x7f822802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea8e94c4c36fd4f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:49.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.058+0000 7f8230ce8640 1 -- 172.21.15.8:0/1204858679 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822802f850 con 0x7f822c151820 2023-10-14T10:33:49.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.058+0000 7f8230ce8640 1 -- 172.21.15.8:0/1204858679 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822802f9b0 con 0x7f822c151820 2023-10-14T10:33:49.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.058+0000 7f8230ce8640 1 -- 172.21.15.8:0/1204858679 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822802fd40 con 0x7f822c151820 2023-10-14T10:33:49.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.058+0000 7f8233f4e640 1 -- 172.21.15.8:0/1204858679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f822c151820 msgr2=0x7f822c0c1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.058+0000 7f8233f4e640 1 --2- 172.21.15.8:0/1204858679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f822c151820 0x7f822c0c1dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8228009870 tx=0x7f822802ba30 comp rx=0 tx=0).stop 2023-10-14T10:33:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.059+0000 7f8233f4e640 1 -- 172.21.15.8:0/1204858679 shutdown_connections 2023-10-14T10:33:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.059+0000 7f8233f4e640 1 --2- 172.21.15.8:0/1204858679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f822c151820 0x7f822c0c1dd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.059+0000 7f8233f4e640 1 -- 172.21.15.8:0/1204858679 >> 172.21.15.8:0/1204858679 conn(0x7f822c0c59d0 msgr2=0x7f822c0c5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:49.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.059+0000 7f8233f4e640 1 -- 172.21.15.8:0/1204858679 shutdown_connections 2023-10-14T10:33:49.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.059+0000 7f8233f4e640 1 -- 172.21.15.8:0/1204858679 wait complete. 2023-10-14T10:33:49.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.060+0000 7f8233f4e640 1 Processor -- start 2023-10-14T10:33:49.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.061+0000 7f8233f4e640 1 -- start start 2023-10-14T10:33:49.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.061+0000 7f8233f4e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f822c06d770 0x7f822c1ea710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:49.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.061+0000 7f8233f4e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f822c06e680 0x7f822c0ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:49.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f8233f4e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f822c0a98d0 0x7f822c1ec810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:49.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f8233f4e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c14e330 con 0x7f822c06d770 2023-10-14T10:33:49.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f8233f4e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c1eac50 con 0x7f822c06e680 2023-10-14T10:33:49.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f8233f4e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822c0a9440 con 0x7f822c0a98d0 2023-10-14T10:33:49.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f8231cea640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f822c06d770 0x7f822c1ea710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:49.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f8231cea640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f822c06d770 0x7f822c1ea710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46772/0 (socket says 172.21.15.8:46772) 2023-10-14T10:33:49.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f8231cea640 1 -- 172.21.15.8:0/1646696066 learned_addr learned my addr 172.21.15.8:0/1646696066 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:49.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f8231cea640 1 -- 172.21.15.8:0/1646696066 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f822c0a98d0 msgr2=0x7f822c1ec810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:49.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f8231cea640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f822c0a98d0 0x7f822c1ec810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:49.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f82314e9640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f822c06e680 0x7f822c0ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:49.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f8231cea640 1 -- 172.21.15.8:0/1646696066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f822c06e680 msgr2=0x7f822c0ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:49.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f8231cea640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f822c06e680 0x7f822c0ab110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:49.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.062+0000 7f8231cea640 1 -- 172.21.15.8:0/1646696066 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82280094d0 con 0x7f822c06d770 2023-10-14T10:33:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.063+0000 7f8231cea640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f822c06d770 0x7f822c1ea710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8228000c00 tx=0x7f8228004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.063+0000 7f82227fc640 1 -- 172.21.15.8:0/1646696066 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228045070 con 0x7f822c06d770 2023-10-14T10:33:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.063+0000 7f82227fc640 1 -- 172.21.15.8:0/1646696066 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8228037d40 con 0x7f822c06d770 2023-10-14T10:33:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.063+0000 7f82227fc640 1 -- 172.21.15.8:0/1646696066 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228041640 con 0x7f822c06d770 2023-10-14T10:33:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.063+0000 7f8233f4e640 1 -- 172.21.15.8:0/1646696066 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822c0a8830 con 0x7f822c06d770 2023-10-14T10:33:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.063+0000 7f8233f4e640 1 -- 172.21.15.8:0/1646696066 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822c0a8df0 con 0x7f822c06d770 2023-10-14T10:33:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.064+0000 7f8233f4e640 1 -- 172.21.15.8:0/1646696066 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822c0c0ae0 con 0x7f822c06d770 2023-10-14T10:33:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.065+0000 7f82227fc640 1 -- 172.21.15.8:0/1646696066 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f822804a410 con 0x7f822c06d770 2023-10-14T10:33:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.066+0000 7f82227fc640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f821006aea0 0x7f821006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.066+0000 7f82227fc640 1 -- 172.21.15.8:0/1646696066 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f822803c070 con 0x7f822c06d770 2023-10-14T10:33:49.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.066+0000 7f82314e9640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f821006aea0 0x7f821006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:49.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.067+0000 7f82314e9640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f821006aea0 0x7f821006d360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f822c070fd0 tx=0x7f821c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:49.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.070+0000 7f82227fc640 1 -- 172.21.15.8:0/1646696066 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8228076c20 con 0x7f822c06d770 2023-10-14T10:33:49.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.305+0000 7f8233f4e640 1 -- 172.21.15.8:0/1646696066 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f822c04e9b0 con 0x7f822c06d770 2023-10-14T10:33:49.809 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-10-14T10:33:49.807+0000 7ff12e7ef640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T10:33:49.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.944+0000 7f82227fc640 1 -- 172.21.15.8:0/1646696066 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f822807a240 con 0x7f822c06d770 2023-10-14T10:33:49.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.948+0000 7f8233f4e640 1 -- 172.21.15.8:0/1646696066 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f821006aea0 msgr2=0x7f821006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:49.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.948+0000 7f8233f4e640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f821006aea0 0x7f821006d360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f822c070fd0 tx=0x7f821c009040 comp rx=0 tx=0).stop 2023-10-14T10:33:49.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.948+0000 7f8233f4e640 1 -- 172.21.15.8:0/1646696066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f822c06d770 msgr2=0x7f822c1ea710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:49.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.948+0000 7f8233f4e640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f822c06d770 0x7f822c1ea710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8228000c00 tx=0x7f8228004730 comp rx=0 tx=0).stop 2023-10-14T10:33:49.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.948+0000 7f8233f4e640 1 -- 172.21.15.8:0/1646696066 shutdown_connections 2023-10-14T10:33:49.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.948+0000 7f8233f4e640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f821006aea0 0x7f821006d360 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:49.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.948+0000 7f8233f4e640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f822c0a98d0 0x7f822c1ec810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:49.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.948+0000 7f8233f4e640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f822c06e680 0x7f822c0ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:49.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.948+0000 7f8233f4e640 1 --2- 172.21.15.8:0/1646696066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f822c06d770 0x7f822c1ea710 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:49.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.948+0000 7f8233f4e640 1 -- 172.21.15.8:0/1646696066 >> 172.21.15.8:0/1646696066 conn(0x7f822c0c59d0 msgr2=0x7f822c0706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:49.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.948+0000 7f8233f4e640 1 -- 172.21.15.8:0/1646696066 shutdown_connections 2023-10-14T10:33:49.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:49.948+0000 7f8233f4e640 1 -- 172.21.15.8:0/1646696066 wait complete. 2023-10-14T10:33:49.970 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T10:33:49.971 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T10:33:50.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.192+0000 7fd963fff640 1 Processor -- start 2023-10-14T10:33:50.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.193+0000 7fd963fff640 1 -- start start 2023-10-14T10:33:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.194+0000 7fd963fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd964151420 0x7fd9640c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.195+0000 7fd963fff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9640c4e30 con 0x7fd9640c5610 2023-10-14T10:33:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.195+0000 7fd963fff640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9640c5d00 con 0x7fd9640c43a0 2023-10-14T10:33:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.195+0000 7fd963fff640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9640c5450 con 0x7fd964151420 2023-10-14T10:33:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.195+0000 7fd962ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd964151420 0x7fd9640c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.195+0000 7fd962ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd964151420 0x7fd9640c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46774/0 (socket says 172.21.15.8:46774) 2023-10-14T10:33:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.195+0000 7fd962ffd640 1 -- 172.21.15.8:0/1208595577 learned_addr learned my addr 172.21.15.8:0/1208595577 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.196+0000 7fd962ffd640 1 -- 172.21.15.8:0/1208595577 >> v1:172.21.15.92:6789/0 conn(0x7fd9640c43a0 legacy=0x7fd9640c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.196+0000 7fd962ffd640 1 -- 172.21.15.8:0/1208595577 >> v1:172.21.15.8:6789/0 conn(0x7fd9640c5610 legacy=0x7fd96406ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.196+0000 7fd962ffd640 1 -- 172.21.15.8:0/1208595577 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640c5170 con 0x7fd964151420 2023-10-14T10:33:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.197+0000 7fd962ffd640 1 --2- 172.21.15.8:0/1208595577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964151420 0x7fd9640c48f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd954009870 tx=0x7fd95402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229e524385dcf8d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.197+0000 7fd961ffb640 1 -- 172.21.15.8:0/1208595577 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954031860 con 0x7fd964151420 2023-10-14T10:33:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.197+0000 7fd961ffb640 1 -- 172.21.15.8:0/1208595577 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9540319c0 con 0x7fd964151420 2023-10-14T10:33:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.197+0000 7fd961ffb640 1 -- 172.21.15.8:0/1208595577 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954031d50 con 0x7fd964151420 2023-10-14T10:33:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.198+0000 7fd963fff640 1 -- 172.21.15.8:0/1208595577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964151420 msgr2=0x7fd9640c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.198+0000 7fd963fff640 1 --2- 172.21.15.8:0/1208595577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964151420 0x7fd9640c48f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd954009870 tx=0x7fd95402b900 comp rx=0 tx=0).stop 2023-10-14T10:33:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.198+0000 7fd963fff640 1 -- 172.21.15.8:0/1208595577 shutdown_connections 2023-10-14T10:33:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.198+0000 7fd963fff640 1 --2- 172.21.15.8:0/1208595577 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964151420 0x7fd9640c48f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:50.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.198+0000 7fd963fff640 1 -- 172.21.15.8:0/1208595577 >> 172.21.15.8:0/1208595577 conn(0x7fd9640c96c0 msgr2=0x7fd9640c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:50.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.198+0000 7fd963fff640 1 -- 172.21.15.8:0/1208595577 shutdown_connections 2023-10-14T10:33:50.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.198+0000 7fd963fff640 1 -- 172.21.15.8:0/1208595577 wait complete. 2023-10-14T10:33:50.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.200+0000 7fd963fff640 1 Processor -- start 2023-10-14T10:33:50.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.200+0000 7fd963fff640 1 -- start start 2023-10-14T10:33:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd963fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640c43a0 0x7fd9641465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd963fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9640c5610 0x7fd964152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd963fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964151420 0x7fd9640ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd963fff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641576b0 con 0x7fd9640c43a0 2023-10-14T10:33:50.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd963fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964157950 con 0x7fd964151420 2023-10-14T10:33:50.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd963fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd964157c30 con 0x7fd9640c5610 2023-10-14T10:33:50.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd962ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640c43a0 0x7fd9641465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:50.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd962ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640c43a0 0x7fd9641465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46776/0 (socket says 172.21.15.8:46776) 2023-10-14T10:33:50.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd962ffd640 1 -- 172.21.15.8:0/157496108 learned_addr learned my addr 172.21.15.8:0/157496108 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd9637fe640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964151420 0x7fd9640ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd9627fc640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9640c5610 0x7fd964152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd962ffd640 1 -- 172.21.15.8:0/157496108 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9640c5610 msgr2=0x7fd964152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd962ffd640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9640c5610 0x7fd964152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd962ffd640 1 -- 172.21.15.8:0/157496108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964151420 msgr2=0x7fd9640ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:50.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd962ffd640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964151420 0x7fd9640ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.201+0000 7fd962ffd640 1 -- 172.21.15.8:0/157496108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9540094d0 con 0x7fd9640c43a0 2023-10-14T10:33:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.202+0000 7fd9637fe640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964151420 0x7fd9640ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.202+0000 7fd962ffd640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640c43a0 0x7fd9641465e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd954009870 tx=0x7fd9540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.202+0000 7fd95bfff640 1 -- 172.21.15.8:0/157496108 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954031810 con 0x7fd9640c43a0 2023-10-14T10:33:50.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.202+0000 7fd95bfff640 1 -- 172.21.15.8:0/157496108 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9540443f0 con 0x7fd9640c43a0 2023-10-14T10:33:50.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.202+0000 7fd95bfff640 1 -- 172.21.15.8:0/157496108 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540447a0 con 0x7fd9640c43a0 2023-10-14T10:33:50.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.202+0000 7fd963fff640 1 -- 172.21.15.8:0/157496108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd964157f10 con 0x7fd9640c43a0 2023-10-14T10:33:50.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.202+0000 7fd963fff640 1 -- 172.21.15.8:0/157496108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9640aa990 con 0x7fd9640c43a0 2023-10-14T10:33:50.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.203+0000 7fd963fff640 1 -- 172.21.15.8:0/157496108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd964157d70 con 0x7fd9640c43a0 2023-10-14T10:33:50.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.204+0000 7fd95bfff640 1 -- 172.21.15.8:0/157496108 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd95404d450 con 0x7fd9640c43a0 2023-10-14T10:33:50.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.205+0000 7fd95bfff640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd94406aea0 0x7fd94406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:50.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.205+0000 7fd95bfff640 1 -- 172.21.15.8:0/157496108 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9540abd80 con 0x7fd9640c43a0 2023-10-14T10:33:50.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.205+0000 7fd9627fc640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd94406aea0 0x7fd94406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:50.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.206+0000 7fd9627fc640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd94406aea0 0x7fd94406d360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd94c007fd0 tx=0x7fd94c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:50.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.210+0000 7fd95bfff640 1 -- 172.21.15.8:0/157496108 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd964157d70 con 0x7fd9640c43a0 2023-10-14T10:33:50.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.441+0000 7fd963fff640 1 -- 172.21.15.8:0/157496108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd964157d70 con 0x7fd9640c43a0 2023-10-14T10:33:50.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.947+0000 7fd95bfff640 1 -- 172.21.15.8:0/157496108 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd964157d70 con 0x7fd9640c43a0 2023-10-14T10:33:50.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.951+0000 7fd963fff640 1 -- 172.21.15.8:0/157496108 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd94406aea0 msgr2=0x7fd94406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:50.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.951+0000 7fd963fff640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd94406aea0 0x7fd94406d360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd94c007fd0 tx=0x7fd94c009040 comp rx=0 tx=0).stop 2023-10-14T10:33:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.951+0000 7fd963fff640 1 -- 172.21.15.8:0/157496108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640c43a0 msgr2=0x7fd9641465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.951+0000 7fd963fff640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640c43a0 0x7fd9641465e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd954009870 tx=0x7fd9540046c0 comp rx=0 tx=0).stop 2023-10-14T10:33:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.951+0000 7fd963fff640 1 -- 172.21.15.8:0/157496108 shutdown_connections 2023-10-14T10:33:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.951+0000 7fd963fff640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd94406aea0 0x7fd94406d360 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:50.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.951+0000 7fd963fff640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd964151420 0x7fd9640ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:50.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.951+0000 7fd963fff640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9640c5610 0x7fd964152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:50.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.951+0000 7fd963fff640 1 --2- 172.21.15.8:0/157496108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640c43a0 0x7fd9641465e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:50.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.951+0000 7fd963fff640 1 -- 172.21.15.8:0/157496108 >> 172.21.15.8:0/157496108 conn(0x7fd9640c96c0 msgr2=0x7fd96414a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:50.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.951+0000 7fd963fff640 1 -- 172.21.15.8:0/157496108 shutdown_connections 2023-10-14T10:33:50.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:50.951+0000 7fd963fff640 1 -- 172.21.15.8:0/157496108 wait complete. 2023-10-14T10:33:50.973 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-14T10:33:50.974 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:33:51.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.182+0000 7ff0894f2640 1 Processor -- start 2023-10-14T10:33:51.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.183+0000 7ff0894f2640 1 -- start start 2023-10-14T10:33:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.184+0000 7ff0894f2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff08414e640 0x7ff084154d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.184+0000 7ff0894f2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff0840a84d0 0x7ff0840a8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.184+0000 7ff0894f2640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0841552d0 con 0x7ff0840c1720 2023-10-14T10:33:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.184+0000 7ff0894f2640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0840a8e80 con 0x7ff0840a84d0 2023-10-14T10:33:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.184+0000 7ff0894f2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0840c1cc0 con 0x7ff08414e640 2023-10-14T10:33:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.185+0000 7ff082ffd640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff08414e640 0x7ff084154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.185+0000 7ff082ffd640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff08414e640 0x7ff084154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:60706/0 (socket says 172.21.15.8:60706) 2023-10-14T10:33:51.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.185+0000 7ff082ffd640 1 -- 172.21.15.8:0/4104589688 learned_addr learned my addr 172.21.15.8:0/4104589688 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:51.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.185+0000 7ff0837fe640 1 --2- 172.21.15.8:0/4104589688 >> v2:172.21.15.92:3300/0 conn(0x7ff0840a84d0 0x7ff0840a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:51.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.186+0000 7ff082ffd640 1 -- 172.21.15.8:0/4104589688 >> v2:172.21.15.92:3300/0 conn(0x7ff0840a84d0 msgr2=0x7ff0840a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:51.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.186+0000 7ff082ffd640 1 --2- 172.21.15.8:0/4104589688 >> v2:172.21.15.92:3300/0 conn(0x7ff0840a84d0 0x7ff0840a8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.186+0000 7ff082ffd640 1 -- 172.21.15.8:0/4104589688 >> v1:172.21.15.92:6789/0 conn(0x7ff0840c1720 legacy=0x7ff0840c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:51.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.186+0000 7ff082ffd640 1 -- 172.21.15.8:0/4104589688 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08406cce0 con 0x7ff08414e640 2023-10-14T10:33:51.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.186+0000 7ff081ffb640 1 -- 172.21.15.8:0/4104589688 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776314727 0 0) 0x7ff0841552d0 con 0x7ff0840c1720 2023-10-14T10:33:51.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.187+0000 7ff082ffd640 1 --2- 172.21.15.8:0/4104589688 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff08414e640 0x7ff084154d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff074009e50 tx=0x7ff07402bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d4d11e1286e51dd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:51.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.188+0000 7ff081ffb640 1 -- 172.21.15.8:0/4104589688 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07402caf0 con 0x7ff08414e640 2023-10-14T10:33:51.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.188+0000 7ff081ffb640 1 -- 172.21.15.8:0/4104589688 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07402cc50 con 0x7ff08414e640 2023-10-14T10:33:51.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.188+0000 7ff081ffb640 1 -- 172.21.15.8:0/4104589688 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0740343f0 con 0x7ff08414e640 2023-10-14T10:33:51.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.188+0000 7ff0894f2640 1 -- 172.21.15.8:0/4104589688 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff08414e640 msgr2=0x7ff084154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:51.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.188+0000 7ff0894f2640 1 --2- 172.21.15.8:0/4104589688 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff08414e640 0x7ff084154d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff074009e50 tx=0x7ff07402bf50 comp rx=0 tx=0).stop 2023-10-14T10:33:51.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.188+0000 7ff0894f2640 1 -- 172.21.15.8:0/4104589688 shutdown_connections 2023-10-14T10:33:51.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.188+0000 7ff0894f2640 1 --2- 172.21.15.8:0/4104589688 >> v2:172.21.15.92:3300/0 conn(0x7ff0840a84d0 0x7ff0840a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.188+0000 7ff0894f2640 1 --2- 172.21.15.8:0/4104589688 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff08414e640 0x7ff084154d90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.188+0000 7ff0894f2640 1 -- 172.21.15.8:0/4104589688 >> 172.21.15.8:0/4104589688 conn(0x7ff0840a74d0 msgr2=0x7ff0840a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:51.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.188+0000 7ff0894f2640 1 -- 172.21.15.8:0/4104589688 shutdown_connections 2023-10-14T10:33:51.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.188+0000 7ff0894f2640 1 -- 172.21.15.8:0/4104589688 wait complete. 2023-10-14T10:33:51.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.190+0000 7ff0894f2640 1 Processor -- start 2023-10-14T10:33:51.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.190+0000 7ff0894f2640 1 -- start start 2023-10-14T10:33:51.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.191+0000 7ff0894f2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0840a84d0 0x7ff084071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:51.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.191+0000 7ff0894f2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0840c1720 0x7ff0840c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:51.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.191+0000 7ff0894f2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff08414e640 0x7ff08414f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:51.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.191+0000 7ff0894f2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0841518c0 con 0x7ff0840c1720 2023-10-14T10:33:51.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.191+0000 7ff0894f2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08414eda0 con 0x7ff0840a84d0 2023-10-14T10:33:51.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.191+0000 7ff0894f2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0840c5310 con 0x7ff08414e640 2023-10-14T10:33:51.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.191+0000 7ff0827fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0840c1720 0x7ff0840c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:51.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.192+0000 7ff0827fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0840c1720 0x7ff0840c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46780/0 (socket says 172.21.15.8:46780) 2023-10-14T10:33:51.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.192+0000 7ff0827fc640 1 -- 172.21.15.8:0/886556298 learned_addr learned my addr 172.21.15.8:0/886556298 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:51.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.192+0000 7ff0837fe640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff08414e640 0x7ff08414f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:51.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.192+0000 7ff082ffd640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0840a84d0 0x7ff084071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:51.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.192+0000 7ff0827fc640 1 -- 172.21.15.8:0/886556298 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff08414e640 msgr2=0x7ff08414f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:51.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.192+0000 7ff0827fc640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff08414e640 0x7ff08414f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.192+0000 7ff0827fc640 1 -- 172.21.15.8:0/886556298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0840a84d0 msgr2=0x7ff084071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:51.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.192+0000 7ff0827fc640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0840a84d0 0x7ff084071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.192+0000 7ff0827fc640 1 -- 172.21.15.8:0/886556298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff074009b30 con 0x7ff0840c1720 2023-10-14T10:33:51.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.192+0000 7ff082ffd640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0840a84d0 0x7ff084071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:51.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.192+0000 7ff0827fc640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0840c1720 0x7ff0840c3d70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c410 tx=0x7ff06c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:51.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.193+0000 7ff07b7fe640 1 -- 172.21.15.8:0/886556298 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c0035f0 con 0x7ff0840c1720 2023-10-14T10:33:51.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.193+0000 7ff07b7fe640 1 -- 172.21.15.8:0/886556298 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c003770 con 0x7ff0840c1720 2023-10-14T10:33:51.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.193+0000 7ff07b7fe640 1 -- 172.21.15.8:0/886556298 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c003b20 con 0x7ff0840c1720 2023-10-14T10:33:51.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.193+0000 7ff0894f2640 1 -- 172.21.15.8:0/886556298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0840c4a70 con 0x7ff0840c1720 2023-10-14T10:33:51.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.193+0000 7ff0894f2640 1 -- 172.21.15.8:0/886556298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0840c5030 con 0x7ff0840c1720 2023-10-14T10:33:51.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.194+0000 7ff0894f2640 1 -- 172.21.15.8:0/886556298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff084073b50 con 0x7ff0840c1720 2023-10-14T10:33:51.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.195+0000 7ff07b7fe640 1 -- 172.21.15.8:0/886556298 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff06c003c80 con 0x7ff0840c1720 2023-10-14T10:33:51.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.196+0000 7ff07b7fe640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff06406aea0 0x7ff06406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:51.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.196+0000 7ff07b7fe640 1 -- 172.21.15.8:0/886556298 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff06c088cd0 con 0x7ff0840c1720 2023-10-14T10:33:51.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.196+0000 7ff082ffd640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff06406aea0 0x7ff06406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:51.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.197+0000 7ff082ffd640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff06406aea0 0x7ff06406d360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff074035000 tx=0x7ff074030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:51.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.200+0000 7ff07b7fe640 1 -- 172.21.15.8:0/886556298 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff06c053ce0 con 0x7ff0840c1720 2023-10-14T10:33:51.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.424+0000 7ff0894f2640 1 -- 172.21.15.8:0/886556298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0840c0730 con 0x7ff0840c1720 2023-10-14T10:33:51.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.425+0000 7ff07b7fe640 1 -- 172.21.15.8:0/886556298 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4898 (secure 0 0 0) 0x7ff06c017020 con 0x7ff0840c1720 2023-10-14T10:33:51.428 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:51.428 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3003490368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3003490368},{"type":"v1","addr":"172.21.15.92:6834","nonce":3003490368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3352501671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":3352501671},{"type":"v1","addr":"172.21.15.92:6835","nonce":3352501671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4157669185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4157669185},{"type":"v1","addr":"172.21.15.8:6837","nonce":4157669185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:33:47.398252+0000","modified":"2023-10-14T10:33:50.442698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6835/524862170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":524862170},{"type":"v1","addr":"172.21.15.8:6835","nonce":524862170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T10:33:51.428 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T10:33:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.428+0000 7ff0894f2640 1 -- 172.21.15.8:0/886556298 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff06406aea0 msgr2=0x7ff06406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.428+0000 7ff0894f2640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff06406aea0 0x7ff06406d360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff074035000 tx=0x7ff074030000 comp rx=0 tx=0).stop 2023-10-14T10:33:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.428+0000 7ff0894f2640 1 -- 172.21.15.8:0/886556298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0840c1720 msgr2=0x7ff0840c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.428+0000 7ff0894f2640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0840c1720 0x7ff0840c3d70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c410 tx=0x7ff06c00c8d0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.428+0000 7ff0894f2640 1 -- 172.21.15.8:0/886556298 shutdown_connections 2023-10-14T10:33:51.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.428+0000 7ff0894f2640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff06406aea0 0x7ff06406d360 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.428+0000 7ff0894f2640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff08414e640 0x7ff08414f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.428+0000 7ff0894f2640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0840c1720 0x7ff0840c3d70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.428+0000 7ff0894f2640 1 --2- 172.21.15.8:0/886556298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0840a84d0 0x7ff084071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.428+0000 7ff0894f2640 1 -- 172.21.15.8:0/886556298 >> 172.21.15.8:0/886556298 conn(0x7ff0840a74d0 msgr2=0x7ff0840a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:51.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.428+0000 7ff0894f2640 1 -- 172.21.15.8:0/886556298 shutdown_connections 2023-10-14T10:33:51.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.428+0000 7ff0894f2640 1 -- 172.21.15.8:0/886556298 wait complete. 2023-10-14T10:33:51.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:33:51.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.664+0000 7f0d25355640 1 Processor -- start 2023-10-14T10:33:51.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.664+0000 7f0d25355640 1 -- start start 2023-10-14T10:33:51.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d25355640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0d200c1520 0x7f0d2006d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:51.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d25355640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d200c0950 0x7f0d2014aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:51.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d25355640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d20151870 con 0x7f0d200c5a10 2023-10-14T10:33:51.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d25355640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d20151dd0 con 0x7f0d200c1520 2023-10-14T10:33:51.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d25355640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d200a8be0 con 0x7f0d200c0950 2023-10-14T10:33:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d167fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0d200c1520 0x7f0d2006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d1effd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0d200c5a10 0x7f0d200a84d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34384/0 (socket says 172.21.15.8:34384) 2023-10-14T10:33:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d1effd640 1 -- 172.21.15.8:0/4084302918 learned_addr learned my addr 172.21.15.8:0/4084302918 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d1f7fe640 1 --2- 172.21.15.8:0/4084302918 >> v2:172.21.15.92:3300/0 conn(0x7f0d200c0950 0x7f0d2014aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:51.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d167fc640 1 -- 172.21.15.8:0/4084302918 >> v2:172.21.15.92:3300/0 conn(0x7f0d200c0950 msgr2=0x7f0d2014aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:51.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d167fc640 1 --2- 172.21.15.8:0/4084302918 >> v2:172.21.15.92:3300/0 conn(0x7f0d200c0950 0x7f0d2014aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d167fc640 1 -- 172.21.15.8:0/4084302918 >> v1:172.21.15.8:6789/0 conn(0x7f0d200c5a10 legacy=0x7f0d200a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:51.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.666+0000 7f0d167fc640 1 -- 172.21.15.8:0/4084302918 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2006cd70 con 0x7f0d200c1520 2023-10-14T10:33:51.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.667+0000 7f0d1f7fe640 1 --2- 172.21.15.8:0/4084302918 >> v2:172.21.15.92:3300/0 conn(0x7f0d200c0950 0x7f0d2014aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:51.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.668+0000 7f0d167fc640 1 --2- 172.21.15.8:0/4084302918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d200c1520 0x7f0d2006d810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d200c1210 tx=0x7f0d0802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b44ebec06ce44a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.668+0000 7f0d1e7fc640 1 -- 172.21.15.8:0/4084302918 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08031520 con 0x7f0d200c1520 2023-10-14T10:33:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.668+0000 7f0d1e7fc640 1 -- 172.21.15.8:0/4084302918 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d08031680 con 0x7f0d200c1520 2023-10-14T10:33:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.668+0000 7f0d1e7fc640 1 -- 172.21.15.8:0/4084302918 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08031a10 con 0x7f0d200c1520 2023-10-14T10:33:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.668+0000 7f0d25355640 1 -- 172.21.15.8:0/4084302918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d200c1520 msgr2=0x7f0d2006d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.668+0000 7f0d25355640 1 --2- 172.21.15.8:0/4084302918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d200c1520 0x7f0d2006d810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d200c1210 tx=0x7f0d0802b7c0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.669+0000 7f0d25355640 1 -- 172.21.15.8:0/4084302918 shutdown_connections 2023-10-14T10:33:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.669+0000 7f0d25355640 1 --2- 172.21.15.8:0/4084302918 >> v2:172.21.15.92:3300/0 conn(0x7f0d200c0950 0x7f0d2014aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.669+0000 7f0d25355640 1 --2- 172.21.15.8:0/4084302918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d200c1520 0x7f0d2006d810 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.669+0000 7f0d25355640 1 -- 172.21.15.8:0/4084302918 >> 172.21.15.8:0/4084302918 conn(0x7f0d200a74d0 msgr2=0x7f0d200a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:51.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.669+0000 7f0d25355640 1 -- 172.21.15.8:0/4084302918 shutdown_connections 2023-10-14T10:33:51.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.669+0000 7f0d25355640 1 -- 172.21.15.8:0/4084302918 wait complete. 2023-10-14T10:33:51.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.670+0000 7f0d25355640 1 Processor -- start 2023-10-14T10:33:51.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.670+0000 7f0d25355640 1 -- start start 2023-10-14T10:33:51.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.671+0000 7f0d25355640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d200c0950 0x7f0d2015e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:51.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.671+0000 7f0d25355640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d200c1520 0x7f0d200c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:51.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.671+0000 7f0d25355640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d200c5a10 0x7f0d201ec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:51.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.671+0000 7f0d25355640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201442a0 con 0x7f0d200c5a10 2023-10-14T10:33:51.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.671+0000 7f0d25355640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2015dd60 con 0x7f0d200c0950 2023-10-14T10:33:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.671+0000 7f0d25355640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d20151000 con 0x7f0d200c1520 2023-10-14T10:33:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.671+0000 7f0d1f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d200c5a10 0x7f0d201ec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.672+0000 7f0d1f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d200c5a10 0x7f0d201ec8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46796/0 (socket says 172.21.15.8:46796) 2023-10-14T10:33:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.672+0000 7f0d1f7fe640 1 -- 172.21.15.8:0/2690070729 learned_addr learned my addr 172.21.15.8:0/2690070729 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.672+0000 7f0d1effd640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d200c0950 0x7f0d2015e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:51.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.672+0000 7f0d167fc640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d200c1520 0x7f0d200c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:51.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.672+0000 7f0d1f7fe640 1 -- 172.21.15.8:0/2690070729 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d200c1520 msgr2=0x7f0d200c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:51.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.672+0000 7f0d1f7fe640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d200c1520 0x7f0d200c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.672+0000 7f0d1f7fe640 1 -- 172.21.15.8:0/2690070729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d200c0950 msgr2=0x7f0d2015e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:51.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.672+0000 7f0d1f7fe640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d200c0950 0x7f0d2015e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.672+0000 7f0d1f7fe640 1 -- 172.21.15.8:0/2690070729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08009400 con 0x7f0d200c5a10 2023-10-14T10:33:51.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.672+0000 7f0d1effd640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d200c0950 0x7f0d2015e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:51.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.672+0000 7f0d1f7fe640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d200c5a10 0x7f0d201ec8d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800c7c0 tx=0x7f0d1800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:51.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.672+0000 7f0d17fff640 1 -- 172.21.15.8:0/2690070729 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18004230 con 0x7f0d200c5a10 2023-10-14T10:33:51.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.673+0000 7f0d17fff640 1 -- 172.21.15.8:0/2690070729 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d18004390 con 0x7f0d200c5a10 2023-10-14T10:33:51.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.673+0000 7f0d17fff640 1 -- 172.21.15.8:0/2690070729 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18007860 con 0x7f0d200c5a10 2023-10-14T10:33:51.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.673+0000 7f0d25355640 1 -- 172.21.15.8:0/2690070729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d200a9900 con 0x7f0d200c5a10 2023-10-14T10:33:51.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.673+0000 7f0d25355640 1 -- 172.21.15.8:0/2690070729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d20150060 con 0x7f0d200c5a10 2023-10-14T10:33:51.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.674+0000 7f0d25355640 1 -- 172.21.15.8:0/2690070729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d200c0110 con 0x7f0d200c5a10 2023-10-14T10:33:51.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.675+0000 7f0d17fff640 1 -- 172.21.15.8:0/2690070729 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0d180079c0 con 0x7f0d200c5a10 2023-10-14T10:33:51.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.676+0000 7f0d17fff640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0d0006ae70 0x7f0d0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:51.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.676+0000 7f0d17fff640 1 -- 172.21.15.8:0/2690070729 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d180897c0 con 0x7f0d200c5a10 2023-10-14T10:33:51.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.676+0000 7f0d1effd640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0d0006ae70 0x7f0d0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:51.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.677+0000 7f0d1effd640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0d0006ae70 0x7f0d0006d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d10005c00 tx=0x7f0d10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:51.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.680+0000 7f0d17fff640 1 -- 172.21.15.8:0/2690070729 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d180549c0 con 0x7f0d200c5a10 2023-10-14T10:33:51.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.874+0000 7f0d25355640 1 -- 172.21.15.8:0/2690070729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d20144000 con 0x7f0d200c5a10 2023-10-14T10:33:51.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.876+0000 7f0d17fff640 1 -- 172.21.15.8:0/2690070729 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7f0d20144000 con 0x7f0d200c5a10 2023-10-14T10:33:51.878 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:51.879 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:33:51.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.878+0000 7f0d25355640 1 -- 172.21.15.8:0/2690070729 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0d0006ae70 msgr2=0x7f0d0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:51.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.878+0000 7f0d25355640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0d0006ae70 0x7f0d0006d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d10005c00 tx=0x7f0d10009040 comp rx=0 tx=0).stop 2023-10-14T10:33:51.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.878+0000 7f0d25355640 1 -- 172.21.15.8:0/2690070729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d200c5a10 msgr2=0x7f0d201ec8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:51.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.878+0000 7f0d25355640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d200c5a10 0x7f0d201ec8d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800c7c0 tx=0x7f0d1800cc80 comp rx=0 tx=0).stop 2023-10-14T10:33:51.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.879+0000 7f0d25355640 1 -- 172.21.15.8:0/2690070729 shutdown_connections 2023-10-14T10:33:51.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.879+0000 7f0d25355640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0d0006ae70 0x7f0d0006d330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.879+0000 7f0d25355640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d200c5a10 0x7f0d201ec8d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.879+0000 7f0d25355640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d200c1520 0x7f0d200c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.879+0000 7f0d25355640 1 --2- 172.21.15.8:0/2690070729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d200c0950 0x7f0d2015e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:51.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.879+0000 7f0d25355640 1 -- 172.21.15.8:0/2690070729 >> 172.21.15.8:0/2690070729 conn(0x7f0d200a74d0 msgr2=0x7f0d20149df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:51.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.879+0000 7f0d25355640 1 -- 172.21.15.8:0/2690070729 shutdown_connections 2023-10-14T10:33:51.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:51.879+0000 7f0d25355640 1 -- 172.21.15.8:0/2690070729 wait complete. 2023-10-14T10:33:51.899 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T10:33:51.899 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T10:33:52.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.123+0000 7f79e0bf0640 1 Processor -- start 2023-10-14T10:33:52.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.124+0000 7f79e0bf0640 1 -- start start 2023-10-14T10:33:52.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.125+0000 7f79e0bf0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79dc1514c0 0x7f79dc06b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.125+0000 7f79e0bf0640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f79dc0c50f0 0x7f79dc0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.125+0000 7f79e0bf0640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc1543b0 con 0x7f79dc154840 2023-10-14T10:33:52.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.125+0000 7f79e0bf0640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc06c3c0 con 0x7f79dc0c50f0 2023-10-14T10:33:52.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.125+0000 7f79e0bf0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc153e30 con 0x7f79dc1514c0 2023-10-14T10:33:52.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.125+0000 7f79d2ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f79dc0c50f0 0x7f79dc0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.126+0000 7f79d2ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f79dc0c50f0 0x7f79dc0c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46800/0 (socket says 172.21.15.8:46800) 2023-10-14T10:33:52.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.126+0000 7f79d2ffd640 1 -- 172.21.15.8:0/4289410659 learned_addr learned my addr 172.21.15.8:0/4289410659 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:52.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.126+0000 7f79db7fe640 1 --2- 172.21.15.8:0/4289410659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79dc1514c0 0x7f79dc06b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.126+0000 7f79d2ffd640 1 -- 172.21.15.8:0/4289410659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79dc1514c0 msgr2=0x7f79dc06b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:52.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.126+0000 7f79d2ffd640 1 --2- 172.21.15.8:0/4289410659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79dc1514c0 0x7f79dc06b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.126+0000 7f79d2ffd640 1 -- 172.21.15.8:0/4289410659 >> v1:172.21.15.92:6789/0 conn(0x7f79dc154840 legacy=0x7f79dc0c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:52.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.126+0000 7f79d2ffd640 1 -- 172.21.15.8:0/4289410659 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc1518a0 con 0x7f79dc0c50f0 2023-10-14T10:33:52.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.127+0000 7f79d2ffd640 1 --2- 172.21.15.8:0/4289410659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79dc0c50f0 0x7f79dc0c7530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009870 tx=0x7f79c402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aead8e23cdea42c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:52.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.127+0000 7f79daffd640 1 -- 172.21.15.8:0/4289410659 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c40317c0 con 0x7f79dc0c50f0 2023-10-14T10:33:52.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.128+0000 7f79daffd640 1 -- 172.21.15.8:0/4289410659 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c4031920 con 0x7f79dc0c50f0 2023-10-14T10:33:52.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.128+0000 7f79daffd640 1 -- 172.21.15.8:0/4289410659 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4031cb0 con 0x7f79dc0c50f0 2023-10-14T10:33:52.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.128+0000 7f79e0bf0640 1 -- 172.21.15.8:0/4289410659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79dc0c50f0 msgr2=0x7f79dc0c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:52.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.128+0000 7f79e0bf0640 1 --2- 172.21.15.8:0/4289410659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79dc0c50f0 0x7f79dc0c7530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009870 tx=0x7f79c402b860 comp rx=0 tx=0).stop 2023-10-14T10:33:52.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.128+0000 7f79e0bf0640 1 -- 172.21.15.8:0/4289410659 shutdown_connections 2023-10-14T10:33:52.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.128+0000 7f79e0bf0640 1 --2- 172.21.15.8:0/4289410659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79dc0c50f0 0x7f79dc0c7530 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.128+0000 7f79e0bf0640 1 --2- 172.21.15.8:0/4289410659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79dc1514c0 0x7f79dc06b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.128+0000 7f79e0bf0640 1 -- 172.21.15.8:0/4289410659 >> 172.21.15.8:0/4289410659 conn(0x7f79dc0c60b0 msgr2=0x7f79dc0c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:52.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.128+0000 7f79e0bf0640 1 -- 172.21.15.8:0/4289410659 shutdown_connections 2023-10-14T10:33:52.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.128+0000 7f79e0bf0640 1 -- 172.21.15.8:0/4289410659 wait complete. 2023-10-14T10:33:52.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.130+0000 7f79e0bf0640 1 Processor -- start 2023-10-14T10:33:52.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.130+0000 7f79e0bf0640 1 -- start start 2023-10-14T10:33:52.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79e0bf0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79dc0c50f0 0x7f79dc1e9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79e0bf0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79dc1514c0 0x7f79dc0aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79e0bf0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79dc154840 0x7f79dc0c0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79e0bf0640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc0ab600 con 0x7f79dc0c50f0 2023-10-14T10:33:52.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79e0bf0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc1e9f50 con 0x7f79dc1514c0 2023-10-14T10:33:52.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79e0bf0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc0aaf60 con 0x7f79dc154840 2023-10-14T10:33:52.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79db7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79dc0c50f0 0x7f79dc1e9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79db7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79dc0c50f0 0x7f79dc1e9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46808/0 (socket says 172.21.15.8:46808) 2023-10-14T10:33:52.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79db7fe640 1 -- 172.21.15.8:0/3001036314 learned_addr learned my addr 172.21.15.8:0/3001036314 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:52.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79db7fe640 1 -- 172.21.15.8:0/3001036314 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79dc154840 msgr2=0x7f79dc0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:52.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79db7fe640 1 --2- 172.21.15.8:0/3001036314 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79dc154840 0x7f79dc0c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79db7fe640 1 -- 172.21.15.8:0/3001036314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79dc1514c0 msgr2=0x7f79dc0aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:52.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79db7fe640 1 --2- 172.21.15.8:0/3001036314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79dc1514c0 0x7f79dc0aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.131+0000 7f79db7fe640 1 -- 172.21.15.8:0/3001036314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c40094d0 con 0x7f79dc0c50f0 2023-10-14T10:33:52.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.132+0000 7f79db7fe640 1 --2- 172.21.15.8:0/3001036314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79dc0c50f0 0x7f79dc1e9a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00ce40 tx=0x7f79cc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:52.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.132+0000 7f79d8ff9640 1 -- 172.21.15.8:0/3001036314 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc003b90 con 0x7f79dc0c50f0 2023-10-14T10:33:52.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.132+0000 7f79d8ff9640 1 -- 172.21.15.8:0/3001036314 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc003cf0 con 0x7f79dc0c50f0 2023-10-14T10:33:52.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.132+0000 7f79d8ff9640 1 -- 172.21.15.8:0/3001036314 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc004240 con 0x7f79dc0c50f0 2023-10-14T10:33:52.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.132+0000 7f79e0bf0640 1 -- 172.21.15.8:0/3001036314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc0abf60 con 0x7f79dc0c50f0 2023-10-14T10:33:52.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.132+0000 7f79e0bf0640 1 -- 172.21.15.8:0/3001036314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc14df00 con 0x7f79dc0c50f0 2023-10-14T10:33:52.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.133+0000 7f79e0bf0640 1 -- 172.21.15.8:0/3001036314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc14e880 con 0x7f79dc0c50f0 2023-10-14T10:33:52.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.134+0000 7f79d8ff9640 1 -- 172.21.15.8:0/3001036314 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f79cc0043a0 con 0x7f79dc0c50f0 2023-10-14T10:33:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.135+0000 7f79d8ff9640 1 --2- 172.21.15.8:0/3001036314 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79bc06ae70 0x7f79bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.135+0000 7f79d8ff9640 1 -- 172.21.15.8:0/3001036314 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79cc012070 con 0x7f79dc0c50f0 2023-10-14T10:33:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.135+0000 7f79d2ffd640 1 --2- 172.21.15.8:0/3001036314 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79bc06ae70 0x7f79bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.136+0000 7f79d2ffd640 1 --2- 172.21.15.8:0/3001036314 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79bc06ae70 0x7f79bc06d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f79c4036000 tx=0x7f79c4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.139+0000 7f79d8ff9640 1 -- 172.21.15.8:0/3001036314 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79cc0550a0 con 0x7f79dc0c50f0 2023-10-14T10:33:52.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.329+0000 7f79e0bf0640 1 -- 172.21.15.8:0/3001036314 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79dc0c5890 con 0x7f79bc06ae70 2023-10-14T10:33:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.354+0000 7f79d8ff9640 1 -- 172.21.15.8:0/3001036314 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264464 (secure 0 0 0) 0x7f79c4031b10 con 0x7f79bc06ae70 2023-10-14T10:33:52.360 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:52.362 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T10:33:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.361+0000 7f79e0bf0640 1 -- 172.21.15.8:0/3001036314 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79bc06ae70 msgr2=0x7f79bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.361+0000 7f79e0bf0640 1 --2- 172.21.15.8:0/3001036314 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79bc06ae70 0x7f79bc06d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f79c4036000 tx=0x7f79c4030000 comp rx=0 tx=0).stop 2023-10-14T10:33:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.361+0000 7f79e0bf0640 1 -- 172.21.15.8:0/3001036314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79dc0c50f0 msgr2=0x7f79dc1e9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.361+0000 7f79e0bf0640 1 --2- 172.21.15.8:0/3001036314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79dc0c50f0 0x7f79dc1e9a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00ce40 tx=0x7f79cc00a660 comp rx=0 tx=0).stop 2023-10-14T10:33:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.361+0000 7f79e0bf0640 1 -- 172.21.15.8:0/3001036314 shutdown_connections 2023-10-14T10:33:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.361+0000 7f79e0bf0640 1 --2- 172.21.15.8:0/3001036314 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79bc06ae70 0x7f79bc06d330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.361+0000 7f79e0bf0640 1 --2- 172.21.15.8:0/3001036314 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79dc154840 0x7f79dc0c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.361+0000 7f79e0bf0640 1 --2- 172.21.15.8:0/3001036314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79dc1514c0 0x7f79dc0aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.361+0000 7f79e0bf0640 1 --2- 172.21.15.8:0/3001036314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79dc0c50f0 0x7f79dc1e9a10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.361+0000 7f79e0bf0640 1 -- 172.21.15.8:0/3001036314 >> 172.21.15.8:0/3001036314 conn(0x7f79dc0c60b0 msgr2=0x7f79dc14ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:52.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.361+0000 7f79e0bf0640 1 -- 172.21.15.8:0/3001036314 shutdown_connections 2023-10-14T10:33:52.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.361+0000 7f79e0bf0640 1 -- 172.21.15.8:0/3001036314 wait complete. 2023-10-14T10:33:52.380 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-14T10:33:50.632842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236036,"kb_used_data":2872,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738684,"statfs":{"total":773094113280,"available":772852412416,"internally_reserved":0,"allocated":2940928,"data_stored":1764908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.742214"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654359+0000","last_change":"2023-10-14T10:33:47.504191+0000","last_active":"2023-10-14T10:33:49.654359+0000","last_peered":"2023-10-14T10:33:49.654359+0000","last_clean":"2023-10-14T10:33:49.654359+0000","last_became_active":"2023-10-14T10:33:47.503838+0000","last_became_peered":"2023-10-14T10:33:47.503838+0000","last_unstale":"2023-10-14T10:33:49.654359+0000","last_undegraded":"2023-10-14T10:33:49.654359+0000","last_fullsized":"2023-10-14T10:33:49.654359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:37.834157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456736+0000","last_change":"2023-10-14T10:33:47.486126+0000","last_active":"2023-10-14T10:33:48.456736+0000","last_peered":"2023-10-14T10:33:48.456736+0000","last_clean":"2023-10-14T10:33:48.456736+0000","last_became_active":"2023-10-14T10:33:47.484535+0000","last_became_peered":"2023-10-14T10:33:47.484535+0000","last_unstale":"2023-10-14T10:33:48.456736+0000","last_undegraded":"2023-10-14T10:33:48.456736+0000","last_fullsized":"2023-10-14T10:33:48.456736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653537+0000","last_change":"2023-10-14T10:33:47.481217+0000","last_active":"2023-10-14T10:33:49.653537+0000","last_peered":"2023-10-14T10:33:49.653537+0000","last_clean":"2023-10-14T10:33:49.653537+0000","last_became_active":"2023-10-14T10:33:47.480170+0000","last_became_peered":"2023-10-14T10:33:47.480170+0000","last_unstale":"2023-10-14T10:33:49.653537+0000","last_undegraded":"2023-10-14T10:33:49.653537+0000","last_fullsized":"2023-10-14T10:33:49.653537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462757+0000","last_change":"2023-10-14T10:33:47.481641+0000","last_active":"2023-10-14T10:33:48.462757+0000","last_peered":"2023-10-14T10:33:48.462757+0000","last_clean":"2023-10-14T10:33:48.462757+0000","last_became_active":"2023-10-14T10:33:47.481143+0000","last_became_peered":"2023-10-14T10:33:47.481143+0000","last_unstale":"2023-10-14T10:33:48.462757+0000","last_undegraded":"2023-10-14T10:33:48.462757+0000","last_fullsized":"2023-10-14T10:33:48.462757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:13:18.695800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653106+0000","last_change":"2023-10-14T10:33:47.495716+0000","last_active":"2023-10-14T10:33:49.653106+0000","last_peered":"2023-10-14T10:33:49.653106+0000","last_clean":"2023-10-14T10:33:49.653106+0000","last_became_active":"2023-10-14T10:33:47.495391+0000","last_became_peered":"2023-10-14T10:33:47.495391+0000","last_unstale":"2023-10-14T10:33:49.653106+0000","last_undegraded":"2023-10-14T10:33:49.653106+0000","last_fullsized":"2023-10-14T10:33:49.653106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:00.621252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462279+0000","last_change":"2023-10-14T10:33:47.485901+0000","last_active":"2023-10-14T10:33:48.462279+0000","last_peered":"2023-10-14T10:33:48.462279+0000","last_clean":"2023-10-14T10:33:48.462279+0000","last_became_active":"2023-10-14T10:33:47.485410+0000","last_became_peered":"2023-10-14T10:33:47.485410+0000","last_unstale":"2023-10-14T10:33:48.462279+0000","last_undegraded":"2023-10-14T10:33:48.462279+0000","last_fullsized":"2023-10-14T10:33:48.462279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:13.355108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651994+0000","last_change":"2023-10-14T10:33:47.494929+0000","last_active":"2023-10-14T10:33:49.651994+0000","last_peered":"2023-10-14T10:33:49.651994+0000","last_clean":"2023-10-14T10:33:49.651994+0000","last_became_active":"2023-10-14T10:33:47.494645+0000","last_became_peered":"2023-10-14T10:33:47.494645+0000","last_unstale":"2023-10-14T10:33:49.651994+0000","last_undegraded":"2023-10-14T10:33:49.651994+0000","last_fullsized":"2023-10-14T10:33:49.651994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:47.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.211860+0000","last_change":"2023-10-14T10:33:47.480684+0000","last_active":"2023-10-14T10:33:49.211860+0000","last_peered":"2023-10-14T10:33:49.211860+0000","last_clean":"2023-10-14T10:33:49.211860+0000","last_became_active":"2023-10-14T10:33:47.480247+0000","last_became_peered":"2023-10-14T10:33:47.480247+0000","last_unstale":"2023-10-14T10:33:49.211860+0000","last_undegraded":"2023-10-14T10:33:49.211860+0000","last_fullsized":"2023-10-14T10:33:49.211860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654569+0000","last_change":"2023-10-14T10:33:47.500899+0000","last_active":"2023-10-14T10:33:49.654569+0000","last_peered":"2023-10-14T10:33:49.654569+0000","last_clean":"2023-10-14T10:33:49.654569+0000","last_became_active":"2023-10-14T10:33:47.500541+0000","last_became_peered":"2023-10-14T10:33:47.500541+0000","last_unstale":"2023-10-14T10:33:49.654569+0000","last_undegraded":"2023-10-14T10:33:49.654569+0000","last_fullsized":"2023-10-14T10:33:49.654569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:03.978194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653275+0000","last_change":"2023-10-14T10:33:47.484954+0000","last_active":"2023-10-14T10:33:49.653275+0000","last_peered":"2023-10-14T10:33:49.653275+0000","last_clean":"2023-10-14T10:33:49.653275+0000","last_became_active":"2023-10-14T10:33:47.484596+0000","last_became_peered":"2023-10-14T10:33:47.484596+0000","last_unstale":"2023-10-14T10:33:49.653275+0000","last_undegraded":"2023-10-14T10:33:49.653275+0000","last_fullsized":"2023-10-14T10:33:49.653275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652603+0000","last_change":"2023-10-14T10:33:47.503231+0000","last_active":"2023-10-14T10:33:49.652603+0000","last_peered":"2023-10-14T10:33:49.652603+0000","last_clean":"2023-10-14T10:33:49.652603+0000","last_became_active":"2023-10-14T10:33:47.496705+0000","last_became_peered":"2023-10-14T10:33:47.496705+0000","last_unstale":"2023-10-14T10:33:49.652603+0000","last_undegraded":"2023-10-14T10:33:49.652603+0000","last_fullsized":"2023-10-14T10:33:49.652603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.459938+0000","last_change":"2023-10-14T10:33:47.502726+0000","last_active":"2023-10-14T10:33:48.459938+0000","last_peered":"2023-10-14T10:33:48.459938+0000","last_clean":"2023-10-14T10:33:48.459938+0000","last_became_active":"2023-10-14T10:33:47.501799+0000","last_became_peered":"2023-10-14T10:33:47.501799+0000","last_unstale":"2023-10-14T10:33:48.459938+0000","last_undegraded":"2023-10-14T10:33:48.459938+0000","last_fullsized":"2023-10-14T10:33:48.459938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:10:51.321625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212506+0000","last_change":"2023-10-14T10:33:47.488816+0000","last_active":"2023-10-14T10:33:49.212506+0000","last_peered":"2023-10-14T10:33:49.212506+0000","last_clean":"2023-10-14T10:33:49.212506+0000","last_became_active":"2023-10-14T10:33:47.488505+0000","last_became_peered":"2023-10-14T10:33:47.488505+0000","last_unstale":"2023-10-14T10:33:49.212506+0000","last_undegraded":"2023-10-14T10:33:49.212506+0000","last_fullsized":"2023-10-14T10:33:49.212506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.305043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652714+0000","last_change":"2023-10-14T10:33:47.482197+0000","last_active":"2023-10-14T10:33:49.652714+0000","last_peered":"2023-10-14T10:33:49.652714+0000","last_clean":"2023-10-14T10:33:49.652714+0000","last_became_active":"2023-10-14T10:33:47.481209+0000","last_became_peered":"2023-10-14T10:33:47.481209+0000","last_unstale":"2023-10-14T10:33:49.652714+0000","last_undegraded":"2023-10-14T10:33:49.652714+0000","last_fullsized":"2023-10-14T10:33:49.652714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:02.548595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456348+0000","last_change":"2023-10-14T10:33:47.469873+0000","last_active":"2023-10-14T10:33:48.456348+0000","last_peered":"2023-10-14T10:33:48.456348+0000","last_clean":"2023-10-14T10:33:48.456348+0000","last_became_active":"2023-10-14T10:33:47.469462+0000","last_became_peered":"2023-10-14T10:33:47.469462+0000","last_unstale":"2023-10-14T10:33:48.456348+0000","last_undegraded":"2023-10-14T10:33:48.456348+0000","last_fullsized":"2023-10-14T10:33:48.456348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.461731+0000","last_change":"2023-10-14T10:33:47.484628+0000","last_active":"2023-10-14T10:33:48.461731+0000","last_peered":"2023-10-14T10:33:48.461731+0000","last_clean":"2023-10-14T10:33:48.461731+0000","last_became_active":"2023-10-14T10:33:47.484319+0000","last_became_peered":"2023-10-14T10:33:47.484319+0000","last_unstale":"2023-10-14T10:33:48.461731+0000","last_undegraded":"2023-10-14T10:33:48.461731+0000","last_fullsized":"2023-10-14T10:33:48.461731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463105+0000","last_change":"2023-10-14T10:33:47.494508+0000","last_active":"2023-10-14T10:33:48.463105+0000","last_peered":"2023-10-14T10:33:48.463105+0000","last_clean":"2023-10-14T10:33:48.463105+0000","last_became_active":"2023-10-14T10:33:47.494119+0000","last_became_peered":"2023-10-14T10:33:47.494119+0000","last_unstale":"2023-10-14T10:33:48.463105+0000","last_undegraded":"2023-10-14T10:33:48.463105+0000","last_fullsized":"2023-10-14T10:33:48.463105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:37.834157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651364+0000","last_change":"2023-10-14T10:33:47.482878+0000","last_active":"2023-10-14T10:33:49.651364+0000","last_peered":"2023-10-14T10:33:49.651364+0000","last_clean":"2023-10-14T10:33:49.651364+0000","last_became_active":"2023-10-14T10:33:47.482566+0000","last_became_peered":"2023-10-14T10:33:47.482566+0000","last_unstale":"2023-10-14T10:33:49.651364+0000","last_undegraded":"2023-10-14T10:33:49.651364+0000","last_fullsized":"2023-10-14T10:33:49.651364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:08.668848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654211+0000","last_change":"2023-10-14T10:33:47.497038+0000","last_active":"2023-10-14T10:33:49.654211+0000","last_peered":"2023-10-14T10:33:49.654211+0000","last_clean":"2023-10-14T10:33:49.654211+0000","last_became_active":"2023-10-14T10:33:47.496705+0000","last_became_peered":"2023-10-14T10:33:47.496705+0000","last_unstale":"2023-10-14T10:33:49.654211+0000","last_undegraded":"2023-10-14T10:33:49.654211+0000","last_fullsized":"2023-10-14T10:33:49.654211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:20.511159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652680+0000","last_change":"2023-10-14T10:33:47.497999+0000","last_active":"2023-10-14T10:33:49.652680+0000","last_peered":"2023-10-14T10:33:49.652680+0000","last_clean":"2023-10-14T10:33:49.652680+0000","last_became_active":"2023-10-14T10:33:47.494872+0000","last_became_peered":"2023-10-14T10:33:47.494872+0000","last_unstale":"2023-10-14T10:33:49.652680+0000","last_undegraded":"2023-10-14T10:33:49.652680+0000","last_fullsized":"2023-10-14T10:33:49.652680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653148+0000","last_change":"2023-10-14T10:33:47.490809+0000","last_active":"2023-10-14T10:33:49.653148+0000","last_peered":"2023-10-14T10:33:49.653148+0000","last_clean":"2023-10-14T10:33:49.653148+0000","last_became_active":"2023-10-14T10:33:47.490523+0000","last_became_peered":"2023-10-14T10:33:47.490523+0000","last_unstale":"2023-10-14T10:33:49.653148+0000","last_undegraded":"2023-10-14T10:33:49.653148+0000","last_fullsized":"2023-10-14T10:33:49.653148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:28.374613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462234+0000","last_change":"2023-10-14T10:33:47.491586+0000","last_active":"2023-10-14T10:33:48.462234+0000","last_peered":"2023-10-14T10:33:48.462234+0000","last_clean":"2023-10-14T10:33:48.462234+0000","last_became_active":"2023-10-14T10:33:47.491262+0000","last_became_peered":"2023-10-14T10:33:47.491262+0000","last_unstale":"2023-10-14T10:33:48.462234+0000","last_undegraded":"2023-10-14T10:33:48.462234+0000","last_fullsized":"2023-10-14T10:33:48.462234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:47.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.211866+0000","last_change":"2023-10-14T10:33:47.479860+0000","last_active":"2023-10-14T10:33:49.211866+0000","last_peered":"2023-10-14T10:33:49.211866+0000","last_clean":"2023-10-14T10:33:49.211866+0000","last_became_active":"2023-10-14T10:33:47.479536+0000","last_became_peered":"2023-10-14T10:33:47.479536+0000","last_unstale":"2023-10-14T10:33:49.211866+0000","last_undegraded":"2023-10-14T10:33:49.211866+0000","last_fullsized":"2023-10-14T10:33:49.211866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.461909+0000","last_change":"2023-10-14T10:33:47.480950+0000","last_active":"2023-10-14T10:33:48.461909+0000","last_peered":"2023-10-14T10:33:48.461909+0000","last_clean":"2023-10-14T10:33:48.461909+0000","last_became_active":"2023-10-14T10:33:47.480623+0000","last_became_peered":"2023-10-14T10:33:47.480623+0000","last_unstale":"2023-10-14T10:33:48.461909+0000","last_undegraded":"2023-10-14T10:33:48.461909+0000","last_fullsized":"2023-10-14T10:33:48.461909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.305043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212838+0000","last_change":"2023-10-14T10:33:47.476116+0000","last_active":"2023-10-14T10:33:49.212838+0000","last_peered":"2023-10-14T10:33:49.212838+0000","last_clean":"2023-10-14T10:33:49.212838+0000","last_became_active":"2023-10-14T10:33:47.475806+0000","last_became_peered":"2023-10-14T10:33:47.475806+0000","last_unstale":"2023-10-14T10:33:49.212838+0000","last_undegraded":"2023-10-14T10:33:49.212838+0000","last_fullsized":"2023-10-14T10:33:49.212838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:13.355108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653449+0000","last_change":"2023-10-14T10:33:47.503282+0000","last_active":"2023-10-14T10:33:49.653449+0000","last_peered":"2023-10-14T10:33:49.653449+0000","last_clean":"2023-10-14T10:33:49.653449+0000","last_became_active":"2023-10-14T10:33:47.498347+0000","last_became_peered":"2023-10-14T10:33:47.498347+0000","last_unstale":"2023-10-14T10:33:49.653449+0000","last_undegraded":"2023-10-14T10:33:49.653449+0000","last_fullsized":"2023-10-14T10:33:49.653449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.305043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456488+0000","last_change":"2023-10-14T10:33:47.477397+0000","last_active":"2023-10-14T10:33:48.456488+0000","last_peered":"2023-10-14T10:33:48.456488+0000","last_clean":"2023-10-14T10:33:48.456488+0000","last_became_active":"2023-10-14T10:33:47.477023+0000","last_became_peered":"2023-10-14T10:33:47.477023+0000","last_unstale":"2023-10-14T10:33:48.456488+0000","last_undegraded":"2023-10-14T10:33:48.456488+0000","last_fullsized":"2023-10-14T10:33:48.456488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212867+0000","last_change":"2023-10-14T10:33:47.483158+0000","last_active":"2023-10-14T10:33:49.212867+0000","last_peered":"2023-10-14T10:33:49.212867+0000","last_clean":"2023-10-14T10:33:49.212867+0000","last_became_active":"2023-10-14T10:33:47.481098+0000","last_became_peered":"2023-10-14T10:33:47.481098+0000","last_unstale":"2023-10-14T10:33:49.212867+0000","last_undegraded":"2023-10-14T10:33:49.212867+0000","last_fullsized":"2023-10-14T10:33:49.212867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:58.057067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653230+0000","last_change":"2023-10-14T10:33:47.481204+0000","last_active":"2023-10-14T10:33:49.653230+0000","last_peered":"2023-10-14T10:33:49.653230+0000","last_clean":"2023-10-14T10:33:49.653230+0000","last_became_active":"2023-10-14T10:33:47.480212+0000","last_became_peered":"2023-10-14T10:33:47.480212+0000","last_unstale":"2023-10-14T10:33:49.653230+0000","last_undegraded":"2023-10-14T10:33:49.653230+0000","last_fullsized":"2023-10-14T10:33:49.653230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462667+0000","last_change":"2023-10-14T10:33:47.480818+0000","last_active":"2023-10-14T10:33:48.462667+0000","last_peered":"2023-10-14T10:33:48.462667+0000","last_clean":"2023-10-14T10:33:48.462667+0000","last_became_active":"2023-10-14T10:33:47.480593+0000","last_became_peered":"2023-10-14T10:33:47.480593+0000","last_unstale":"2023-10-14T10:33:48.462667+0000","last_undegraded":"2023-10-14T10:33:48.462667+0000","last_fullsized":"2023-10-14T10:33:48.462667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:11.483101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.650911+0000","last_change":"2023-10-14T10:33:47.477330+0000","last_active":"2023-10-14T10:33:49.650911+0000","last_peered":"2023-10-14T10:33:49.650911+0000","last_clean":"2023-10-14T10:33:49.650911+0000","last_became_active":"2023-10-14T10:33:47.476922+0000","last_became_peered":"2023-10-14T10:33:47.476922+0000","last_unstale":"2023-10-14T10:33:49.650911+0000","last_undegraded":"2023-10-14T10:33:49.650911+0000","last_fullsized":"2023-10-14T10:33:49.650911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:34:46.239394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651600+0000","last_change":"2023-10-14T10:33:47.496369+0000","last_active":"2023-10-14T10:33:49.651600+0000","last_peered":"2023-10-14T10:33:49.651600+0000","last_clean":"2023-10-14T10:33:49.651600+0000","last_became_active":"2023-10-14T10:33:47.494458+0000","last_became_peered":"2023-10-14T10:33:47.494458+0000","last_unstale":"2023-10-14T10:33:49.651600+0000","last_undegraded":"2023-10-14T10:33:49.651600+0000","last_fullsized":"2023-10-14T10:33:49.651600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.459427+0000","last_change":"2023-10-14T10:33:47.469801+0000","last_active":"2023-10-14T10:33:48.459427+0000","last_peered":"2023-10-14T10:33:48.459427+0000","last_clean":"2023-10-14T10:33:48.459427+0000","last_became_active":"2023-10-14T10:33:47.468284+0000","last_became_peered":"2023-10-14T10:33:47.468284+0000","last_unstale":"2023-10-14T10:33:48.459427+0000","last_undegraded":"2023-10-14T10:33:48.459427+0000","last_fullsized":"2023-10-14T10:33:48.459427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:35.323602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212468+0000","last_change":"2023-10-14T10:33:46.944464+0000","last_active":"2023-10-14T10:33:49.212468+0000","last_peered":"2023-10-14T10:33:49.212468+0000","last_clean":"2023-10-14T10:33:49.212468+0000","last_became_active":"2023-10-14T10:33:46.943975+0000","last_became_peered":"2023-10-14T10:33:46.943975+0000","last_unstale":"2023-10-14T10:33:49.212468+0000","last_undegraded":"2023-10-14T10:33:49.212468+0000","last_fullsized":"2023-10-14T10:33:49.212468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653470+0000","last_change":"2023-10-14T10:33:47.487990+0000","last_active":"2023-10-14T10:33:49.653470+0000","last_peered":"2023-10-14T10:33:49.653470+0000","last_clean":"2023-10-14T10:33:49.653470+0000","last_became_active":"2023-10-14T10:33:47.487504+0000","last_became_peered":"2023-10-14T10:33:47.487504+0000","last_unstale":"2023-10-14T10:33:49.653470+0000","last_undegraded":"2023-10-14T10:33:49.653470+0000","last_fullsized":"2023-10-14T10:33:49.653470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652732+0000","last_change":"2023-10-14T10:33:46.944422+0000","last_active":"2023-10-14T10:33:49.652732+0000","last_peered":"2023-10-14T10:33:49.652732+0000","last_clean":"2023-10-14T10:33:49.652732+0000","last_became_active":"2023-10-14T10:33:46.944045+0000","last_became_peered":"2023-10-14T10:33:46.944045+0000","last_unstale":"2023-10-14T10:33:49.652732+0000","last_undegraded":"2023-10-14T10:33:49.652732+0000","last_fullsized":"2023-10-14T10:33:49.652732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212102+0000","last_change":"2023-10-14T10:33:46.946032+0000","last_active":"2023-10-14T10:33:49.212102+0000","last_peered":"2023-10-14T10:33:49.212102+0000","last_clean":"2023-10-14T10:33:49.212102+0000","last_became_active":"2023-10-14T10:33:46.945694+0000","last_became_peered":"2023-10-14T10:33:46.945694+0000","last_unstale":"2023-10-14T10:33:49.212102+0000","last_undegraded":"2023-10-14T10:33:49.212102+0000","last_fullsized":"2023-10-14T10:33:49.212102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:35.235012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212057+0000","last_change":"2023-10-14T10:33:47.486768+0000","last_active":"2023-10-14T10:33:49.212057+0000","last_peered":"2023-10-14T10:33:49.212057+0000","last_clean":"2023-10-14T10:33:49.212057+0000","last_became_active":"2023-10-14T10:33:47.486477+0000","last_became_peered":"2023-10-14T10:33:47.486477+0000","last_unstale":"2023-10-14T10:33:49.212057+0000","last_undegraded":"2023-10-14T10:33:49.212057+0000","last_fullsized":"2023-10-14T10:33:49.212057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462041+0000","last_change":"2023-10-14T10:33:46.943179+0000","last_active":"2023-10-14T10:33:48.462041+0000","last_peered":"2023-10-14T10:33:48.462041+0000","last_clean":"2023-10-14T10:33:48.462041+0000","last_became_active":"2023-10-14T10:33:46.942887+0000","last_became_peered":"2023-10-14T10:33:46.942887+0000","last_unstale":"2023-10-14T10:33:48.462041+0000","last_undegraded":"2023-10-14T10:33:48.462041+0000","last_fullsized":"2023-10-14T10:33:48.462041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:01.285291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456237+0000","last_change":"2023-10-14T10:33:47.477341+0000","last_active":"2023-10-14T10:33:48.456237+0000","last_peered":"2023-10-14T10:33:48.456237+0000","last_clean":"2023-10-14T10:33:48.456237+0000","last_became_active":"2023-10-14T10:33:47.476425+0000","last_became_peered":"2023-10-14T10:33:47.476425+0000","last_unstale":"2023-10-14T10:33:48.456237+0000","last_undegraded":"2023-10-14T10:33:48.456237+0000","last_fullsized":"2023-10-14T10:33:48.456237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652803+0000","last_change":"2023-10-14T10:33:46.946573+0000","last_active":"2023-10-14T10:33:49.652803+0000","last_peered":"2023-10-14T10:33:49.652803+0000","last_clean":"2023-10-14T10:33:49.652803+0000","last_became_active":"2023-10-14T10:33:46.945846+0000","last_became_peered":"2023-10-14T10:33:46.945846+0000","last_unstale":"2023-10-14T10:33:49.652803+0000","last_undegraded":"2023-10-14T10:33:49.652803+0000","last_fullsized":"2023-10-14T10:33:49.652803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:28.392606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462337+0000","last_change":"2023-10-14T10:33:47.494832+0000","last_active":"2023-10-14T10:33:48.462337+0000","last_peered":"2023-10-14T10:33:48.462337+0000","last_clean":"2023-10-14T10:33:48.462337+0000","last_became_active":"2023-10-14T10:33:47.494306+0000","last_became_peered":"2023-10-14T10:33:47.494306+0000","last_unstale":"2023-10-14T10:33:48.462337+0000","last_undegraded":"2023-10-14T10:33:48.462337+0000","last_fullsized":"2023-10-14T10:33:48.462337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:58.057067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462569+0000","last_change":"2023-10-14T10:33:46.946908+0000","last_active":"2023-10-14T10:33:48.462569+0000","last_peered":"2023-10-14T10:33:48.462569+0000","last_clean":"2023-10-14T10:33:48.462569+0000","last_became_active":"2023-10-14T10:33:46.946623+0000","last_became_peered":"2023-10-14T10:33:46.946623+0000","last_unstale":"2023-10-14T10:33:48.462569+0000","last_undegraded":"2023-10-14T10:33:48.462569+0000","last_fullsized":"2023-10-14T10:33:48.462569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653979+0000","last_change":"2023-10-14T10:33:47.485672+0000","last_active":"2023-10-14T10:33:49.653979+0000","last_peered":"2023-10-14T10:33:49.653979+0000","last_clean":"2023-10-14T10:33:49.653979+0000","last_became_active":"2023-10-14T10:33:47.485336+0000","last_became_peered":"2023-10-14T10:33:47.485336+0000","last_unstale":"2023-10-14T10:33:49.653979+0000","last_undegraded":"2023-10-14T10:33:49.653979+0000","last_fullsized":"2023-10-14T10:33:49.653979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456519+0000","last_change":"2023-10-14T10:33:46.942861+0000","last_active":"2023-10-14T10:33:48.456519+0000","last_peered":"2023-10-14T10:33:48.456519+0000","last_clean":"2023-10-14T10:33:48.456519+0000","last_became_active":"2023-10-14T10:33:46.942559+0000","last_became_peered":"2023-10-14T10:33:46.942559+0000","last_unstale":"2023-10-14T10:33:48.456519+0000","last_undegraded":"2023-10-14T10:33:48.456519+0000","last_fullsized":"2023-10-14T10:33:48.456519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:01.285291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460271+0000","last_change":"2023-10-14T10:33:47.496746+0000","last_active":"2023-10-14T10:33:48.460271+0000","last_peered":"2023-10-14T10:33:48.460271+0000","last_clean":"2023-10-14T10:33:48.460271+0000","last_became_active":"2023-10-14T10:33:47.495439+0000","last_became_peered":"2023-10-14T10:33:47.495439+0000","last_unstale":"2023-10-14T10:33:48.460271+0000","last_undegraded":"2023-10-14T10:33:48.460271+0000","last_fullsized":"2023-10-14T10:33:48.460271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:36.498316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652736+0000","last_change":"2023-10-14T10:33:46.948656+0000","last_active":"2023-10-14T10:33:49.652736+0000","last_peered":"2023-10-14T10:33:49.652736+0000","last_clean":"2023-10-14T10:33:49.652736+0000","last_became_active":"2023-10-14T10:33:46.945172+0000","last_became_peered":"2023-10-14T10:33:46.945172+0000","last_unstale":"2023-10-14T10:33:49.652736+0000","last_undegraded":"2023-10-14T10:33:49.652736+0000","last_fullsized":"2023-10-14T10:33:49.652736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:27.111309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653869+0000","last_change":"2023-10-14T10:33:47.494774+0000","last_active":"2023-10-14T10:33:49.653869+0000","last_peered":"2023-10-14T10:33:49.653869+0000","last_clean":"2023-10-14T10:33:49.653869+0000","last_became_active":"2023-10-14T10:33:47.494464+0000","last_became_peered":"2023-10-14T10:33:47.494464+0000","last_unstale":"2023-10-14T10:33:49.653869+0000","last_undegraded":"2023-10-14T10:33:49.653869+0000","last_fullsized":"2023-10-14T10:33:49.653869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:11.483101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653515+0000","last_change":"2023-10-14T10:33:46.949538+0000","last_active":"2023-10-14T10:33:49.653515+0000","last_peered":"2023-10-14T10:33:49.653515+0000","last_clean":"2023-10-14T10:33:49.653515+0000","last_became_active":"2023-10-14T10:33:46.949221+0000","last_became_peered":"2023-10-14T10:33:46.949221+0000","last_unstale":"2023-10-14T10:33:49.653515+0000","last_undegraded":"2023-10-14T10:33:49.653515+0000","last_fullsized":"2023-10-14T10:33:49.653515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:24.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652794+0000","last_change":"2023-10-14T10:33:47.495094+0000","last_active":"2023-10-14T10:33:49.652794+0000","last_peered":"2023-10-14T10:33:49.652794+0000","last_clean":"2023-10-14T10:33:49.652794+0000","last_became_active":"2023-10-14T10:33:47.494462+0000","last_became_peered":"2023-10-14T10:33:47.494462+0000","last_unstale":"2023-10-14T10:33:49.652794+0000","last_undegraded":"2023-10-14T10:33:49.652794+0000","last_fullsized":"2023-10-14T10:33:49.652794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:21.485819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463293+0000","last_change":"2023-10-14T10:33:46.949862+0000","last_active":"2023-10-14T10:33:48.463293+0000","last_peered":"2023-10-14T10:33:48.463293+0000","last_clean":"2023-10-14T10:33:48.463293+0000","last_became_active":"2023-10-14T10:33:46.949575+0000","last_became_peered":"2023-10-14T10:33:46.949575+0000","last_unstale":"2023-10-14T10:33:48.463293+0000","last_undegraded":"2023-10-14T10:33:48.463293+0000","last_fullsized":"2023-10-14T10:33:48.463293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:51.370720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653325+0000","last_change":"2023-10-14T10:33:47.499315+0000","last_active":"2023-10-14T10:33:49.653325+0000","last_peered":"2023-10-14T10:33:49.653325+0000","last_clean":"2023-10-14T10:33:49.653325+0000","last_became_active":"2023-10-14T10:33:47.498922+0000","last_became_peered":"2023-10-14T10:33:47.498922+0000","last_unstale":"2023-10-14T10:33:49.653325+0000","last_undegraded":"2023-10-14T10:33:49.653325+0000","last_fullsized":"2023-10-14T10:33:49.653325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:10.602705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651606+0000","last_change":"2023-10-14T10:33:46.947577+0000","last_active":"2023-10-14T10:33:49.651606+0000","last_peered":"2023-10-14T10:33:49.651606+0000","last_clean":"2023-10-14T10:33:49.651606+0000","last_became_active":"2023-10-14T10:33:46.947158+0000","last_became_peered":"2023-10-14T10:33:46.947158+0000","last_unstale":"2023-10-14T10:33:49.651606+0000","last_undegraded":"2023-10-14T10:33:49.651606+0000","last_fullsized":"2023-10-14T10:33:49.651606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651703+0000","last_change":"2023-10-14T10:33:47.482689+0000","last_active":"2023-10-14T10:33:49.651703+0000","last_peered":"2023-10-14T10:33:49.651703+0000","last_clean":"2023-10-14T10:33:49.651703+0000","last_became_active":"2023-10-14T10:33:47.482301+0000","last_became_peered":"2023-10-14T10:33:47.482301+0000","last_unstale":"2023-10-14T10:33:49.651703+0000","last_undegraded":"2023-10-14T10:33:49.651703+0000","last_fullsized":"2023-10-14T10:33:49.651703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.650670+0000","last_change":"2023-10-14T10:33:46.933875+0000","last_active":"2023-10-14T10:33:49.650670+0000","last_peered":"2023-10-14T10:33:49.650670+0000","last_clean":"2023-10-14T10:33:49.650670+0000","last_became_active":"2023-10-14T10:33:46.932445+0000","last_became_peered":"2023-10-14T10:33:46.932445+0000","last_unstale":"2023-10-14T10:33:49.650670+0000","last_undegraded":"2023-10-14T10:33:49.650670+0000","last_fullsized":"2023-10-14T10:33:49.650670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:23.669098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652199+0000","last_change":"2023-10-14T10:33:47.500004+0000","last_active":"2023-10-14T10:33:49.652199+0000","last_peered":"2023-10-14T10:33:49.652199+0000","last_clean":"2023-10-14T10:33:49.652199+0000","last_became_active":"2023-10-14T10:33:47.499661+0000","last_became_peered":"2023-10-14T10:33:47.499661+0000","last_unstale":"2023-10-14T10:33:49.652199+0000","last_undegraded":"2023-10-14T10:33:49.652199+0000","last_fullsized":"2023-10-14T10:33:49.652199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:13.355108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460519+0000","last_change":"2023-10-14T10:33:46.941041+0000","last_active":"2023-10-14T10:33:48.460519+0000","last_peered":"2023-10-14T10:33:48.460519+0000","last_clean":"2023-10-14T10:33:48.460519+0000","last_became_active":"2023-10-14T10:33:46.940755+0000","last_became_peered":"2023-10-14T10:33:46.940755+0000","last_unstale":"2023-10-14T10:33:48.460519+0000","last_undegraded":"2023-10-14T10:33:48.460519+0000","last_fullsized":"2023-10-14T10:33:48.460519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:58.183303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652938+0000","last_change":"2023-10-14T10:33:47.501109+0000","last_active":"2023-10-14T10:33:49.652938+0000","last_peered":"2023-10-14T10:33:49.652938+0000","last_clean":"2023-10-14T10:33:49.652938+0000","last_became_active":"2023-10-14T10:33:47.500841+0000","last_became_peered":"2023-10-14T10:33:47.500841+0000","last_unstale":"2023-10-14T10:33:49.652938+0000","last_undegraded":"2023-10-14T10:33:49.652938+0000","last_fullsized":"2023-10-14T10:33:49.652938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:58.057067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651355+0000","last_change":"2023-10-14T10:33:46.934433+0000","last_active":"2023-10-14T10:33:49.651355+0000","last_peered":"2023-10-14T10:33:49.651355+0000","last_clean":"2023-10-14T10:33:49.651355+0000","last_became_active":"2023-10-14T10:33:46.934173+0000","last_became_peered":"2023-10-14T10:33:46.934173+0000","last_unstale":"2023-10-14T10:33:49.651355+0000","last_undegraded":"2023-10-14T10:33:49.651355+0000","last_fullsized":"2023-10-14T10:33:49.651355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:34.060298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654571+0000","last_change":"2023-10-14T10:33:47.500414+0000","last_active":"2023-10-14T10:33:49.654571+0000","last_peered":"2023-10-14T10:33:49.654571+0000","last_clean":"2023-10-14T10:33:49.654571+0000","last_became_active":"2023-10-14T10:33:47.500103+0000","last_became_peered":"2023-10-14T10:33:47.500103+0000","last_unstale":"2023-10-14T10:33:49.654571+0000","last_undegraded":"2023-10-14T10:33:49.654571+0000","last_fullsized":"2023-10-14T10:33:49.654571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:55.928753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456627+0000","last_change":"2023-10-14T10:33:46.929461+0000","last_active":"2023-10-14T10:33:48.456627+0000","last_peered":"2023-10-14T10:33:48.456627+0000","last_clean":"2023-10-14T10:33:48.456627+0000","last_became_active":"2023-10-14T10:33:46.928486+0000","last_became_peered":"2023-10-14T10:33:46.928486+0000","last_unstale":"2023-10-14T10:33:48.456627+0000","last_undegraded":"2023-10-14T10:33:48.456627+0000","last_fullsized":"2023-10-14T10:33:48.456627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:27.111309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463161+0000","last_change":"2023-10-14T10:33:47.483087+0000","last_active":"2023-10-14T10:33:48.463161+0000","last_peered":"2023-10-14T10:33:48.463161+0000","last_clean":"2023-10-14T10:33:48.463161+0000","last_became_active":"2023-10-14T10:33:47.481501+0000","last_became_peered":"2023-10-14T10:33:47.481501+0000","last_unstale":"2023-10-14T10:33:48.463161+0000","last_undegraded":"2023-10-14T10:33:48.463161+0000","last_fullsized":"2023-10-14T10:33:48.463161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:03.978194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651260+0000","last_change":"2023-10-14T10:33:46.943701+0000","last_active":"2023-10-14T10:33:49.651260+0000","last_peered":"2023-10-14T10:33:49.651260+0000","last_clean":"2023-10-14T10:33:49.651260+0000","last_became_active":"2023-10-14T10:33:46.942265+0000","last_became_peered":"2023-10-14T10:33:46.942265+0000","last_unstale":"2023-10-14T10:33:49.651260+0000","last_undegraded":"2023-10-14T10:33:49.651260+0000","last_fullsized":"2023-10-14T10:33:49.651260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:10:50.058321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653885+0000","last_change":"2023-10-14T10:33:47.502823+0000","last_active":"2023-10-14T10:33:49.653885+0000","last_peered":"2023-10-14T10:33:49.653885+0000","last_clean":"2023-10-14T10:33:49.653885+0000","last_became_active":"2023-10-14T10:33:47.502237+0000","last_became_peered":"2023-10-14T10:33:47.502237+0000","last_unstale":"2023-10-14T10:33:49.653885+0000","last_undegraded":"2023-10-14T10:33:49.653885+0000","last_fullsized":"2023-10-14T10:33:49.653885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:13:18.695800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T10:33:47.489150+0000","last_change":"2023-10-14T10:33:42.821659+0000","last_active":"2023-10-14T10:33:47.489150+0000","last_peered":"2023-10-14T10:33:47.489150+0000","last_clean":"2023-10-14T10:33:47.489150+0000","last_became_active":"2023-10-14T10:33:42.819441+0000","last_became_peered":"2023-10-14T10:33:42.819441+0000","last_unstale":"2023-10-14T10:33:47.489150+0000","last_undegraded":"2023-10-14T10:33:47.489150+0000","last_fullsized":"2023-10-14T10:33:47.489150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_clean_scrub_stamp":"2023-10-14T10:33:41.468382+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:59.542930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.461818+0000","last_change":"2023-10-14T10:33:46.932732+0000","last_active":"2023-10-14T10:33:48.461818+0000","last_peered":"2023-10-14T10:33:48.461818+0000","last_clean":"2023-10-14T10:33:48.461818+0000","last_became_active":"2023-10-14T10:33:46.929319+0000","last_became_peered":"2023-10-14T10:33:46.929319+0000","last_unstale":"2023-10-14T10:33:48.461818+0000","last_undegraded":"2023-10-14T10:33:48.461818+0000","last_fullsized":"2023-10-14T10:33:48.461818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:24.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.211843+0000","last_change":"2023-10-14T10:33:47.480133+0000","last_active":"2023-10-14T10:33:49.211843+0000","last_peered":"2023-10-14T10:33:49.211843+0000","last_clean":"2023-10-14T10:33:49.211843+0000","last_became_active":"2023-10-14T10:33:47.479802+0000","last_became_peered":"2023-10-14T10:33:47.479802+0000","last_unstale":"2023-10-14T10:33:49.211843+0000","last_undegraded":"2023-10-14T10:33:49.211843+0000","last_fullsized":"2023-10-14T10:33:49.211843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651892+0000","last_change":"2023-10-14T10:33:46.951335+0000","last_active":"2023-10-14T10:33:49.651892+0000","last_peered":"2023-10-14T10:33:49.651892+0000","last_clean":"2023-10-14T10:33:49.651892+0000","last_became_active":"2023-10-14T10:33:46.950717+0000","last_became_peered":"2023-10-14T10:33:46.950717+0000","last_unstale":"2023-10-14T10:33:49.651892+0000","last_undegraded":"2023-10-14T10:33:49.651892+0000","last_fullsized":"2023-10-14T10:33:49.651892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:35.235012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652648+0000","last_change":"2023-10-14T10:33:47.486246+0000","last_active":"2023-10-14T10:33:49.652648+0000","last_peered":"2023-10-14T10:33:49.652648+0000","last_clean":"2023-10-14T10:33:49.652648+0000","last_became_active":"2023-10-14T10:33:47.485935+0000","last_became_peered":"2023-10-14T10:33:47.485935+0000","last_unstale":"2023-10-14T10:33:49.652648+0000","last_undegraded":"2023-10-14T10:33:49.652648+0000","last_fullsized":"2023-10-14T10:33:49.652648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:29.655910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651005+0000","last_change":"2023-10-14T10:33:46.932409+0000","last_active":"2023-10-14T10:33:49.651005+0000","last_peered":"2023-10-14T10:33:49.651005+0000","last_clean":"2023-10-14T10:33:49.651005+0000","last_became_active":"2023-10-14T10:33:46.932081+0000","last_became_peered":"2023-10-14T10:33:46.932081+0000","last_unstale":"2023-10-14T10:33:49.651005+0000","last_undegraded":"2023-10-14T10:33:49.651005+0000","last_fullsized":"2023-10-14T10:33:49.651005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:35.235012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456692+0000","last_change":"2023-10-14T10:33:47.472076+0000","last_active":"2023-10-14T10:33:48.456692+0000","last_peered":"2023-10-14T10:33:48.456692+0000","last_clean":"2023-10-14T10:33:48.456692+0000","last_became_active":"2023-10-14T10:33:47.471729+0000","last_became_peered":"2023-10-14T10:33:47.471729+0000","last_unstale":"2023-10-14T10:33:48.456692+0000","last_undegraded":"2023-10-14T10:33:48.456692+0000","last_fullsized":"2023-10-14T10:33:48.456692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463351+0000","last_change":"2023-10-14T10:33:46.940624+0000","last_active":"2023-10-14T10:33:48.463351+0000","last_peered":"2023-10-14T10:33:48.463351+0000","last_clean":"2023-10-14T10:33:48.463351+0000","last_became_active":"2023-10-14T10:33:46.939832+0000","last_became_peered":"2023-10-14T10:33:46.939832+0000","last_unstale":"2023-10-14T10:33:48.463351+0000","last_undegraded":"2023-10-14T10:33:48.463351+0000","last_fullsized":"2023-10-14T10:33:48.463351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:14.846393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460408+0000","last_change":"2023-10-14T10:33:47.482352+0000","last_active":"2023-10-14T10:33:48.460408+0000","last_peered":"2023-10-14T10:33:48.460408+0000","last_clean":"2023-10-14T10:33:48.460408+0000","last_became_active":"2023-10-14T10:33:47.482107+0000","last_became_peered":"2023-10-14T10:33:47.482107+0000","last_unstale":"2023-10-14T10:33:48.460408+0000","last_undegraded":"2023-10-14T10:33:48.460408+0000","last_fullsized":"2023-10-14T10:33:48.460408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:34:46.239394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456396+0000","last_change":"2023-10-14T10:33:46.938082+0000","last_active":"2023-10-14T10:33:48.456396+0000","last_peered":"2023-10-14T10:33:48.456396+0000","last_clean":"2023-10-14T10:33:48.456396+0000","last_became_active":"2023-10-14T10:33:46.937753+0000","last_became_peered":"2023-10-14T10:33:46.937753+0000","last_unstale":"2023-10-14T10:33:48.456396+0000","last_undegraded":"2023-10-14T10:33:48.456396+0000","last_fullsized":"2023-10-14T10:33:48.456396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:24.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462602+0000","last_change":"2023-10-14T10:33:47.476592+0000","last_active":"2023-10-14T10:33:48.462602+0000","last_peered":"2023-10-14T10:33:48.462602+0000","last_clean":"2023-10-14T10:33:48.462602+0000","last_became_active":"2023-10-14T10:33:47.476154+0000","last_became_peered":"2023-10-14T10:33:47.476154+0000","last_unstale":"2023-10-14T10:33:48.462602+0000","last_undegraded":"2023-10-14T10:33:48.462602+0000","last_fullsized":"2023-10-14T10:33:48.462602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:10.602705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654137+0000","last_change":"2023-10-14T10:33:46.953499+0000","last_active":"2023-10-14T10:33:49.654137+0000","last_peered":"2023-10-14T10:33:49.654137+0000","last_clean":"2023-10-14T10:33:49.654137+0000","last_became_active":"2023-10-14T10:33:46.953253+0000","last_became_peered":"2023-10-14T10:33:46.953253+0000","last_unstale":"2023-10-14T10:33:49.654137+0000","last_undegraded":"2023-10-14T10:33:49.654137+0000","last_fullsized":"2023-10-14T10:33:49.654137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:05.299234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456292+0000","last_change":"2023-10-14T10:33:47.474355+0000","last_active":"2023-10-14T10:33:48.456292+0000","last_peered":"2023-10-14T10:33:48.456292+0000","last_clean":"2023-10-14T10:33:48.456292+0000","last_became_active":"2023-10-14T10:33:47.473947+0000","last_became_peered":"2023-10-14T10:33:47.473947+0000","last_unstale":"2023-10-14T10:33:48.456292+0000","last_undegraded":"2023-10-14T10:33:48.456292+0000","last_fullsized":"2023-10-14T10:33:48.456292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456734+0000","last_change":"2023-10-14T10:33:46.946715+0000","last_active":"2023-10-14T10:33:48.456734+0000","last_peered":"2023-10-14T10:33:48.456734+0000","last_clean":"2023-10-14T10:33:48.456734+0000","last_became_active":"2023-10-14T10:33:46.946368+0000","last_became_peered":"2023-10-14T10:33:46.946368+0000","last_unstale":"2023-10-14T10:33:48.456734+0000","last_undegraded":"2023-10-14T10:33:48.456734+0000","last_fullsized":"2023-10-14T10:33:48.456734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.213127+0000","last_change":"2023-10-14T10:33:47.494870+0000","last_active":"2023-10-14T10:33:49.213127+0000","last_peered":"2023-10-14T10:33:49.213127+0000","last_clean":"2023-10-14T10:33:49.213127+0000","last_became_active":"2023-10-14T10:33:47.494561+0000","last_became_peered":"2023-10-14T10:33:47.494561+0000","last_unstale":"2023-10-14T10:33:49.213127+0000","last_undegraded":"2023-10-14T10:33:49.213127+0000","last_fullsized":"2023-10-14T10:33:49.213127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:00.621252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652945+0000","last_change":"2023-10-14T10:33:46.952942+0000","last_active":"2023-10-14T10:33:49.652945+0000","last_peered":"2023-10-14T10:33:49.652945+0000","last_clean":"2023-10-14T10:33:49.652945+0000","last_became_active":"2023-10-14T10:33:46.952649+0000","last_became_peered":"2023-10-14T10:33:46.952649+0000","last_unstale":"2023-10-14T10:33:49.652945+0000","last_undegraded":"2023-10-14T10:33:49.652945+0000","last_fullsized":"2023-10-14T10:33:49.652945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:01.285291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653758+0000","last_change":"2023-10-14T10:33:47.481610+0000","last_active":"2023-10-14T10:33:49.653758+0000","last_peered":"2023-10-14T10:33:49.653758+0000","last_clean":"2023-10-14T10:33:49.653758+0000","last_became_active":"2023-10-14T10:33:47.481134+0000","last_became_peered":"2023-10-14T10:33:47.481134+0000","last_unstale":"2023-10-14T10:33:49.653758+0000","last_undegraded":"2023-10-14T10:33:49.653758+0000","last_fullsized":"2023-10-14T10:33:49.653758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651537+0000","last_change":"2023-10-14T10:33:46.951887+0000","last_active":"2023-10-14T10:33:49.651537+0000","last_peered":"2023-10-14T10:33:49.651537+0000","last_clean":"2023-10-14T10:33:49.651537+0000","last_became_active":"2023-10-14T10:33:46.951005+0000","last_became_peered":"2023-10-14T10:33:46.951005+0000","last_unstale":"2023-10-14T10:33:49.651537+0000","last_undegraded":"2023-10-14T10:33:49.651537+0000","last_fullsized":"2023-10-14T10:33:49.651537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:44.489158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460796+0000","last_change":"2023-10-14T10:33:47.472416+0000","last_active":"2023-10-14T10:33:48.460796+0000","last_peered":"2023-10-14T10:33:48.460796+0000","last_clean":"2023-10-14T10:33:48.460796+0000","last_became_active":"2023-10-14T10:33:47.472042+0000","last_became_peered":"2023-10-14T10:33:47.472042+0000","last_unstale":"2023-10-14T10:33:48.460796+0000","last_undegraded":"2023-10-14T10:33:48.460796+0000","last_fullsized":"2023-10-14T10:33:48.460796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:08.668848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456421+0000","last_change":"2023-10-14T10:33:46.943709+0000","last_active":"2023-10-14T10:33:48.456421+0000","last_peered":"2023-10-14T10:33:48.456421+0000","last_clean":"2023-10-14T10:33:48.456421+0000","last_became_active":"2023-10-14T10:33:46.943331+0000","last_became_peered":"2023-10-14T10:33:46.943331+0000","last_unstale":"2023-10-14T10:33:48.456421+0000","last_undegraded":"2023-10-14T10:33:48.456421+0000","last_fullsized":"2023-10-14T10:33:48.456421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212270+0000","last_change":"2023-10-14T10:33:47.485638+0000","last_active":"2023-10-14T10:33:49.212270+0000","last_peered":"2023-10-14T10:33:49.212270+0000","last_clean":"2023-10-14T10:33:49.212270+0000","last_became_active":"2023-10-14T10:33:47.485152+0000","last_became_peered":"2023-10-14T10:33:47.485152+0000","last_unstale":"2023-10-14T10:33:49.212270+0000","last_undegraded":"2023-10-14T10:33:49.212270+0000","last_fullsized":"2023-10-14T10:33:49.212270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456868+0000","last_change":"2023-10-14T10:33:46.940511+0000","last_active":"2023-10-14T10:33:48.456868+0000","last_peered":"2023-10-14T10:33:48.456868+0000","last_clean":"2023-10-14T10:33:48.456868+0000","last_became_active":"2023-10-14T10:33:46.940203+0000","last_became_peered":"2023-10-14T10:33:46.940203+0000","last_unstale":"2023-10-14T10:33:48.456868+0000","last_undegraded":"2023-10-14T10:33:48.456868+0000","last_fullsized":"2023-10-14T10:33:48.456868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:34.060298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212360+0000","last_change":"2023-10-14T10:33:47.484334+0000","last_active":"2023-10-14T10:33:49.212360+0000","last_peered":"2023-10-14T10:33:49.212360+0000","last_clean":"2023-10-14T10:33:49.212360+0000","last_became_active":"2023-10-14T10:33:47.484053+0000","last_became_peered":"2023-10-14T10:33:47.484053+0000","last_unstale":"2023-10-14T10:33:49.212360+0000","last_undegraded":"2023-10-14T10:33:49.212360+0000","last_fullsized":"2023-10-14T10:33:49.212360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653506+0000","last_change":"2023-10-14T10:33:46.952342+0000","last_active":"2023-10-14T10:33:49.653506+0000","last_peered":"2023-10-14T10:33:49.653506+0000","last_clean":"2023-10-14T10:33:49.653506+0000","last_became_active":"2023-10-14T10:33:46.952054+0000","last_became_peered":"2023-10-14T10:33:46.952054+0000","last_unstale":"2023-10-14T10:33:49.653506+0000","last_undegraded":"2023-10-14T10:33:49.653506+0000","last_fullsized":"2023-10-14T10:33:49.653506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:07.405544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652415+0000","last_change":"2023-10-14T10:33:47.483290+0000","last_active":"2023-10-14T10:33:49.652415+0000","last_peered":"2023-10-14T10:33:49.652415+0000","last_clean":"2023-10-14T10:33:49.652415+0000","last_became_active":"2023-10-14T10:33:47.482376+0000","last_became_peered":"2023-10-14T10:33:47.482376+0000","last_unstale":"2023-10-14T10:33:49.652415+0000","last_undegraded":"2023-10-14T10:33:49.652415+0000","last_fullsized":"2023-10-14T10:33:49.652415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462475+0000","last_change":"2023-10-14T10:33:47.474830+0000","last_active":"2023-10-14T10:33:48.462475+0000","last_peered":"2023-10-14T10:33:48.462475+0000","last_clean":"2023-10-14T10:33:48.462475+0000","last_became_active":"2023-10-14T10:33:47.474496+0000","last_became_peered":"2023-10-14T10:33:47.474496+0000","last_unstale":"2023-10-14T10:33:48.462475+0000","last_undegraded":"2023-10-14T10:33:48.462475+0000","last_fullsized":"2023-10-14T10:33:48.462475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:00.621252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653758+0000","last_change":"2023-10-14T10:33:46.952550+0000","last_active":"2023-10-14T10:33:49.653758+0000","last_peered":"2023-10-14T10:33:49.653758+0000","last_clean":"2023-10-14T10:33:49.653758+0000","last_became_active":"2023-10-14T10:33:46.952221+0000","last_became_peered":"2023-10-14T10:33:46.952221+0000","last_unstale":"2023-10-14T10:33:49.653758+0000","last_undegraded":"2023-10-14T10:33:49.653758+0000","last_fullsized":"2023-10-14T10:33:49.653758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462966+0000","last_change":"2023-10-14T10:33:47.480595+0000","last_active":"2023-10-14T10:33:48.462966+0000","last_peered":"2023-10-14T10:33:48.462966+0000","last_clean":"2023-10-14T10:33:48.462966+0000","last_became_active":"2023-10-14T10:33:47.479987+0000","last_became_peered":"2023-10-14T10:33:47.479987+0000","last_unstale":"2023-10-14T10:33:48.462966+0000","last_undegraded":"2023-10-14T10:33:48.462966+0000","last_fullsized":"2023-10-14T10:33:48.462966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:20.511159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654009+0000","last_change":"2023-10-14T10:33:46.956415+0000","last_active":"2023-10-14T10:33:49.654009+0000","last_peered":"2023-10-14T10:33:49.654009+0000","last_clean":"2023-10-14T10:33:49.654009+0000","last_became_active":"2023-10-14T10:33:46.956031+0000","last_became_peered":"2023-10-14T10:33:46.956031+0000","last_unstale":"2023-10-14T10:33:49.654009+0000","last_undegraded":"2023-10-14T10:33:49.654009+0000","last_fullsized":"2023-10-14T10:33:49.654009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:51.370720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654052+0000","last_change":"2023-10-14T10:33:47.487837+0000","last_active":"2023-10-14T10:33:49.654052+0000","last_peered":"2023-10-14T10:33:49.654052+0000","last_clean":"2023-10-14T10:33:49.654052+0000","last_became_active":"2023-10-14T10:33:47.487230+0000","last_became_peered":"2023-10-14T10:33:47.487230+0000","last_unstale":"2023-10-14T10:33:49.654052+0000","last_undegraded":"2023-10-14T10:33:49.654052+0000","last_fullsized":"2023-10-14T10:33:49.654052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.213080+0000","last_change":"2023-10-14T10:33:46.941475+0000","last_active":"2023-10-14T10:33:49.213080+0000","last_peered":"2023-10-14T10:33:49.213080+0000","last_clean":"2023-10-14T10:33:49.213080+0000","last_became_active":"2023-10-14T10:33:46.941184+0000","last_became_peered":"2023-10-14T10:33:46.941184+0000","last_unstale":"2023-10-14T10:33:49.213080+0000","last_undegraded":"2023-10-14T10:33:49.213080+0000","last_fullsized":"2023-10-14T10:33:49.213080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212744+0000","last_change":"2023-10-14T10:33:47.488896+0000","last_active":"2023-10-14T10:33:49.212744+0000","last_peered":"2023-10-14T10:33:49.212744+0000","last_clean":"2023-10-14T10:33:49.212744+0000","last_became_active":"2023-10-14T10:33:47.488561+0000","last_became_peered":"2023-10-14T10:33:47.488561+0000","last_unstale":"2023-10-14T10:33:49.212744+0000","last_undegraded":"2023-10-14T10:33:49.212744+0000","last_fullsized":"2023-10-14T10:33:49.212744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:47.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654339+0000","last_change":"2023-10-14T10:33:46.951000+0000","last_active":"2023-10-14T10:33:49.654339+0000","last_peered":"2023-10-14T10:33:49.654339+0000","last_clean":"2023-10-14T10:33:49.654339+0000","last_became_active":"2023-10-14T10:33:46.950678+0000","last_became_peered":"2023-10-14T10:33:46.950678+0000","last_unstale":"2023-10-14T10:33:49.654339+0000","last_undegraded":"2023-10-14T10:33:49.654339+0000","last_fullsized":"2023-10-14T10:33:49.654339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":802816,"data_stored":660219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.744}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.698}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.492}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":70881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.762}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8420000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.619}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.651}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9610000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.907}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":69269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.794}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4780000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.601}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.78}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3490000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":811008,"data_stored":660275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T10:33:52.386 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T10:33:52.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.650+0000 7fd53e475640 1 Processor -- start 2023-10-14T10:33:52.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.650+0000 7fd53e475640 1 -- start start 2023-10-14T10:33:52.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.652+0000 7fd53e475640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd53806b6e0 0x7fd5381555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.652+0000 7fd53e475640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd538155b00 0x7fd53815c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.652+0000 7fd53e475640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd538151bf0 con 0x7fd538152670 2023-10-14T10:33:52.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.652+0000 7fd53e475640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5380bffd0 con 0x7fd53806b6e0 2023-10-14T10:33:52.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.652+0000 7fd53e475640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380c02b0 con 0x7fd538155b00 2023-10-14T10:33:52.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.652+0000 7fd53d473640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd538152670 0x7fd5380c2110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34396/0 (socket says 172.21.15.8:34396) 2023-10-14T10:33:52.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.652+0000 7fd53d473640 1 -- 172.21.15.8:0/1423091359 learned_addr learned my addr 172.21.15.8:0/1423091359 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:52.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.652+0000 7fd53dc74640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd538155b00 0x7fd53815c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.652+0000 7fd53cc72640 1 --2- 172.21.15.8:0/1423091359 >> v2:172.21.15.92:3300/0 conn(0x7fd53806b6e0 0x7fd5381555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.652+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88840433 0 0) 0x7fd538151bf0 con 0x7fd538152670 2023-10-14T10:33:52.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.652+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd524003520 con 0x7fd538152670 2023-10-14T10:33:52.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4111669291 0 0) 0x7fd524003520 con 0x7fd538152670 2023-10-14T10:33:52.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd538155b00 msgr2=0x7fd53815c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:52.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd538155b00 0x7fd53815c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 >> v2:172.21.15.92:3300/0 conn(0x7fd53806b6e0 msgr2=0x7fd5381555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:52.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 --2- 172.21.15.8:0/1423091359 >> v2:172.21.15.92:3300/0 conn(0x7fd53806b6e0 0x7fd5381555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5380c0590 con 0x7fd538152670 2023-10-14T10:33:52.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fd534001670 con 0x7fd538152670 2023-10-14T10:33:52.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 >> v1:172.21.15.8:6789/0 conn(0x7fd538152670 legacy=0x7fd5380c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:52.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd524003970 0x7fd524003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5240047c0 0x7fd524004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd538155b00 0x7fd524005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380bffd0 con 0x7fd5240047c0 2023-10-14T10:33:52.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380c02b0 con 0x7fd524003970 2023-10-14T10:33:52.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.653+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52400b9d0 con 0x7fd538155b00 2023-10-14T10:33:52.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.654+0000 7fd53cc72640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5240047c0 0x7fd524004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.654+0000 7fd53dc74640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd538155b00 0x7fd524005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.654+0000 7fd53d473640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd524003970 0x7fd524003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.654+0000 7fd53cc72640 1 -- 172.21.15.8:0/1423091359 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd538155b00 msgr2=0x7fd524005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:52.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.654+0000 7fd53cc72640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd538155b00 0x7fd524005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.654+0000 7fd53cc72640 1 -- 172.21.15.8:0/1423091359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd524003970 msgr2=0x7fd524003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:52.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.654+0000 7fd53cc72640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd524003970 0x7fd524003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.654+0000 7fd53cc72640 1 -- 172.21.15.8:0/1423091359 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd524003520 con 0x7fd5240047c0 2023-10-14T10:33:52.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.654+0000 7fd53d473640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd524003970 0x7fd524003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:52.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.655+0000 7fd53cc72640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5240047c0 0x7fd524004c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd528009af0 tx=0x7fd5240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3e251db6f7e2f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:52.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.655+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52802c710 con 0x7fd5240047c0 2023-10-14T10:33:52.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.655+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52802c870 con 0x7fd5240047c0 2023-10-14T10:33:52.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.656+0000 7fd52ffff640 1 -- 172.21.15.8:0/1423091359 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52802cc00 con 0x7fd5240047c0 2023-10-14T10:33:52.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.656+0000 7fd53e475640 1 -- 172.21.15.8:0/1423091359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5240047c0 msgr2=0x7fd524004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:52.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.656+0000 7fd53e475640 1 --2- 172.21.15.8:0/1423091359 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5240047c0 0x7fd524004c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd528009af0 tx=0x7fd5240057f0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.656+0000 7fd53dc74640 1 -- 172.21.15.8:0/1423091359 reap_dead start 2023-10-14T10:33:52.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.656+0000 7fd53e475640 1 -- 172.21.15.8:0/1423091359 shutdown_connections 2023-10-14T10:33:52.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.656+0000 7fd53e475640 1 -- 172.21.15.8:0/1423091359 >> 172.21.15.8:0/1423091359 conn(0x7fd53806a200 msgr2=0x7fd53806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:52.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.656+0000 7fd53e475640 1 -- 172.21.15.8:0/1423091359 shutdown_connections 2023-10-14T10:33:52.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.656+0000 7fd53e475640 1 -- 172.21.15.8:0/1423091359 wait complete. 2023-10-14T10:33:52.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.658+0000 7fd53e475640 1 Processor -- start 2023-10-14T10:33:52.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.658+0000 7fd53e475640 1 -- start start 2023-10-14T10:33:52.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.659+0000 7fd53e475640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5240047c0 0x7fd5380c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.659+0000 7fd53e475640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd5380a82e0 0x7fd5381e9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.659+0000 7fd53e475640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5381e9850 0x7fd538141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.659+0000 7fd53e475640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380bedc0 con 0x7fd5240047c0 2023-10-14T10:33:52.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.659+0000 7fd53e475640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5381e8be0 con 0x7fd5381e9850 2023-10-14T10:33:52.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.659+0000 7fd53e475640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5381e8e80 con 0x7fd5380a82e0 2023-10-14T10:33:52.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.660+0000 7fd53d473640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5240047c0 0x7fd5380c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.660+0000 7fd53d473640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5240047c0 0x7fd5380c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46820/0 (socket says 172.21.15.8:46820) 2023-10-14T10:33:52.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.660+0000 7fd53d473640 1 -- 172.21.15.8:0/2837379592 learned_addr learned my addr 172.21.15.8:0/2837379592 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:52.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.660+0000 7fd53cc72640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd5380a82e0 0x7fd5381e9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.660+0000 7fd53dc74640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5381e9850 0x7fd538141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.660+0000 7fd53d473640 1 -- 172.21.15.8:0/2837379592 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd5380a82e0 msgr2=0x7fd5381e9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:52.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.660+0000 7fd53d473640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd5380a82e0 0x7fd5381e9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.660+0000 7fd53d473640 1 -- 172.21.15.8:0/2837379592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5381e9850 msgr2=0x7fd538141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:52.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.660+0000 7fd53d473640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5381e9850 0x7fd538141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.660+0000 7fd53d473640 1 -- 172.21.15.8:0/2837379592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5380be820 con 0x7fd5240047c0 2023-10-14T10:33:52.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.660+0000 7fd53dc74640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5381e9850 0x7fd538141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:52.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.660+0000 7fd53d473640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5240047c0 0x7fd5380c47e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd53400d810 tx=0x7fd53400dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:52.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.661+0000 7fd52dffb640 1 -- 172.21.15.8:0/2837379592 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5340074e0 con 0x7fd5240047c0 2023-10-14T10:33:52.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.661+0000 7fd52dffb640 1 -- 172.21.15.8:0/2837379592 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534007640 con 0x7fd5240047c0 2023-10-14T10:33:52.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.661+0000 7fd52dffb640 1 -- 172.21.15.8:0/2837379592 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534004a20 con 0x7fd5240047c0 2023-10-14T10:33:52.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.661+0000 7fd53e475640 1 -- 172.21.15.8:0/2837379592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5380beae0 con 0x7fd5240047c0 2023-10-14T10:33:52.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.661+0000 7fd53e475640 1 -- 172.21.15.8:0/2837379592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd538151cc0 con 0x7fd5240047c0 2023-10-14T10:33:52.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.662+0000 7fd53e475640 1 -- 172.21.15.8:0/2837379592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53804e9b0 con 0x7fd5240047c0 2023-10-14T10:33:52.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.663+0000 7fd52dffb640 1 -- 172.21.15.8:0/2837379592 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd534004b80 con 0x7fd5240047c0 2023-10-14T10:33:52.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.664+0000 7fd52dffb640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd51c06aea0 0x7fd51c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:52.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.664+0000 7fd52dffb640 1 -- 172.21.15.8:0/2837379592 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd534088f60 con 0x7fd5240047c0 2023-10-14T10:33:52.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.664+0000 7fd53cc72640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd51c06aea0 0x7fd51c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:52.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.665+0000 7fd53cc72640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd51c06aea0 0x7fd51c06d360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd528036000 tx=0x7fd528030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:52.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.669+0000 7fd52dffb640 1 -- 172.21.15.8:0/2837379592 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd534054000 con 0x7fd5240047c0 2023-10-14T10:33:52.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.858+0000 7fd53e475640 1 -- 172.21.15.8:0/2837379592 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5380c0870 con 0x7fd51c06aea0 2023-10-14T10:33:52.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.878+0000 7fd52dffb640 1 -- 172.21.15.8:0/2837379592 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264464 (secure 0 0 0) 0x7fd528004040 con 0x7fd51c06aea0 2023-10-14T10:33:52.884 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:52.885 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T10:33:52.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.883+0000 7fd53e475640 1 -- 172.21.15.8:0/2837379592 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd51c06aea0 msgr2=0x7fd51c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:52.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.883+0000 7fd53e475640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd51c06aea0 0x7fd51c06d360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd528036000 tx=0x7fd528030000 comp rx=0 tx=0).stop 2023-10-14T10:33:52.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.883+0000 7fd53e475640 1 -- 172.21.15.8:0/2837379592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5240047c0 msgr2=0x7fd5380c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:52.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.883+0000 7fd53e475640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5240047c0 0x7fd5380c47e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd53400d810 tx=0x7fd53400dcd0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.883+0000 7fd53e475640 1 -- 172.21.15.8:0/2837379592 shutdown_connections 2023-10-14T10:33:52.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.883+0000 7fd53e475640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd51c06aea0 0x7fd51c06d360 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.883+0000 7fd53e475640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5381e9850 0x7fd538141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.883+0000 7fd53e475640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd5380a82e0 0x7fd5381e9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.883+0000 7fd53e475640 1 --2- 172.21.15.8:0/2837379592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5240047c0 0x7fd5380c47e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:52.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.883+0000 7fd53e475640 1 -- 172.21.15.8:0/2837379592 >> 172.21.15.8:0/2837379592 conn(0x7fd53806a200 msgr2=0x7fd5380c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:52.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.884+0000 7fd53e475640 1 -- 172.21.15.8:0/2837379592 shutdown_connections 2023-10-14T10:33:52.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:52.884+0000 7fd53e475640 1 -- 172.21.15.8:0/2837379592 wait complete. 2023-10-14T10:33:52.909 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-14T10:33:52.633717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236036,"kb_used_data":2872,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738684,"statfs":{"total":773094113280,"available":772852412416,"internally_reserved":0,"allocated":2940928,"data_stored":1764908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001941"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654359+0000","last_change":"2023-10-14T10:33:47.504191+0000","last_active":"2023-10-14T10:33:49.654359+0000","last_peered":"2023-10-14T10:33:49.654359+0000","last_clean":"2023-10-14T10:33:49.654359+0000","last_became_active":"2023-10-14T10:33:47.503838+0000","last_became_peered":"2023-10-14T10:33:47.503838+0000","last_unstale":"2023-10-14T10:33:49.654359+0000","last_undegraded":"2023-10-14T10:33:49.654359+0000","last_fullsized":"2023-10-14T10:33:49.654359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:37.834157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456736+0000","last_change":"2023-10-14T10:33:47.486126+0000","last_active":"2023-10-14T10:33:48.456736+0000","last_peered":"2023-10-14T10:33:48.456736+0000","last_clean":"2023-10-14T10:33:48.456736+0000","last_became_active":"2023-10-14T10:33:47.484535+0000","last_became_peered":"2023-10-14T10:33:47.484535+0000","last_unstale":"2023-10-14T10:33:48.456736+0000","last_undegraded":"2023-10-14T10:33:48.456736+0000","last_fullsized":"2023-10-14T10:33:48.456736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653537+0000","last_change":"2023-10-14T10:33:47.481217+0000","last_active":"2023-10-14T10:33:49.653537+0000","last_peered":"2023-10-14T10:33:49.653537+0000","last_clean":"2023-10-14T10:33:49.653537+0000","last_became_active":"2023-10-14T10:33:47.480170+0000","last_became_peered":"2023-10-14T10:33:47.480170+0000","last_unstale":"2023-10-14T10:33:49.653537+0000","last_undegraded":"2023-10-14T10:33:49.653537+0000","last_fullsized":"2023-10-14T10:33:49.653537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462757+0000","last_change":"2023-10-14T10:33:47.481641+0000","last_active":"2023-10-14T10:33:48.462757+0000","last_peered":"2023-10-14T10:33:48.462757+0000","last_clean":"2023-10-14T10:33:48.462757+0000","last_became_active":"2023-10-14T10:33:47.481143+0000","last_became_peered":"2023-10-14T10:33:47.481143+0000","last_unstale":"2023-10-14T10:33:48.462757+0000","last_undegraded":"2023-10-14T10:33:48.462757+0000","last_fullsized":"2023-10-14T10:33:48.462757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:13:18.695800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653106+0000","last_change":"2023-10-14T10:33:47.495716+0000","last_active":"2023-10-14T10:33:49.653106+0000","last_peered":"2023-10-14T10:33:49.653106+0000","last_clean":"2023-10-14T10:33:49.653106+0000","last_became_active":"2023-10-14T10:33:47.495391+0000","last_became_peered":"2023-10-14T10:33:47.495391+0000","last_unstale":"2023-10-14T10:33:49.653106+0000","last_undegraded":"2023-10-14T10:33:49.653106+0000","last_fullsized":"2023-10-14T10:33:49.653106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:00.621252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462279+0000","last_change":"2023-10-14T10:33:47.485901+0000","last_active":"2023-10-14T10:33:48.462279+0000","last_peered":"2023-10-14T10:33:48.462279+0000","last_clean":"2023-10-14T10:33:48.462279+0000","last_became_active":"2023-10-14T10:33:47.485410+0000","last_became_peered":"2023-10-14T10:33:47.485410+0000","last_unstale":"2023-10-14T10:33:48.462279+0000","last_undegraded":"2023-10-14T10:33:48.462279+0000","last_fullsized":"2023-10-14T10:33:48.462279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:13.355108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651994+0000","last_change":"2023-10-14T10:33:47.494929+0000","last_active":"2023-10-14T10:33:49.651994+0000","last_peered":"2023-10-14T10:33:49.651994+0000","last_clean":"2023-10-14T10:33:49.651994+0000","last_became_active":"2023-10-14T10:33:47.494645+0000","last_became_peered":"2023-10-14T10:33:47.494645+0000","last_unstale":"2023-10-14T10:33:49.651994+0000","last_undegraded":"2023-10-14T10:33:49.651994+0000","last_fullsized":"2023-10-14T10:33:49.651994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:47.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.211860+0000","last_change":"2023-10-14T10:33:47.480684+0000","last_active":"2023-10-14T10:33:49.211860+0000","last_peered":"2023-10-14T10:33:49.211860+0000","last_clean":"2023-10-14T10:33:49.211860+0000","last_became_active":"2023-10-14T10:33:47.480247+0000","last_became_peered":"2023-10-14T10:33:47.480247+0000","last_unstale":"2023-10-14T10:33:49.211860+0000","last_undegraded":"2023-10-14T10:33:49.211860+0000","last_fullsized":"2023-10-14T10:33:49.211860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654569+0000","last_change":"2023-10-14T10:33:47.500899+0000","last_active":"2023-10-14T10:33:49.654569+0000","last_peered":"2023-10-14T10:33:49.654569+0000","last_clean":"2023-10-14T10:33:49.654569+0000","last_became_active":"2023-10-14T10:33:47.500541+0000","last_became_peered":"2023-10-14T10:33:47.500541+0000","last_unstale":"2023-10-14T10:33:49.654569+0000","last_undegraded":"2023-10-14T10:33:49.654569+0000","last_fullsized":"2023-10-14T10:33:49.654569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:03.978194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653275+0000","last_change":"2023-10-14T10:33:47.484954+0000","last_active":"2023-10-14T10:33:49.653275+0000","last_peered":"2023-10-14T10:33:49.653275+0000","last_clean":"2023-10-14T10:33:49.653275+0000","last_became_active":"2023-10-14T10:33:47.484596+0000","last_became_peered":"2023-10-14T10:33:47.484596+0000","last_unstale":"2023-10-14T10:33:49.653275+0000","last_undegraded":"2023-10-14T10:33:49.653275+0000","last_fullsized":"2023-10-14T10:33:49.653275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652603+0000","last_change":"2023-10-14T10:33:47.503231+0000","last_active":"2023-10-14T10:33:49.652603+0000","last_peered":"2023-10-14T10:33:49.652603+0000","last_clean":"2023-10-14T10:33:49.652603+0000","last_became_active":"2023-10-14T10:33:47.496705+0000","last_became_peered":"2023-10-14T10:33:47.496705+0000","last_unstale":"2023-10-14T10:33:49.652603+0000","last_undegraded":"2023-10-14T10:33:49.652603+0000","last_fullsized":"2023-10-14T10:33:49.652603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.459938+0000","last_change":"2023-10-14T10:33:47.502726+0000","last_active":"2023-10-14T10:33:48.459938+0000","last_peered":"2023-10-14T10:33:48.459938+0000","last_clean":"2023-10-14T10:33:48.459938+0000","last_became_active":"2023-10-14T10:33:47.501799+0000","last_became_peered":"2023-10-14T10:33:47.501799+0000","last_unstale":"2023-10-14T10:33:48.459938+0000","last_undegraded":"2023-10-14T10:33:48.459938+0000","last_fullsized":"2023-10-14T10:33:48.459938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:10:51.321625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212506+0000","last_change":"2023-10-14T10:33:47.488816+0000","last_active":"2023-10-14T10:33:49.212506+0000","last_peered":"2023-10-14T10:33:49.212506+0000","last_clean":"2023-10-14T10:33:49.212506+0000","last_became_active":"2023-10-14T10:33:47.488505+0000","last_became_peered":"2023-10-14T10:33:47.488505+0000","last_unstale":"2023-10-14T10:33:49.212506+0000","last_undegraded":"2023-10-14T10:33:49.212506+0000","last_fullsized":"2023-10-14T10:33:49.212506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.305043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652714+0000","last_change":"2023-10-14T10:33:47.482197+0000","last_active":"2023-10-14T10:33:49.652714+0000","last_peered":"2023-10-14T10:33:49.652714+0000","last_clean":"2023-10-14T10:33:49.652714+0000","last_became_active":"2023-10-14T10:33:47.481209+0000","last_became_peered":"2023-10-14T10:33:47.481209+0000","last_unstale":"2023-10-14T10:33:49.652714+0000","last_undegraded":"2023-10-14T10:33:49.652714+0000","last_fullsized":"2023-10-14T10:33:49.652714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:02.548595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456348+0000","last_change":"2023-10-14T10:33:47.469873+0000","last_active":"2023-10-14T10:33:48.456348+0000","last_peered":"2023-10-14T10:33:48.456348+0000","last_clean":"2023-10-14T10:33:48.456348+0000","last_became_active":"2023-10-14T10:33:47.469462+0000","last_became_peered":"2023-10-14T10:33:47.469462+0000","last_unstale":"2023-10-14T10:33:48.456348+0000","last_undegraded":"2023-10-14T10:33:48.456348+0000","last_fullsized":"2023-10-14T10:33:48.456348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.461731+0000","last_change":"2023-10-14T10:33:47.484628+0000","last_active":"2023-10-14T10:33:48.461731+0000","last_peered":"2023-10-14T10:33:48.461731+0000","last_clean":"2023-10-14T10:33:48.461731+0000","last_became_active":"2023-10-14T10:33:47.484319+0000","last_became_peered":"2023-10-14T10:33:47.484319+0000","last_unstale":"2023-10-14T10:33:48.461731+0000","last_undegraded":"2023-10-14T10:33:48.461731+0000","last_fullsized":"2023-10-14T10:33:48.461731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463105+0000","last_change":"2023-10-14T10:33:47.494508+0000","last_active":"2023-10-14T10:33:48.463105+0000","last_peered":"2023-10-14T10:33:48.463105+0000","last_clean":"2023-10-14T10:33:48.463105+0000","last_became_active":"2023-10-14T10:33:47.494119+0000","last_became_peered":"2023-10-14T10:33:47.494119+0000","last_unstale":"2023-10-14T10:33:48.463105+0000","last_undegraded":"2023-10-14T10:33:48.463105+0000","last_fullsized":"2023-10-14T10:33:48.463105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:37.834157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651364+0000","last_change":"2023-10-14T10:33:47.482878+0000","last_active":"2023-10-14T10:33:49.651364+0000","last_peered":"2023-10-14T10:33:49.651364+0000","last_clean":"2023-10-14T10:33:49.651364+0000","last_became_active":"2023-10-14T10:33:47.482566+0000","last_became_peered":"2023-10-14T10:33:47.482566+0000","last_unstale":"2023-10-14T10:33:49.651364+0000","last_undegraded":"2023-10-14T10:33:49.651364+0000","last_fullsized":"2023-10-14T10:33:49.651364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:08.668848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654211+0000","last_change":"2023-10-14T10:33:47.497038+0000","last_active":"2023-10-14T10:33:49.654211+0000","last_peered":"2023-10-14T10:33:49.654211+0000","last_clean":"2023-10-14T10:33:49.654211+0000","last_became_active":"2023-10-14T10:33:47.496705+0000","last_became_peered":"2023-10-14T10:33:47.496705+0000","last_unstale":"2023-10-14T10:33:49.654211+0000","last_undegraded":"2023-10-14T10:33:49.654211+0000","last_fullsized":"2023-10-14T10:33:49.654211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:20.511159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652680+0000","last_change":"2023-10-14T10:33:47.497999+0000","last_active":"2023-10-14T10:33:49.652680+0000","last_peered":"2023-10-14T10:33:49.652680+0000","last_clean":"2023-10-14T10:33:49.652680+0000","last_became_active":"2023-10-14T10:33:47.494872+0000","last_became_peered":"2023-10-14T10:33:47.494872+0000","last_unstale":"2023-10-14T10:33:49.652680+0000","last_undegraded":"2023-10-14T10:33:49.652680+0000","last_fullsized":"2023-10-14T10:33:49.652680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653148+0000","last_change":"2023-10-14T10:33:47.490809+0000","last_active":"2023-10-14T10:33:49.653148+0000","last_peered":"2023-10-14T10:33:49.653148+0000","last_clean":"2023-10-14T10:33:49.653148+0000","last_became_active":"2023-10-14T10:33:47.490523+0000","last_became_peered":"2023-10-14T10:33:47.490523+0000","last_unstale":"2023-10-14T10:33:49.653148+0000","last_undegraded":"2023-10-14T10:33:49.653148+0000","last_fullsized":"2023-10-14T10:33:49.653148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:28.374613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462234+0000","last_change":"2023-10-14T10:33:47.491586+0000","last_active":"2023-10-14T10:33:48.462234+0000","last_peered":"2023-10-14T10:33:48.462234+0000","last_clean":"2023-10-14T10:33:48.462234+0000","last_became_active":"2023-10-14T10:33:47.491262+0000","last_became_peered":"2023-10-14T10:33:47.491262+0000","last_unstale":"2023-10-14T10:33:48.462234+0000","last_undegraded":"2023-10-14T10:33:48.462234+0000","last_fullsized":"2023-10-14T10:33:48.462234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:47.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.211866+0000","last_change":"2023-10-14T10:33:47.479860+0000","last_active":"2023-10-14T10:33:49.211866+0000","last_peered":"2023-10-14T10:33:49.211866+0000","last_clean":"2023-10-14T10:33:49.211866+0000","last_became_active":"2023-10-14T10:33:47.479536+0000","last_became_peered":"2023-10-14T10:33:47.479536+0000","last_unstale":"2023-10-14T10:33:49.211866+0000","last_undegraded":"2023-10-14T10:33:49.211866+0000","last_fullsized":"2023-10-14T10:33:49.211866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.461909+0000","last_change":"2023-10-14T10:33:47.480950+0000","last_active":"2023-10-14T10:33:48.461909+0000","last_peered":"2023-10-14T10:33:48.461909+0000","last_clean":"2023-10-14T10:33:48.461909+0000","last_became_active":"2023-10-14T10:33:47.480623+0000","last_became_peered":"2023-10-14T10:33:47.480623+0000","last_unstale":"2023-10-14T10:33:48.461909+0000","last_undegraded":"2023-10-14T10:33:48.461909+0000","last_fullsized":"2023-10-14T10:33:48.461909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.305043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212838+0000","last_change":"2023-10-14T10:33:47.476116+0000","last_active":"2023-10-14T10:33:49.212838+0000","last_peered":"2023-10-14T10:33:49.212838+0000","last_clean":"2023-10-14T10:33:49.212838+0000","last_became_active":"2023-10-14T10:33:47.475806+0000","last_became_peered":"2023-10-14T10:33:47.475806+0000","last_unstale":"2023-10-14T10:33:49.212838+0000","last_undegraded":"2023-10-14T10:33:49.212838+0000","last_fullsized":"2023-10-14T10:33:49.212838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:13.355108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653449+0000","last_change":"2023-10-14T10:33:47.503282+0000","last_active":"2023-10-14T10:33:49.653449+0000","last_peered":"2023-10-14T10:33:49.653449+0000","last_clean":"2023-10-14T10:33:49.653449+0000","last_became_active":"2023-10-14T10:33:47.498347+0000","last_became_peered":"2023-10-14T10:33:47.498347+0000","last_unstale":"2023-10-14T10:33:49.653449+0000","last_undegraded":"2023-10-14T10:33:49.653449+0000","last_fullsized":"2023-10-14T10:33:49.653449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.305043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456488+0000","last_change":"2023-10-14T10:33:47.477397+0000","last_active":"2023-10-14T10:33:48.456488+0000","last_peered":"2023-10-14T10:33:48.456488+0000","last_clean":"2023-10-14T10:33:48.456488+0000","last_became_active":"2023-10-14T10:33:47.477023+0000","last_became_peered":"2023-10-14T10:33:47.477023+0000","last_unstale":"2023-10-14T10:33:48.456488+0000","last_undegraded":"2023-10-14T10:33:48.456488+0000","last_fullsized":"2023-10-14T10:33:48.456488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212867+0000","last_change":"2023-10-14T10:33:47.483158+0000","last_active":"2023-10-14T10:33:49.212867+0000","last_peered":"2023-10-14T10:33:49.212867+0000","last_clean":"2023-10-14T10:33:49.212867+0000","last_became_active":"2023-10-14T10:33:47.481098+0000","last_became_peered":"2023-10-14T10:33:47.481098+0000","last_unstale":"2023-10-14T10:33:49.212867+0000","last_undegraded":"2023-10-14T10:33:49.212867+0000","last_fullsized":"2023-10-14T10:33:49.212867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:58.057067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653230+0000","last_change":"2023-10-14T10:33:47.481204+0000","last_active":"2023-10-14T10:33:49.653230+0000","last_peered":"2023-10-14T10:33:49.653230+0000","last_clean":"2023-10-14T10:33:49.653230+0000","last_became_active":"2023-10-14T10:33:47.480212+0000","last_became_peered":"2023-10-14T10:33:47.480212+0000","last_unstale":"2023-10-14T10:33:49.653230+0000","last_undegraded":"2023-10-14T10:33:49.653230+0000","last_fullsized":"2023-10-14T10:33:49.653230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462667+0000","last_change":"2023-10-14T10:33:47.480818+0000","last_active":"2023-10-14T10:33:48.462667+0000","last_peered":"2023-10-14T10:33:48.462667+0000","last_clean":"2023-10-14T10:33:48.462667+0000","last_became_active":"2023-10-14T10:33:47.480593+0000","last_became_peered":"2023-10-14T10:33:47.480593+0000","last_unstale":"2023-10-14T10:33:48.462667+0000","last_undegraded":"2023-10-14T10:33:48.462667+0000","last_fullsized":"2023-10-14T10:33:48.462667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:11.483101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.650911+0000","last_change":"2023-10-14T10:33:47.477330+0000","last_active":"2023-10-14T10:33:49.650911+0000","last_peered":"2023-10-14T10:33:49.650911+0000","last_clean":"2023-10-14T10:33:49.650911+0000","last_became_active":"2023-10-14T10:33:47.476922+0000","last_became_peered":"2023-10-14T10:33:47.476922+0000","last_unstale":"2023-10-14T10:33:49.650911+0000","last_undegraded":"2023-10-14T10:33:49.650911+0000","last_fullsized":"2023-10-14T10:33:49.650911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:34:46.239394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651600+0000","last_change":"2023-10-14T10:33:47.496369+0000","last_active":"2023-10-14T10:33:49.651600+0000","last_peered":"2023-10-14T10:33:49.651600+0000","last_clean":"2023-10-14T10:33:49.651600+0000","last_became_active":"2023-10-14T10:33:47.494458+0000","last_became_peered":"2023-10-14T10:33:47.494458+0000","last_unstale":"2023-10-14T10:33:49.651600+0000","last_undegraded":"2023-10-14T10:33:49.651600+0000","last_fullsized":"2023-10-14T10:33:49.651600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.459427+0000","last_change":"2023-10-14T10:33:47.469801+0000","last_active":"2023-10-14T10:33:48.459427+0000","last_peered":"2023-10-14T10:33:48.459427+0000","last_clean":"2023-10-14T10:33:48.459427+0000","last_became_active":"2023-10-14T10:33:47.468284+0000","last_became_peered":"2023-10-14T10:33:47.468284+0000","last_unstale":"2023-10-14T10:33:48.459427+0000","last_undegraded":"2023-10-14T10:33:48.459427+0000","last_fullsized":"2023-10-14T10:33:48.459427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:35.323602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212468+0000","last_change":"2023-10-14T10:33:46.944464+0000","last_active":"2023-10-14T10:33:49.212468+0000","last_peered":"2023-10-14T10:33:49.212468+0000","last_clean":"2023-10-14T10:33:49.212468+0000","last_became_active":"2023-10-14T10:33:46.943975+0000","last_became_peered":"2023-10-14T10:33:46.943975+0000","last_unstale":"2023-10-14T10:33:49.212468+0000","last_undegraded":"2023-10-14T10:33:49.212468+0000","last_fullsized":"2023-10-14T10:33:49.212468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653470+0000","last_change":"2023-10-14T10:33:47.487990+0000","last_active":"2023-10-14T10:33:49.653470+0000","last_peered":"2023-10-14T10:33:49.653470+0000","last_clean":"2023-10-14T10:33:49.653470+0000","last_became_active":"2023-10-14T10:33:47.487504+0000","last_became_peered":"2023-10-14T10:33:47.487504+0000","last_unstale":"2023-10-14T10:33:49.653470+0000","last_undegraded":"2023-10-14T10:33:49.653470+0000","last_fullsized":"2023-10-14T10:33:49.653470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652732+0000","last_change":"2023-10-14T10:33:46.944422+0000","last_active":"2023-10-14T10:33:49.652732+0000","last_peered":"2023-10-14T10:33:49.652732+0000","last_clean":"2023-10-14T10:33:49.652732+0000","last_became_active":"2023-10-14T10:33:46.944045+0000","last_became_peered":"2023-10-14T10:33:46.944045+0000","last_unstale":"2023-10-14T10:33:49.652732+0000","last_undegraded":"2023-10-14T10:33:49.652732+0000","last_fullsized":"2023-10-14T10:33:49.652732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212102+0000","last_change":"2023-10-14T10:33:46.946032+0000","last_active":"2023-10-14T10:33:49.212102+0000","last_peered":"2023-10-14T10:33:49.212102+0000","last_clean":"2023-10-14T10:33:49.212102+0000","last_became_active":"2023-10-14T10:33:46.945694+0000","last_became_peered":"2023-10-14T10:33:46.945694+0000","last_unstale":"2023-10-14T10:33:49.212102+0000","last_undegraded":"2023-10-14T10:33:49.212102+0000","last_fullsized":"2023-10-14T10:33:49.212102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:35.235012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212057+0000","last_change":"2023-10-14T10:33:47.486768+0000","last_active":"2023-10-14T10:33:49.212057+0000","last_peered":"2023-10-14T10:33:49.212057+0000","last_clean":"2023-10-14T10:33:49.212057+0000","last_became_active":"2023-10-14T10:33:47.486477+0000","last_became_peered":"2023-10-14T10:33:47.486477+0000","last_unstale":"2023-10-14T10:33:49.212057+0000","last_undegraded":"2023-10-14T10:33:49.212057+0000","last_fullsized":"2023-10-14T10:33:49.212057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462041+0000","last_change":"2023-10-14T10:33:46.943179+0000","last_active":"2023-10-14T10:33:48.462041+0000","last_peered":"2023-10-14T10:33:48.462041+0000","last_clean":"2023-10-14T10:33:48.462041+0000","last_became_active":"2023-10-14T10:33:46.942887+0000","last_became_peered":"2023-10-14T10:33:46.942887+0000","last_unstale":"2023-10-14T10:33:48.462041+0000","last_undegraded":"2023-10-14T10:33:48.462041+0000","last_fullsized":"2023-10-14T10:33:48.462041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:01.285291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456237+0000","last_change":"2023-10-14T10:33:47.477341+0000","last_active":"2023-10-14T10:33:48.456237+0000","last_peered":"2023-10-14T10:33:48.456237+0000","last_clean":"2023-10-14T10:33:48.456237+0000","last_became_active":"2023-10-14T10:33:47.476425+0000","last_became_peered":"2023-10-14T10:33:47.476425+0000","last_unstale":"2023-10-14T10:33:48.456237+0000","last_undegraded":"2023-10-14T10:33:48.456237+0000","last_fullsized":"2023-10-14T10:33:48.456237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652803+0000","last_change":"2023-10-14T10:33:46.946573+0000","last_active":"2023-10-14T10:33:49.652803+0000","last_peered":"2023-10-14T10:33:49.652803+0000","last_clean":"2023-10-14T10:33:49.652803+0000","last_became_active":"2023-10-14T10:33:46.945846+0000","last_became_peered":"2023-10-14T10:33:46.945846+0000","last_unstale":"2023-10-14T10:33:49.652803+0000","last_undegraded":"2023-10-14T10:33:49.652803+0000","last_fullsized":"2023-10-14T10:33:49.652803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:28.392606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462337+0000","last_change":"2023-10-14T10:33:47.494832+0000","last_active":"2023-10-14T10:33:48.462337+0000","last_peered":"2023-10-14T10:33:48.462337+0000","last_clean":"2023-10-14T10:33:48.462337+0000","last_became_active":"2023-10-14T10:33:47.494306+0000","last_became_peered":"2023-10-14T10:33:47.494306+0000","last_unstale":"2023-10-14T10:33:48.462337+0000","last_undegraded":"2023-10-14T10:33:48.462337+0000","last_fullsized":"2023-10-14T10:33:48.462337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:58.057067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462569+0000","last_change":"2023-10-14T10:33:46.946908+0000","last_active":"2023-10-14T10:33:48.462569+0000","last_peered":"2023-10-14T10:33:48.462569+0000","last_clean":"2023-10-14T10:33:48.462569+0000","last_became_active":"2023-10-14T10:33:46.946623+0000","last_became_peered":"2023-10-14T10:33:46.946623+0000","last_unstale":"2023-10-14T10:33:48.462569+0000","last_undegraded":"2023-10-14T10:33:48.462569+0000","last_fullsized":"2023-10-14T10:33:48.462569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653979+0000","last_change":"2023-10-14T10:33:47.485672+0000","last_active":"2023-10-14T10:33:49.653979+0000","last_peered":"2023-10-14T10:33:49.653979+0000","last_clean":"2023-10-14T10:33:49.653979+0000","last_became_active":"2023-10-14T10:33:47.485336+0000","last_became_peered":"2023-10-14T10:33:47.485336+0000","last_unstale":"2023-10-14T10:33:49.653979+0000","last_undegraded":"2023-10-14T10:33:49.653979+0000","last_fullsized":"2023-10-14T10:33:49.653979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456519+0000","last_change":"2023-10-14T10:33:46.942861+0000","last_active":"2023-10-14T10:33:48.456519+0000","last_peered":"2023-10-14T10:33:48.456519+0000","last_clean":"2023-10-14T10:33:48.456519+0000","last_became_active":"2023-10-14T10:33:46.942559+0000","last_became_peered":"2023-10-14T10:33:46.942559+0000","last_unstale":"2023-10-14T10:33:48.456519+0000","last_undegraded":"2023-10-14T10:33:48.456519+0000","last_fullsized":"2023-10-14T10:33:48.456519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:01.285291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460271+0000","last_change":"2023-10-14T10:33:47.496746+0000","last_active":"2023-10-14T10:33:48.460271+0000","last_peered":"2023-10-14T10:33:48.460271+0000","last_clean":"2023-10-14T10:33:48.460271+0000","last_became_active":"2023-10-14T10:33:47.495439+0000","last_became_peered":"2023-10-14T10:33:47.495439+0000","last_unstale":"2023-10-14T10:33:48.460271+0000","last_undegraded":"2023-10-14T10:33:48.460271+0000","last_fullsized":"2023-10-14T10:33:48.460271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:36.498316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652736+0000","last_change":"2023-10-14T10:33:46.948656+0000","last_active":"2023-10-14T10:33:49.652736+0000","last_peered":"2023-10-14T10:33:49.652736+0000","last_clean":"2023-10-14T10:33:49.652736+0000","last_became_active":"2023-10-14T10:33:46.945172+0000","last_became_peered":"2023-10-14T10:33:46.945172+0000","last_unstale":"2023-10-14T10:33:49.652736+0000","last_undegraded":"2023-10-14T10:33:49.652736+0000","last_fullsized":"2023-10-14T10:33:49.652736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:27.111309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653869+0000","last_change":"2023-10-14T10:33:47.494774+0000","last_active":"2023-10-14T10:33:49.653869+0000","last_peered":"2023-10-14T10:33:49.653869+0000","last_clean":"2023-10-14T10:33:49.653869+0000","last_became_active":"2023-10-14T10:33:47.494464+0000","last_became_peered":"2023-10-14T10:33:47.494464+0000","last_unstale":"2023-10-14T10:33:49.653869+0000","last_undegraded":"2023-10-14T10:33:49.653869+0000","last_fullsized":"2023-10-14T10:33:49.653869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:11.483101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653515+0000","last_change":"2023-10-14T10:33:46.949538+0000","last_active":"2023-10-14T10:33:49.653515+0000","last_peered":"2023-10-14T10:33:49.653515+0000","last_clean":"2023-10-14T10:33:49.653515+0000","last_became_active":"2023-10-14T10:33:46.949221+0000","last_became_peered":"2023-10-14T10:33:46.949221+0000","last_unstale":"2023-10-14T10:33:49.653515+0000","last_undegraded":"2023-10-14T10:33:49.653515+0000","last_fullsized":"2023-10-14T10:33:49.653515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:24.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652794+0000","last_change":"2023-10-14T10:33:47.495094+0000","last_active":"2023-10-14T10:33:49.652794+0000","last_peered":"2023-10-14T10:33:49.652794+0000","last_clean":"2023-10-14T10:33:49.652794+0000","last_became_active":"2023-10-14T10:33:47.494462+0000","last_became_peered":"2023-10-14T10:33:47.494462+0000","last_unstale":"2023-10-14T10:33:49.652794+0000","last_undegraded":"2023-10-14T10:33:49.652794+0000","last_fullsized":"2023-10-14T10:33:49.652794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:21.485819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463293+0000","last_change":"2023-10-14T10:33:46.949862+0000","last_active":"2023-10-14T10:33:48.463293+0000","last_peered":"2023-10-14T10:33:48.463293+0000","last_clean":"2023-10-14T10:33:48.463293+0000","last_became_active":"2023-10-14T10:33:46.949575+0000","last_became_peered":"2023-10-14T10:33:46.949575+0000","last_unstale":"2023-10-14T10:33:48.463293+0000","last_undegraded":"2023-10-14T10:33:48.463293+0000","last_fullsized":"2023-10-14T10:33:48.463293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:51.370720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653325+0000","last_change":"2023-10-14T10:33:47.499315+0000","last_active":"2023-10-14T10:33:49.653325+0000","last_peered":"2023-10-14T10:33:49.653325+0000","last_clean":"2023-10-14T10:33:49.653325+0000","last_became_active":"2023-10-14T10:33:47.498922+0000","last_became_peered":"2023-10-14T10:33:47.498922+0000","last_unstale":"2023-10-14T10:33:49.653325+0000","last_undegraded":"2023-10-14T10:33:49.653325+0000","last_fullsized":"2023-10-14T10:33:49.653325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:10.602705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651606+0000","last_change":"2023-10-14T10:33:46.947577+0000","last_active":"2023-10-14T10:33:49.651606+0000","last_peered":"2023-10-14T10:33:49.651606+0000","last_clean":"2023-10-14T10:33:49.651606+0000","last_became_active":"2023-10-14T10:33:46.947158+0000","last_became_peered":"2023-10-14T10:33:46.947158+0000","last_unstale":"2023-10-14T10:33:49.651606+0000","last_undegraded":"2023-10-14T10:33:49.651606+0000","last_fullsized":"2023-10-14T10:33:49.651606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651703+0000","last_change":"2023-10-14T10:33:47.482689+0000","last_active":"2023-10-14T10:33:49.651703+0000","last_peered":"2023-10-14T10:33:49.651703+0000","last_clean":"2023-10-14T10:33:49.651703+0000","last_became_active":"2023-10-14T10:33:47.482301+0000","last_became_peered":"2023-10-14T10:33:47.482301+0000","last_unstale":"2023-10-14T10:33:49.651703+0000","last_undegraded":"2023-10-14T10:33:49.651703+0000","last_fullsized":"2023-10-14T10:33:49.651703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.650670+0000","last_change":"2023-10-14T10:33:46.933875+0000","last_active":"2023-10-14T10:33:49.650670+0000","last_peered":"2023-10-14T10:33:49.650670+0000","last_clean":"2023-10-14T10:33:49.650670+0000","last_became_active":"2023-10-14T10:33:46.932445+0000","last_became_peered":"2023-10-14T10:33:46.932445+0000","last_unstale":"2023-10-14T10:33:49.650670+0000","last_undegraded":"2023-10-14T10:33:49.650670+0000","last_fullsized":"2023-10-14T10:33:49.650670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:23.669098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652199+0000","last_change":"2023-10-14T10:33:47.500004+0000","last_active":"2023-10-14T10:33:49.652199+0000","last_peered":"2023-10-14T10:33:49.652199+0000","last_clean":"2023-10-14T10:33:49.652199+0000","last_became_active":"2023-10-14T10:33:47.499661+0000","last_became_peered":"2023-10-14T10:33:47.499661+0000","last_unstale":"2023-10-14T10:33:49.652199+0000","last_undegraded":"2023-10-14T10:33:49.652199+0000","last_fullsized":"2023-10-14T10:33:49.652199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:13.355108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460519+0000","last_change":"2023-10-14T10:33:46.941041+0000","last_active":"2023-10-14T10:33:48.460519+0000","last_peered":"2023-10-14T10:33:48.460519+0000","last_clean":"2023-10-14T10:33:48.460519+0000","last_became_active":"2023-10-14T10:33:46.940755+0000","last_became_peered":"2023-10-14T10:33:46.940755+0000","last_unstale":"2023-10-14T10:33:48.460519+0000","last_undegraded":"2023-10-14T10:33:48.460519+0000","last_fullsized":"2023-10-14T10:33:48.460519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:58.183303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652938+0000","last_change":"2023-10-14T10:33:47.501109+0000","last_active":"2023-10-14T10:33:49.652938+0000","last_peered":"2023-10-14T10:33:49.652938+0000","last_clean":"2023-10-14T10:33:49.652938+0000","last_became_active":"2023-10-14T10:33:47.500841+0000","last_became_peered":"2023-10-14T10:33:47.500841+0000","last_unstale":"2023-10-14T10:33:49.652938+0000","last_undegraded":"2023-10-14T10:33:49.652938+0000","last_fullsized":"2023-10-14T10:33:49.652938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:58.057067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651355+0000","last_change":"2023-10-14T10:33:46.934433+0000","last_active":"2023-10-14T10:33:49.651355+0000","last_peered":"2023-10-14T10:33:49.651355+0000","last_clean":"2023-10-14T10:33:49.651355+0000","last_became_active":"2023-10-14T10:33:46.934173+0000","last_became_peered":"2023-10-14T10:33:46.934173+0000","last_unstale":"2023-10-14T10:33:49.651355+0000","last_undegraded":"2023-10-14T10:33:49.651355+0000","last_fullsized":"2023-10-14T10:33:49.651355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:34.060298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654571+0000","last_change":"2023-10-14T10:33:47.500414+0000","last_active":"2023-10-14T10:33:49.654571+0000","last_peered":"2023-10-14T10:33:49.654571+0000","last_clean":"2023-10-14T10:33:49.654571+0000","last_became_active":"2023-10-14T10:33:47.500103+0000","last_became_peered":"2023-10-14T10:33:47.500103+0000","last_unstale":"2023-10-14T10:33:49.654571+0000","last_undegraded":"2023-10-14T10:33:49.654571+0000","last_fullsized":"2023-10-14T10:33:49.654571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:55.928753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456627+0000","last_change":"2023-10-14T10:33:46.929461+0000","last_active":"2023-10-14T10:33:48.456627+0000","last_peered":"2023-10-14T10:33:48.456627+0000","last_clean":"2023-10-14T10:33:48.456627+0000","last_became_active":"2023-10-14T10:33:46.928486+0000","last_became_peered":"2023-10-14T10:33:46.928486+0000","last_unstale":"2023-10-14T10:33:48.456627+0000","last_undegraded":"2023-10-14T10:33:48.456627+0000","last_fullsized":"2023-10-14T10:33:48.456627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:27.111309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463161+0000","last_change":"2023-10-14T10:33:47.483087+0000","last_active":"2023-10-14T10:33:48.463161+0000","last_peered":"2023-10-14T10:33:48.463161+0000","last_clean":"2023-10-14T10:33:48.463161+0000","last_became_active":"2023-10-14T10:33:47.481501+0000","last_became_peered":"2023-10-14T10:33:47.481501+0000","last_unstale":"2023-10-14T10:33:48.463161+0000","last_undegraded":"2023-10-14T10:33:48.463161+0000","last_fullsized":"2023-10-14T10:33:48.463161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:03.978194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651260+0000","last_change":"2023-10-14T10:33:46.943701+0000","last_active":"2023-10-14T10:33:49.651260+0000","last_peered":"2023-10-14T10:33:49.651260+0000","last_clean":"2023-10-14T10:33:49.651260+0000","last_became_active":"2023-10-14T10:33:46.942265+0000","last_became_peered":"2023-10-14T10:33:46.942265+0000","last_unstale":"2023-10-14T10:33:49.651260+0000","last_undegraded":"2023-10-14T10:33:49.651260+0000","last_fullsized":"2023-10-14T10:33:49.651260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:10:50.058321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653885+0000","last_change":"2023-10-14T10:33:47.502823+0000","last_active":"2023-10-14T10:33:49.653885+0000","last_peered":"2023-10-14T10:33:49.653885+0000","last_clean":"2023-10-14T10:33:49.653885+0000","last_became_active":"2023-10-14T10:33:47.502237+0000","last_became_peered":"2023-10-14T10:33:47.502237+0000","last_unstale":"2023-10-14T10:33:49.653885+0000","last_undegraded":"2023-10-14T10:33:49.653885+0000","last_fullsized":"2023-10-14T10:33:49.653885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:13:18.695800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T10:33:47.489150+0000","last_change":"2023-10-14T10:33:42.821659+0000","last_active":"2023-10-14T10:33:47.489150+0000","last_peered":"2023-10-14T10:33:47.489150+0000","last_clean":"2023-10-14T10:33:47.489150+0000","last_became_active":"2023-10-14T10:33:42.819441+0000","last_became_peered":"2023-10-14T10:33:42.819441+0000","last_unstale":"2023-10-14T10:33:47.489150+0000","last_undegraded":"2023-10-14T10:33:47.489150+0000","last_fullsized":"2023-10-14T10:33:47.489150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_clean_scrub_stamp":"2023-10-14T10:33:41.468382+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:59.542930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.461818+0000","last_change":"2023-10-14T10:33:46.932732+0000","last_active":"2023-10-14T10:33:48.461818+0000","last_peered":"2023-10-14T10:33:48.461818+0000","last_clean":"2023-10-14T10:33:48.461818+0000","last_became_active":"2023-10-14T10:33:46.929319+0000","last_became_peered":"2023-10-14T10:33:46.929319+0000","last_unstale":"2023-10-14T10:33:48.461818+0000","last_undegraded":"2023-10-14T10:33:48.461818+0000","last_fullsized":"2023-10-14T10:33:48.461818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:24.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.211843+0000","last_change":"2023-10-14T10:33:47.480133+0000","last_active":"2023-10-14T10:33:49.211843+0000","last_peered":"2023-10-14T10:33:49.211843+0000","last_clean":"2023-10-14T10:33:49.211843+0000","last_became_active":"2023-10-14T10:33:47.479802+0000","last_became_peered":"2023-10-14T10:33:47.479802+0000","last_unstale":"2023-10-14T10:33:49.211843+0000","last_undegraded":"2023-10-14T10:33:49.211843+0000","last_fullsized":"2023-10-14T10:33:49.211843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651892+0000","last_change":"2023-10-14T10:33:46.951335+0000","last_active":"2023-10-14T10:33:49.651892+0000","last_peered":"2023-10-14T10:33:49.651892+0000","last_clean":"2023-10-14T10:33:49.651892+0000","last_became_active":"2023-10-14T10:33:46.950717+0000","last_became_peered":"2023-10-14T10:33:46.950717+0000","last_unstale":"2023-10-14T10:33:49.651892+0000","last_undegraded":"2023-10-14T10:33:49.651892+0000","last_fullsized":"2023-10-14T10:33:49.651892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:35.235012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652648+0000","last_change":"2023-10-14T10:33:47.486246+0000","last_active":"2023-10-14T10:33:49.652648+0000","last_peered":"2023-10-14T10:33:49.652648+0000","last_clean":"2023-10-14T10:33:49.652648+0000","last_became_active":"2023-10-14T10:33:47.485935+0000","last_became_peered":"2023-10-14T10:33:47.485935+0000","last_unstale":"2023-10-14T10:33:49.652648+0000","last_undegraded":"2023-10-14T10:33:49.652648+0000","last_fullsized":"2023-10-14T10:33:49.652648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:29.655910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651005+0000","last_change":"2023-10-14T10:33:46.932409+0000","last_active":"2023-10-14T10:33:49.651005+0000","last_peered":"2023-10-14T10:33:49.651005+0000","last_clean":"2023-10-14T10:33:49.651005+0000","last_became_active":"2023-10-14T10:33:46.932081+0000","last_became_peered":"2023-10-14T10:33:46.932081+0000","last_unstale":"2023-10-14T10:33:49.651005+0000","last_undegraded":"2023-10-14T10:33:49.651005+0000","last_fullsized":"2023-10-14T10:33:49.651005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:35.235012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456692+0000","last_change":"2023-10-14T10:33:47.472076+0000","last_active":"2023-10-14T10:33:48.456692+0000","last_peered":"2023-10-14T10:33:48.456692+0000","last_clean":"2023-10-14T10:33:48.456692+0000","last_became_active":"2023-10-14T10:33:47.471729+0000","last_became_peered":"2023-10-14T10:33:47.471729+0000","last_unstale":"2023-10-14T10:33:48.456692+0000","last_undegraded":"2023-10-14T10:33:48.456692+0000","last_fullsized":"2023-10-14T10:33:48.456692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463351+0000","last_change":"2023-10-14T10:33:46.940624+0000","last_active":"2023-10-14T10:33:48.463351+0000","last_peered":"2023-10-14T10:33:48.463351+0000","last_clean":"2023-10-14T10:33:48.463351+0000","last_became_active":"2023-10-14T10:33:46.939832+0000","last_became_peered":"2023-10-14T10:33:46.939832+0000","last_unstale":"2023-10-14T10:33:48.463351+0000","last_undegraded":"2023-10-14T10:33:48.463351+0000","last_fullsized":"2023-10-14T10:33:48.463351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:14.846393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460408+0000","last_change":"2023-10-14T10:33:47.482352+0000","last_active":"2023-10-14T10:33:48.460408+0000","last_peered":"2023-10-14T10:33:48.460408+0000","last_clean":"2023-10-14T10:33:48.460408+0000","last_became_active":"2023-10-14T10:33:47.482107+0000","last_became_peered":"2023-10-14T10:33:47.482107+0000","last_unstale":"2023-10-14T10:33:48.460408+0000","last_undegraded":"2023-10-14T10:33:48.460408+0000","last_fullsized":"2023-10-14T10:33:48.460408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:34:46.239394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456396+0000","last_change":"2023-10-14T10:33:46.938082+0000","last_active":"2023-10-14T10:33:48.456396+0000","last_peered":"2023-10-14T10:33:48.456396+0000","last_clean":"2023-10-14T10:33:48.456396+0000","last_became_active":"2023-10-14T10:33:46.937753+0000","last_became_peered":"2023-10-14T10:33:46.937753+0000","last_unstale":"2023-10-14T10:33:48.456396+0000","last_undegraded":"2023-10-14T10:33:48.456396+0000","last_fullsized":"2023-10-14T10:33:48.456396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:24.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462602+0000","last_change":"2023-10-14T10:33:47.476592+0000","last_active":"2023-10-14T10:33:48.462602+0000","last_peered":"2023-10-14T10:33:48.462602+0000","last_clean":"2023-10-14T10:33:48.462602+0000","last_became_active":"2023-10-14T10:33:47.476154+0000","last_became_peered":"2023-10-14T10:33:47.476154+0000","last_unstale":"2023-10-14T10:33:48.462602+0000","last_undegraded":"2023-10-14T10:33:48.462602+0000","last_fullsized":"2023-10-14T10:33:48.462602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:10.602705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654137+0000","last_change":"2023-10-14T10:33:46.953499+0000","last_active":"2023-10-14T10:33:49.654137+0000","last_peered":"2023-10-14T10:33:49.654137+0000","last_clean":"2023-10-14T10:33:49.654137+0000","last_became_active":"2023-10-14T10:33:46.953253+0000","last_became_peered":"2023-10-14T10:33:46.953253+0000","last_unstale":"2023-10-14T10:33:49.654137+0000","last_undegraded":"2023-10-14T10:33:49.654137+0000","last_fullsized":"2023-10-14T10:33:49.654137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:05.299234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456292+0000","last_change":"2023-10-14T10:33:47.474355+0000","last_active":"2023-10-14T10:33:48.456292+0000","last_peered":"2023-10-14T10:33:48.456292+0000","last_clean":"2023-10-14T10:33:48.456292+0000","last_became_active":"2023-10-14T10:33:47.473947+0000","last_became_peered":"2023-10-14T10:33:47.473947+0000","last_unstale":"2023-10-14T10:33:48.456292+0000","last_undegraded":"2023-10-14T10:33:48.456292+0000","last_fullsized":"2023-10-14T10:33:48.456292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456734+0000","last_change":"2023-10-14T10:33:46.946715+0000","last_active":"2023-10-14T10:33:48.456734+0000","last_peered":"2023-10-14T10:33:48.456734+0000","last_clean":"2023-10-14T10:33:48.456734+0000","last_became_active":"2023-10-14T10:33:46.946368+0000","last_became_peered":"2023-10-14T10:33:46.946368+0000","last_unstale":"2023-10-14T10:33:48.456734+0000","last_undegraded":"2023-10-14T10:33:48.456734+0000","last_fullsized":"2023-10-14T10:33:48.456734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.213127+0000","last_change":"2023-10-14T10:33:47.494870+0000","last_active":"2023-10-14T10:33:49.213127+0000","last_peered":"2023-10-14T10:33:49.213127+0000","last_clean":"2023-10-14T10:33:49.213127+0000","last_became_active":"2023-10-14T10:33:47.494561+0000","last_became_peered":"2023-10-14T10:33:47.494561+0000","last_unstale":"2023-10-14T10:33:49.213127+0000","last_undegraded":"2023-10-14T10:33:49.213127+0000","last_fullsized":"2023-10-14T10:33:49.213127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:00.621252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652945+0000","last_change":"2023-10-14T10:33:46.952942+0000","last_active":"2023-10-14T10:33:49.652945+0000","last_peered":"2023-10-14T10:33:49.652945+0000","last_clean":"2023-10-14T10:33:49.652945+0000","last_became_active":"2023-10-14T10:33:46.952649+0000","last_became_peered":"2023-10-14T10:33:46.952649+0000","last_unstale":"2023-10-14T10:33:49.652945+0000","last_undegraded":"2023-10-14T10:33:49.652945+0000","last_fullsized":"2023-10-14T10:33:49.652945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:01.285291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653758+0000","last_change":"2023-10-14T10:33:47.481610+0000","last_active":"2023-10-14T10:33:49.653758+0000","last_peered":"2023-10-14T10:33:49.653758+0000","last_clean":"2023-10-14T10:33:49.653758+0000","last_became_active":"2023-10-14T10:33:47.481134+0000","last_became_peered":"2023-10-14T10:33:47.481134+0000","last_unstale":"2023-10-14T10:33:49.653758+0000","last_undegraded":"2023-10-14T10:33:49.653758+0000","last_fullsized":"2023-10-14T10:33:49.653758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651537+0000","last_change":"2023-10-14T10:33:46.951887+0000","last_active":"2023-10-14T10:33:49.651537+0000","last_peered":"2023-10-14T10:33:49.651537+0000","last_clean":"2023-10-14T10:33:49.651537+0000","last_became_active":"2023-10-14T10:33:46.951005+0000","last_became_peered":"2023-10-14T10:33:46.951005+0000","last_unstale":"2023-10-14T10:33:49.651537+0000","last_undegraded":"2023-10-14T10:33:49.651537+0000","last_fullsized":"2023-10-14T10:33:49.651537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:44.489158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460796+0000","last_change":"2023-10-14T10:33:47.472416+0000","last_active":"2023-10-14T10:33:48.460796+0000","last_peered":"2023-10-14T10:33:48.460796+0000","last_clean":"2023-10-14T10:33:48.460796+0000","last_became_active":"2023-10-14T10:33:47.472042+0000","last_became_peered":"2023-10-14T10:33:47.472042+0000","last_unstale":"2023-10-14T10:33:48.460796+0000","last_undegraded":"2023-10-14T10:33:48.460796+0000","last_fullsized":"2023-10-14T10:33:48.460796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:08.668848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456421+0000","last_change":"2023-10-14T10:33:46.943709+0000","last_active":"2023-10-14T10:33:48.456421+0000","last_peered":"2023-10-14T10:33:48.456421+0000","last_clean":"2023-10-14T10:33:48.456421+0000","last_became_active":"2023-10-14T10:33:46.943331+0000","last_became_peered":"2023-10-14T10:33:46.943331+0000","last_unstale":"2023-10-14T10:33:48.456421+0000","last_undegraded":"2023-10-14T10:33:48.456421+0000","last_fullsized":"2023-10-14T10:33:48.456421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212270+0000","last_change":"2023-10-14T10:33:47.485638+0000","last_active":"2023-10-14T10:33:49.212270+0000","last_peered":"2023-10-14T10:33:49.212270+0000","last_clean":"2023-10-14T10:33:49.212270+0000","last_became_active":"2023-10-14T10:33:47.485152+0000","last_became_peered":"2023-10-14T10:33:47.485152+0000","last_unstale":"2023-10-14T10:33:49.212270+0000","last_undegraded":"2023-10-14T10:33:49.212270+0000","last_fullsized":"2023-10-14T10:33:49.212270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456868+0000","last_change":"2023-10-14T10:33:46.940511+0000","last_active":"2023-10-14T10:33:48.456868+0000","last_peered":"2023-10-14T10:33:48.456868+0000","last_clean":"2023-10-14T10:33:48.456868+0000","last_became_active":"2023-10-14T10:33:46.940203+0000","last_became_peered":"2023-10-14T10:33:46.940203+0000","last_unstale":"2023-10-14T10:33:48.456868+0000","last_undegraded":"2023-10-14T10:33:48.456868+0000","last_fullsized":"2023-10-14T10:33:48.456868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:34.060298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212360+0000","last_change":"2023-10-14T10:33:47.484334+0000","last_active":"2023-10-14T10:33:49.212360+0000","last_peered":"2023-10-14T10:33:49.212360+0000","last_clean":"2023-10-14T10:33:49.212360+0000","last_became_active":"2023-10-14T10:33:47.484053+0000","last_became_peered":"2023-10-14T10:33:47.484053+0000","last_unstale":"2023-10-14T10:33:49.212360+0000","last_undegraded":"2023-10-14T10:33:49.212360+0000","last_fullsized":"2023-10-14T10:33:49.212360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653506+0000","last_change":"2023-10-14T10:33:46.952342+0000","last_active":"2023-10-14T10:33:49.653506+0000","last_peered":"2023-10-14T10:33:49.653506+0000","last_clean":"2023-10-14T10:33:49.653506+0000","last_became_active":"2023-10-14T10:33:46.952054+0000","last_became_peered":"2023-10-14T10:33:46.952054+0000","last_unstale":"2023-10-14T10:33:49.653506+0000","last_undegraded":"2023-10-14T10:33:49.653506+0000","last_fullsized":"2023-10-14T10:33:49.653506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:07.405544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652415+0000","last_change":"2023-10-14T10:33:47.483290+0000","last_active":"2023-10-14T10:33:49.652415+0000","last_peered":"2023-10-14T10:33:49.652415+0000","last_clean":"2023-10-14T10:33:49.652415+0000","last_became_active":"2023-10-14T10:33:47.482376+0000","last_became_peered":"2023-10-14T10:33:47.482376+0000","last_unstale":"2023-10-14T10:33:49.652415+0000","last_undegraded":"2023-10-14T10:33:49.652415+0000","last_fullsized":"2023-10-14T10:33:49.652415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462475+0000","last_change":"2023-10-14T10:33:47.474830+0000","last_active":"2023-10-14T10:33:48.462475+0000","last_peered":"2023-10-14T10:33:48.462475+0000","last_clean":"2023-10-14T10:33:48.462475+0000","last_became_active":"2023-10-14T10:33:47.474496+0000","last_became_peered":"2023-10-14T10:33:47.474496+0000","last_unstale":"2023-10-14T10:33:48.462475+0000","last_undegraded":"2023-10-14T10:33:48.462475+0000","last_fullsized":"2023-10-14T10:33:48.462475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:00.621252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653758+0000","last_change":"2023-10-14T10:33:46.952550+0000","last_active":"2023-10-14T10:33:49.653758+0000","last_peered":"2023-10-14T10:33:49.653758+0000","last_clean":"2023-10-14T10:33:49.653758+0000","last_became_active":"2023-10-14T10:33:46.952221+0000","last_became_peered":"2023-10-14T10:33:46.952221+0000","last_unstale":"2023-10-14T10:33:49.653758+0000","last_undegraded":"2023-10-14T10:33:49.653758+0000","last_fullsized":"2023-10-14T10:33:49.653758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462966+0000","last_change":"2023-10-14T10:33:47.480595+0000","last_active":"2023-10-14T10:33:48.462966+0000","last_peered":"2023-10-14T10:33:48.462966+0000","last_clean":"2023-10-14T10:33:48.462966+0000","last_became_active":"2023-10-14T10:33:47.479987+0000","last_became_peered":"2023-10-14T10:33:47.479987+0000","last_unstale":"2023-10-14T10:33:48.462966+0000","last_undegraded":"2023-10-14T10:33:48.462966+0000","last_fullsized":"2023-10-14T10:33:48.462966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:20.511159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654009+0000","last_change":"2023-10-14T10:33:46.956415+0000","last_active":"2023-10-14T10:33:49.654009+0000","last_peered":"2023-10-14T10:33:49.654009+0000","last_clean":"2023-10-14T10:33:49.654009+0000","last_became_active":"2023-10-14T10:33:46.956031+0000","last_became_peered":"2023-10-14T10:33:46.956031+0000","last_unstale":"2023-10-14T10:33:49.654009+0000","last_undegraded":"2023-10-14T10:33:49.654009+0000","last_fullsized":"2023-10-14T10:33:49.654009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:51.370720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654052+0000","last_change":"2023-10-14T10:33:47.487837+0000","last_active":"2023-10-14T10:33:49.654052+0000","last_peered":"2023-10-14T10:33:49.654052+0000","last_clean":"2023-10-14T10:33:49.654052+0000","last_became_active":"2023-10-14T10:33:47.487230+0000","last_became_peered":"2023-10-14T10:33:47.487230+0000","last_unstale":"2023-10-14T10:33:49.654052+0000","last_undegraded":"2023-10-14T10:33:49.654052+0000","last_fullsized":"2023-10-14T10:33:49.654052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.213080+0000","last_change":"2023-10-14T10:33:46.941475+0000","last_active":"2023-10-14T10:33:49.213080+0000","last_peered":"2023-10-14T10:33:49.213080+0000","last_clean":"2023-10-14T10:33:49.213080+0000","last_became_active":"2023-10-14T10:33:46.941184+0000","last_became_peered":"2023-10-14T10:33:46.941184+0000","last_unstale":"2023-10-14T10:33:49.213080+0000","last_undegraded":"2023-10-14T10:33:49.213080+0000","last_fullsized":"2023-10-14T10:33:49.213080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212744+0000","last_change":"2023-10-14T10:33:47.488896+0000","last_active":"2023-10-14T10:33:49.212744+0000","last_peered":"2023-10-14T10:33:49.212744+0000","last_clean":"2023-10-14T10:33:49.212744+0000","last_became_active":"2023-10-14T10:33:47.488561+0000","last_became_peered":"2023-10-14T10:33:47.488561+0000","last_unstale":"2023-10-14T10:33:49.212744+0000","last_undegraded":"2023-10-14T10:33:49.212744+0000","last_fullsized":"2023-10-14T10:33:49.212744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:47.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654339+0000","last_change":"2023-10-14T10:33:46.951000+0000","last_active":"2023-10-14T10:33:49.654339+0000","last_peered":"2023-10-14T10:33:49.654339+0000","last_clean":"2023-10-14T10:33:49.654339+0000","last_became_active":"2023-10-14T10:33:46.950678+0000","last_became_peered":"2023-10-14T10:33:46.950678+0000","last_unstale":"2023-10-14T10:33:49.654339+0000","last_undegraded":"2023-10-14T10:33:49.654339+0000","last_fullsized":"2023-10-14T10:33:49.654339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":802816,"data_stored":660219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.744}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.698}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.492}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":70881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.762}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8420000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.619}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.651}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9610000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.907}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":204800,"data_stored":69269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.794}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4780000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.601}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.78}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3490000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":811008,"data_stored":660275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T10:33:52.915 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T10:33:52.916 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T10:33:52.916 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T10:33:52.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T10:33:52.917 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T10:33:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.186+0000 7fa663fff640 1 Processor -- start 2023-10-14T10:33:53.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.186+0000 7fa663fff640 1 -- start start 2023-10-14T10:33:53.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.188+0000 7fa663fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa66406b6e0 0x7fa6641555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:53.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.188+0000 7fa663fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa664155b00 0x7fa66415c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:53.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.188+0000 7fa663fff640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa664151bf0 con 0x7fa664152670 2023-10-14T10:33:53.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.188+0000 7fa663fff640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6640bffd0 con 0x7fa664155b00 2023-10-14T10:33:53.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.188+0000 7fa663fff640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6640c02b0 con 0x7fa66406b6e0 2023-10-14T10:33:53.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.188+0000 7fa6637fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa664155b00 0x7fa66415c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:53.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.188+0000 7fa6637fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa664155b00 0x7fa66415c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46832/0 (socket says 172.21.15.8:46832) 2023-10-14T10:33:53.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.188+0000 7fa6637fe640 1 -- 172.21.15.8:0/2913181785 learned_addr learned my addr 172.21.15.8:0/2913181785 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:53.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.188+0000 7fa65bfff640 1 --2- 172.21.15.8:0/2913181785 >> v2:172.21.15.92:3300/0 conn(0x7fa66406b6e0 0x7fa6641555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.189+0000 7fa6637fe640 1 -- 172.21.15.8:0/2913181785 >> v2:172.21.15.92:3300/0 conn(0x7fa66406b6e0 msgr2=0x7fa6641555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:53.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.189+0000 7fa6637fe640 1 --2- 172.21.15.8:0/2913181785 >> v2:172.21.15.92:3300/0 conn(0x7fa66406b6e0 0x7fa6641555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.189+0000 7fa6637fe640 1 -- 172.21.15.8:0/2913181785 >> v1:172.21.15.92:6789/0 conn(0x7fa664152670 legacy=0x7fa6640c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.189+0000 7fa6637fe640 1 -- 172.21.15.8:0/2913181785 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6640c0590 con 0x7fa664155b00 2023-10-14T10:33:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.190+0000 7fa6637fe640 1 --2- 172.21.15.8:0/2913181785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664155b00 0x7fa66415c570 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6640a8270 tx=0x7fa65c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eebaf102aef6d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:53.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.190+0000 7fa6627fc640 1 -- 172.21.15.8:0/2913181785 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c02ca80 con 0x7fa664155b00 2023-10-14T10:33:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.190+0000 7fa6627fc640 1 -- 172.21.15.8:0/2913181785 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c02cbe0 con 0x7fa664155b00 2023-10-14T10:33:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.190+0000 7fa6627fc640 1 -- 172.21.15.8:0/2913181785 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0343f0 con 0x7fa664155b00 2023-10-14T10:33:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.191+0000 7fa663fff640 1 -- 172.21.15.8:0/2913181785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664155b00 msgr2=0x7fa66415c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.191+0000 7fa663fff640 1 --2- 172.21.15.8:0/2913181785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664155b00 0x7fa66415c570 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6640a8270 tx=0x7fa65c02bee0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.191+0000 7fa663fff640 1 -- 172.21.15.8:0/2913181785 shutdown_connections 2023-10-14T10:33:53.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.191+0000 7fa663fff640 1 --2- 172.21.15.8:0/2913181785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664155b00 0x7fa66415c570 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.191+0000 7fa663fff640 1 --2- 172.21.15.8:0/2913181785 >> v2:172.21.15.92:3300/0 conn(0x7fa66406b6e0 0x7fa6641555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.191+0000 7fa663fff640 1 -- 172.21.15.8:0/2913181785 >> 172.21.15.8:0/2913181785 conn(0x7fa66406a200 msgr2=0x7fa66406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:53.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.191+0000 7fa663fff640 1 -- 172.21.15.8:0/2913181785 shutdown_connections 2023-10-14T10:33:53.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.191+0000 7fa663fff640 1 -- 172.21.15.8:0/2913181785 wait complete. 2023-10-14T10:33:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.193+0000 7fa663fff640 1 Processor -- start 2023-10-14T10:33:53.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.193+0000 7fa663fff640 1 -- start start 2023-10-14T10:33:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.194+0000 7fa663fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa66406b6e0 0x7fa664149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.194+0000 7fa663fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa664152670 0x7fa6641ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.194+0000 7fa663fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa664155b00 0x7fa6641ed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.194+0000 7fa663fff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664154c70 con 0x7fa66406b6e0 2023-10-14T10:33:53.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.194+0000 7fa663fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640a8430 con 0x7fa664152670 2023-10-14T10:33:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.194+0000 7fa663fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640a9260 con 0x7fa664155b00 2023-10-14T10:33:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.194+0000 7fa662ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa66406b6e0 0x7fa664149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.194+0000 7fa662ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa66406b6e0 0x7fa664149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46844/0 (socket says 172.21.15.8:46844) 2023-10-14T10:33:53.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.194+0000 7fa662ffd640 1 -- 172.21.15.8:0/3723726089 learned_addr learned my addr 172.21.15.8:0/3723726089 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:53.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.194+0000 7fa6637fe640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa664155b00 0x7fa6641ed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:53.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.194+0000 7fa65bfff640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa664152670 0x7fa6641ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:53.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa662ffd640 1 -- 172.21.15.8:0/3723726089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa664155b00 msgr2=0x7fa6641ed3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:53.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa662ffd640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa664155b00 0x7fa6641ed3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa662ffd640 1 -- 172.21.15.8:0/3723726089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa664152670 msgr2=0x7fa6641ece60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:53.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa662ffd640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa664152670 0x7fa6641ece60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa662ffd640 1 -- 172.21.15.8:0/3723726089 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c009b30 con 0x7fa66406b6e0 2023-10-14T10:33:53.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa6637fe640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa664155b00 0x7fa6641ed3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:53.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa65bfff640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa664152670 0x7fa6641ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:53.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa662ffd640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa66406b6e0 0x7fa664149890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c450 tx=0x7fa65400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa660ff9640 1 -- 172.21.15.8:0/3723726089 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540052d0 con 0x7fa66406b6e0 2023-10-14T10:33:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa660ff9640 1 -- 172.21.15.8:0/3723726089 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654005430 con 0x7fa66406b6e0 2023-10-14T10:33:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa660ff9640 1 -- 172.21.15.8:0/3723726089 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654012870 con 0x7fa66406b6e0 2023-10-14T10:33:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa663fff640 1 -- 172.21.15.8:0/3723726089 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6640a8ca0 con 0x7fa66406b6e0 2023-10-14T10:33:53.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.195+0000 7fa663fff640 1 -- 172.21.15.8:0/3723726089 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa664149dd0 con 0x7fa66406b6e0 2023-10-14T10:33:53.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.196+0000 7fa663fff640 1 -- 172.21.15.8:0/3723726089 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa664149f60 con 0x7fa66406b6e0 2023-10-14T10:33:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.197+0000 7fa660ff9640 1 -- 172.21.15.8:0/3723726089 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa6540129d0 con 0x7fa66406b6e0 2023-10-14T10:33:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.198+0000 7fa660ff9640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa64406ae70 0x7fa64406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.198+0000 7fa660ff9640 1 -- 172.21.15.8:0/3723726089 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa654089160 con 0x7fa66406b6e0 2023-10-14T10:33:53.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.199+0000 7fa65bfff640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa64406ae70 0x7fa64406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:53.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.199+0000 7fa65bfff640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa64406ae70 0x7fa64406d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa664151410 tx=0x7fa64c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:53.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.202+0000 7fa660ff9640 1 -- 172.21.15.8:0/3723726089 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa654054200 con 0x7fa66406b6e0 2023-10-14T10:33:53.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.447+0000 7fa663fff640 1 -- 172.21.15.8:0/3723726089 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa66404e9b0 con 0x7fa66406b6e0 2023-10-14T10:33:53.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.457+0000 7fa660ff9640 1 -- 172.21.15.8:0/3723726089 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171022 (secure 0 0 0) 0x7fa654057820 con 0x7fa66406b6e0 2023-10-14T10:33:53.461 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:53.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.461+0000 7fa663fff640 1 -- 172.21.15.8:0/3723726089 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa64406ae70 msgr2=0x7fa64406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:53.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.461+0000 7fa663fff640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa64406ae70 0x7fa64406d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa664151410 tx=0x7fa64c008040 comp rx=0 tx=0).stop 2023-10-14T10:33:53.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.461+0000 7fa663fff640 1 -- 172.21.15.8:0/3723726089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa66406b6e0 msgr2=0x7fa664149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:53.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.461+0000 7fa663fff640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa66406b6e0 0x7fa664149890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c450 tx=0x7fa65400c910 comp rx=0 tx=0).stop 2023-10-14T10:33:53.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.462+0000 7fa663fff640 1 -- 172.21.15.8:0/3723726089 shutdown_connections 2023-10-14T10:33:53.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.462+0000 7fa663fff640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa64406ae70 0x7fa64406d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.462+0000 7fa663fff640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa664155b00 0x7fa6641ed3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.462+0000 7fa663fff640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa664152670 0x7fa6641ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.462+0000 7fa663fff640 1 --2- 172.21.15.8:0/3723726089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa66406b6e0 0x7fa664149890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.462+0000 7fa663fff640 1 -- 172.21.15.8:0/3723726089 >> 172.21.15.8:0/3723726089 conn(0x7fa66406a200 msgr2=0x7fa66414ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:53.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.462+0000 7fa663fff640 1 -- 172.21.15.8:0/3723726089 shutdown_connections 2023-10-14T10:33:53.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.462+0000 7fa663fff640 1 -- 172.21.15.8:0/3723726089 wait complete. 2023-10-14T10:33:53.483 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1591624325},{"type":"v1","addr":"172.21.15.8:6833","nonce":1591624325}]},"active_addr":"172.21.15.8:6833/1591624325","active_change":"2023-10-14T10:33:32.612156+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":356513977}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":1778633819}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":3157034633}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":2976096069}]}]} 2023-10-14T10:33:53.487 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T10:33:53.487 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T10:33:53.487 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:33:53.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.707+0000 7f47aaa10640 1 Processor -- start 2023-10-14T10:33:53.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.708+0000 7f47aaa10640 1 -- start start 2023-10-14T10:33:53.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.709+0000 7f47aaa10640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f47a4071ff0 0x7f47a40c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:53.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.709+0000 7f47aaa10640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f47a4152960 0x7f47a406d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:53.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.709+0000 7f47aaa10640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a4151ea0 con 0x7f47a413b260 2023-10-14T10:33:53.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.709+0000 7f47aaa10640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a4152540 con 0x7f47a4071ff0 2023-10-14T10:33:53.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.709+0000 7f47aaa10640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40c5d80 con 0x7f47a4152960 2023-10-14T10:33:53.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.710+0000 7f479bfff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f47a4071ff0 0x7f47a40c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.710+0000 7f47a8fad640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f47a4152960 0x7f47a406d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.710+0000 7f47a3fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f47a413b260 0x7f47a40c1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:56896/0 (socket says 172.21.15.8:56896) 2023-10-14T10:33:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.710+0000 7f47a3fff640 1 -- 172.21.15.8:0/1434363384 learned_addr learned my addr 172.21.15.8:0/1434363384 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.711+0000 7f47a37fe640 1 -- 172.21.15.8:0/1434363384 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629005544 0 0) 0x7f47a4151ea0 con 0x7f47a413b260 2023-10-14T10:33:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.711+0000 7f47a37fe640 1 -- 172.21.15.8:0/1434363384 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4790003520 con 0x7f47a413b260 2023-10-14T10:33:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.711+0000 7f479bfff640 1 -- 172.21.15.8:0/1434363384 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f47a4152960 msgr2=0x7f47a406d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.711+0000 7f479bfff640 1 --2- 172.21.15.8:0/1434363384 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f47a4152960 0x7f47a406d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.711+0000 7f479bfff640 1 -- 172.21.15.8:0/1434363384 >> v1:172.21.15.92:6789/0 conn(0x7f47a413b260 legacy=0x7f47a40c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.711+0000 7f479bfff640 1 -- 172.21.15.8:0/1434363384 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a40c6060 con 0x7f47a4071ff0 2023-10-14T10:33:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.711+0000 7f47a8fad640 1 --2- 172.21.15.8:0/1434363384 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f47a4152960 0x7f47a406d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:33:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.712+0000 7f479bfff640 1 --2- 172.21.15.8:0/1434363384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a4071ff0 0x7f47a40c57a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f478c0097a0 tx=0x7f478c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb8a64ece7aa3740 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.713+0000 7f47a37fe640 1 -- 172.21.15.8:0/1434363384 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c031780 con 0x7f47a4071ff0 2023-10-14T10:33:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.713+0000 7f47a37fe640 1 -- 172.21.15.8:0/1434363384 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c0318e0 con 0x7f47a4071ff0 2023-10-14T10:33:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.713+0000 7f47a37fe640 1 -- 172.21.15.8:0/1434363384 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c031c50 con 0x7f47a4071ff0 2023-10-14T10:33:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.714+0000 7f47aaa10640 1 -- 172.21.15.8:0/1434363384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a4071ff0 msgr2=0x7f47a40c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.714+0000 7f47aaa10640 1 --2- 172.21.15.8:0/1434363384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a4071ff0 0x7f47a40c57a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f478c0097a0 tx=0x7f478c02b820 comp rx=0 tx=0).stop 2023-10-14T10:33:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.714+0000 7f47aaa10640 1 -- 172.21.15.8:0/1434363384 shutdown_connections 2023-10-14T10:33:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.714+0000 7f47aaa10640 1 --2- 172.21.15.8:0/1434363384 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f47a4152960 0x7f47a406d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.714+0000 7f47aaa10640 1 --2- 172.21.15.8:0/1434363384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a4071ff0 0x7f47a40c57a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.714+0000 7f47aaa10640 1 -- 172.21.15.8:0/1434363384 >> 172.21.15.8:0/1434363384 conn(0x7f47a40a74d0 msgr2=0x7f47a40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.714+0000 7f47aaa10640 1 -- 172.21.15.8:0/1434363384 shutdown_connections 2023-10-14T10:33:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.714+0000 7f47aaa10640 1 -- 172.21.15.8:0/1434363384 wait complete. 2023-10-14T10:33:53.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.716+0000 7f47aaa10640 1 Processor -- start 2023-10-14T10:33:53.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.716+0000 7f47aaa10640 1 -- start start 2023-10-14T10:33:53.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.717+0000 7f47aaa10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a4071ff0 0x7f47a414f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:53.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.717+0000 7f47aaa10640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a413b260 0x7f47a4136af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:53.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.717+0000 7f47aaa10640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f47a4152960 0x7f47a40c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:53.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.717+0000 7f47aaa10640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a41534e0 con 0x7f47a413b260 2023-10-14T10:33:53.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.717+0000 7f47aaa10640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4156080 con 0x7f47a4071ff0 2023-10-14T10:33:53.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.717+0000 7f47aaa10640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a41e9e10 con 0x7f47a4152960 2023-10-14T10:33:53.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.717+0000 7f479bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a413b260 0x7f47a4136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:53.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.717+0000 7f479bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a413b260 0x7f47a4136af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46852/0 (socket says 172.21.15.8:46852) 2023-10-14T10:33:53.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.718+0000 7f479bfff640 1 -- 172.21.15.8:0/860856456 learned_addr learned my addr 172.21.15.8:0/860856456 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:53.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.718+0000 7f47a3fff640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a4071ff0 0x7f47a414f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:53.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.718+0000 7f47a8fad640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f47a4152960 0x7f47a40c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:53.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.718+0000 7f479bfff640 1 -- 172.21.15.8:0/860856456 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f47a4152960 msgr2=0x7f47a40c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:53.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.718+0000 7f479bfff640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f47a4152960 0x7f47a40c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.718+0000 7f479bfff640 1 -- 172.21.15.8:0/860856456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a4071ff0 msgr2=0x7f47a414f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:53.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.718+0000 7f479bfff640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a4071ff0 0x7f47a414f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.718+0000 7f479bfff640 1 -- 172.21.15.8:0/860856456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c009a70 con 0x7f47a413b260 2023-10-14T10:33:53.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.718+0000 7f479bfff640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a413b260 0x7f47a4136af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f478c0098c0 tx=0x7f478c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:53.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.719+0000 7f47a17fa640 1 -- 172.21.15.8:0/860856456 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c032820 con 0x7f47a413b260 2023-10-14T10:33:53.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.719+0000 7f47a17fa640 1 -- 172.21.15.8:0/860856456 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c032980 con 0x7f47a413b260 2023-10-14T10:33:53.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.719+0000 7f47aaa10640 1 -- 172.21.15.8:0/860856456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478c009400 con 0x7f47a413b260 2023-10-14T10:33:53.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.719+0000 7f47a17fa640 1 -- 172.21.15.8:0/860856456 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c032cf0 con 0x7f47a413b260 2023-10-14T10:33:53.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.719+0000 7f47aaa10640 1 -- 172.21.15.8:0/860856456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a41ed170 con 0x7f47a413b260 2023-10-14T10:33:53.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.720+0000 7f47aaa10640 1 -- 172.21.15.8:0/860856456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a4153620 con 0x7f47a413b260 2023-10-14T10:33:53.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.721+0000 7f47a17fa640 1 -- 172.21.15.8:0/860856456 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f478c04e440 con 0x7f47a413b260 2023-10-14T10:33:53.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.722+0000 7f47a17fa640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f478406aea0 0x7f478406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:53.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.722+0000 7f47a17fa640 1 -- 172.21.15.8:0/860856456 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f478c0ab5f0 con 0x7f47a413b260 2023-10-14T10:33:53.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.723+0000 7f47a3fff640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f478406aea0 0x7f478406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:53.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.723+0000 7f47a3fff640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f478406aea0 0x7f478406d360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f47940011e0 tx=0x7f4794009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:53.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.727+0000 7f47a17fa640 1 -- 172.21.15.8:0/860856456 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47a4153620 con 0x7f47a413b260 2023-10-14T10:33:53.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.920+0000 7f47aaa10640 1 -- 172.21.15.8:0/860856456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47a4153620 con 0x7f47a413b260 2023-10-14T10:33:53.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.923+0000 7f47a17fa640 1 -- 172.21.15.8:0/860856456 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7f47a4153620 con 0x7f47a413b260 2023-10-14T10:33:53.926 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:53.926 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:33:53.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.926+0000 7f47aaa10640 1 -- 172.21.15.8:0/860856456 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f478406aea0 msgr2=0x7f478406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:53.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.926+0000 7f47aaa10640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f478406aea0 0x7f478406d360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f47940011e0 tx=0x7f4794009040 comp rx=0 tx=0).stop 2023-10-14T10:33:53.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.926+0000 7f47aaa10640 1 -- 172.21.15.8:0/860856456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a413b260 msgr2=0x7f47a4136af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:53.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.926+0000 7f47aaa10640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a413b260 0x7f47a4136af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f478c0098c0 tx=0x7f478c0046c0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.926+0000 7f47aaa10640 1 -- 172.21.15.8:0/860856456 shutdown_connections 2023-10-14T10:33:53.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.926+0000 7f47aaa10640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f478406aea0 0x7f478406d360 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.926+0000 7f47aaa10640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f47a4152960 0x7f47a40c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.926+0000 7f47aaa10640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47a413b260 0x7f47a4136af0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.926+0000 7f47aaa10640 1 --2- 172.21.15.8:0/860856456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47a4071ff0 0x7f47a414f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:53.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.926+0000 7f47aaa10640 1 -- 172.21.15.8:0/860856456 >> 172.21.15.8:0/860856456 conn(0x7f47a40a74d0 msgr2=0x7f47a41389e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:53.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.926+0000 7f47aaa10640 1 -- 172.21.15.8:0/860856456 shutdown_connections 2023-10-14T10:33:53.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:53.926+0000 7f47aaa10640 1 -- 172.21.15.8:0/860856456 wait complete. 2023-10-14T10:33:53.950 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T10:33:53.950 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:33:54.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.175+0000 7fd1ab59e640 1 Processor -- start 2023-10-14T10:33:54.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.175+0000 7fd1ab59e640 1 -- start start 2023-10-14T10:33:54.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.177+0000 7fd1ab59e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd1ac0bf7f0 0x7fd1ac1545f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.177+0000 7fd1ab59e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac0bfe20 con 0x7fd1ac14dea0 2023-10-14T10:33:54.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.177+0000 7fd1ab59e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac0c03c0 con 0x7fd1ac0c0640 2023-10-14T10:33:54.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.177+0000 7fd1ab59e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac154b30 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.177+0000 7fd1aa59c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd1ac14dea0 0x7fd1ac069de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34402/0 (socket says 172.21.15.8:34402) 2023-10-14T10:33:54.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.177+0000 7fd1aa59c640 1 -- 172.21.15.8:0/2784097081 learned_addr learned my addr 172.21.15.8:0/2784097081 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:54.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.177+0000 7fd1aad9d640 1 --2- 172.21.15.8:0/2784097081 >> v2:172.21.15.8:3300/0 conn(0x7fd1ac0bf7f0 0x7fd1ac1545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.178+0000 7fd1aad9d640 1 -- 172.21.15.8:0/2784097081 >> v1:172.21.15.92:6789/0 conn(0x7fd1ac0c0640 legacy=0x7fd1ac153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.178+0000 7fd1aad9d640 1 -- 172.21.15.8:0/2784097081 >> v1:172.21.15.8:6789/0 conn(0x7fd1ac14dea0 legacy=0x7fd1ac069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.178+0000 7fd1aad9d640 1 -- 172.21.15.8:0/2784097081 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac070ed0 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.179+0000 7fd1aad9d640 1 --2- 172.21.15.8:0/2784097081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1ac0bf7f0 0x7fd1ac1545f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009d90 tx=0x7fd1a402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5697d4e0b9d69c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.179+0000 7fd1a959a640 1 -- 172.21.15.8:0/2784097081 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a402cc60 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.180+0000 7fd1a959a640 1 -- 172.21.15.8:0/2784097081 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a402cdc0 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.180+0000 7fd1a959a640 1 -- 172.21.15.8:0/2784097081 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4034660 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.180+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2784097081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1ac0bf7f0 msgr2=0x7fd1ac1545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.180+0000 7fd1ab59e640 1 --2- 172.21.15.8:0/2784097081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1ac0bf7f0 0x7fd1ac1545f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009d90 tx=0x7fd1a402beb0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.180+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2784097081 shutdown_connections 2023-10-14T10:33:54.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.180+0000 7fd1ab59e640 1 --2- 172.21.15.8:0/2784097081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1ac0bf7f0 0x7fd1ac1545f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.180+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2784097081 >> 172.21.15.8:0/2784097081 conn(0x7fd1ac06d6c0 msgr2=0x7fd1ac06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.180+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2784097081 shutdown_connections 2023-10-14T10:33:54.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.180+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2784097081 wait complete. 2023-10-14T10:33:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.182+0000 7fd1ab59e640 1 Processor -- start 2023-10-14T10:33:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.182+0000 7fd1ab59e640 1 -- start start 2023-10-14T10:33:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.183+0000 7fd1ab59e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1ac0bf7f0 0x7fd1ac1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.183+0000 7fd1ab59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1ac0c0640 0x7fd1ac1e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.184+0000 7fd1ab59e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1ac14dea0 0x7fd1ac1466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.184+0000 7fd1ab59e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac14ea70 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.184+0000 7fd1ab59e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac1e9b60 con 0x7fd1ac0c0640 2023-10-14T10:33:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.184+0000 7fd1ab59e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac1e9810 con 0x7fd1ac14dea0 2023-10-14T10:33:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.184+0000 7fd1aa59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1ac0bf7f0 0x7fd1ac1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.184+0000 7fd1aa59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1ac0bf7f0 0x7fd1ac1519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46866/0 (socket says 172.21.15.8:46866) 2023-10-14T10:33:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.184+0000 7fd1aa59c640 1 -- 172.21.15.8:0/2495430371 learned_addr learned my addr 172.21.15.8:0/2495430371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.184+0000 7fd1aa59c640 1 -- 172.21.15.8:0/2495430371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1ac14dea0 msgr2=0x7fd1ac1466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.184+0000 7fd1aa59c640 1 --2- 172.21.15.8:0/2495430371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1ac14dea0 0x7fd1ac1466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.184+0000 7fd1aa59c640 1 -- 172.21.15.8:0/2495430371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1ac0c0640 msgr2=0x7fd1ac1e9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.184+0000 7fd1aa59c640 1 --2- 172.21.15.8:0/2495430371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1ac0c0640 0x7fd1ac1e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.184+0000 7fd1aa59c640 1 -- 172.21.15.8:0/2495430371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4009a70 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.185+0000 7fd1aa59c640 1 --2- 172.21.15.8:0/2495430371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1ac0bf7f0 0x7fd1ac1519b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00c480 tx=0x7fd19c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.185+0000 7fd19affd640 1 -- 172.21.15.8:0/2495430371 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c005ce0 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.185+0000 7fd19affd640 1 -- 172.21.15.8:0/2495430371 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c005e40 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.185+0000 7fd19affd640 1 -- 172.21.15.8:0/2495430371 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0072f0 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.185+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2495430371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac1536f0 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.185+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2495430371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac144200 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.186+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2495430371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac04e9b0 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.187+0000 7fd19affd640 1 -- 172.21.15.8:0/2495430371 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd19c007450 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.188+0000 7fd19affd640 1 --2- 172.21.15.8:0/2495430371 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd18c06aea0 0x7fd18c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.189+0000 7fd19affd640 1 -- 172.21.15.8:0/2495430371 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd19c088ab0 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.189+0000 7fd1a9d9b640 1 --2- 172.21.15.8:0/2495430371 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd18c06aea0 0x7fd18c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.189+0000 7fd1a9d9b640 1 --2- 172.21.15.8:0/2495430371 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd18c06aea0 0x7fd18c06d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0000f60 tx=0x7fd1a00079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.194+0000 7fd19affd640 1 -- 172.21.15.8:0/2495430371 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd19c053c00 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.389+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2495430371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1ac0c6a80 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.391+0000 7fd19affd640 1 -- 172.21.15.8:0/2495430371 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7fd19c017020 con 0x7fd1ac0bf7f0 2023-10-14T10:33:54.394 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:54.394 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:33:54.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.394+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2495430371 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd18c06aea0 msgr2=0x7fd18c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.394+0000 7fd1ab59e640 1 --2- 172.21.15.8:0/2495430371 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd18c06aea0 0x7fd18c06d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0000f60 tx=0x7fd1a00079b0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.394+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2495430371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1ac0bf7f0 msgr2=0x7fd1ac1519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.394+0000 7fd1ab59e640 1 --2- 172.21.15.8:0/2495430371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1ac0bf7f0 0x7fd1ac1519b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00c480 tx=0x7fd19c00c940 comp rx=0 tx=0).stop 2023-10-14T10:33:54.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.394+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2495430371 shutdown_connections 2023-10-14T10:33:54.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.394+0000 7fd1ab59e640 1 --2- 172.21.15.8:0/2495430371 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd18c06aea0 0x7fd18c06d360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.394+0000 7fd1ab59e640 1 --2- 172.21.15.8:0/2495430371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1ac14dea0 0x7fd1ac1466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.394+0000 7fd1ab59e640 1 --2- 172.21.15.8:0/2495430371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1ac0c0640 0x7fd1ac1e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.394+0000 7fd1ab59e640 1 --2- 172.21.15.8:0/2495430371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1ac0bf7f0 0x7fd1ac1519b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.394+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2495430371 >> 172.21.15.8:0/2495430371 conn(0x7fd1ac06d6c0 msgr2=0x7fd1ac148890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.394+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2495430371 shutdown_connections 2023-10-14T10:33:54.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.394+0000 7fd1ab59e640 1 -- 172.21.15.8:0/2495430371 wait complete. 2023-10-14T10:33:54.416 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T10:33:54.417 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T10:33:54.418 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T10:33:54.418 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-14T10:33:54.419 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-14T10:33:54.419 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-14T10:33:54.420 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-14T10:33:54.420 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-14T10:33:54.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.728+0000 7fc4dd7ae640 1 Processor -- start 2023-10-14T10:33:54.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.728+0000 7fc4dd7ae640 1 -- start start 2023-10-14T10:33:54.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.730+0000 7fc4dd7ae640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc4d0006cd0 0x7fc4d00070b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.731+0000 7fc4dd7ae640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc4d00dbb40 0x7fc4d00dbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.731+0000 7fc4dd7ae640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d00da650 con 0x7fc4d00dc500 2023-10-14T10:33:54.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.731+0000 7fc4dd7ae640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d00da910 con 0x7fc4d0006cd0 2023-10-14T10:33:54.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.731+0000 7fc4dd7ae640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00dabf0 con 0x7fc4d00dbb40 2023-10-14T10:33:54.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.731+0000 7fc4d7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc4d0006cd0 0x7fc4d00070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.732+0000 7fc4d7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc4d0006cd0 0x7fc4d00070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46870/0 (socket says 172.21.15.8:46870) 2023-10-14T10:33:54.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.732+0000 7fc4d7fff640 1 -- 172.21.15.8:0/496124925 learned_addr learned my addr 172.21.15.8:0/496124925 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.732+0000 7fc4d77fe640 1 --2- 172.21.15.8:0/496124925 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc4d00dbb40 0x7fc4d00dbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.732+0000 7fc4d7fff640 1 -- 172.21.15.8:0/496124925 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc4d00dbb40 msgr2=0x7fc4d00dbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:54.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.732+0000 7fc4d7fff640 1 --2- 172.21.15.8:0/496124925 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc4d00dbb40 0x7fc4d00dbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.732+0000 7fc4d7fff640 1 -- 172.21.15.8:0/496124925 >> v1:172.21.15.92:6789/0 conn(0x7fc4d00dc500 legacy=0x7fc4d00ddc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.732+0000 7fc4d7fff640 1 -- 172.21.15.8:0/496124925 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d00daed0 con 0x7fc4d0006cd0 2023-10-14T10:33:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.735+0000 7fc4d7fff640 1 --2- 172.21.15.8:0/496124925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4d0006cd0 0x7fc4d00070b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009ad0 tx=0x7fc4cc02bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82df0a8b76e0c09c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.736+0000 7fc4d6ffd640 1 -- 172.21.15.8:0/496124925 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc02c790 con 0x7fc4d0006cd0 2023-10-14T10:33:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.736+0000 7fc4d6ffd640 1 -- 172.21.15.8:0/496124925 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc02c8f0 con 0x7fc4d0006cd0 2023-10-14T10:33:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.736+0000 7fc4d6ffd640 1 -- 172.21.15.8:0/496124925 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc02cce0 con 0x7fc4d0006cd0 2023-10-14T10:33:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.736+0000 7fe094597640 1 Processor -- start 2023-10-14T10:33:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.737+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/496124925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4d0006cd0 msgr2=0x7fc4d00070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.737+0000 7fc4dd7ae640 1 --2- 172.21.15.8:0/496124925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4d0006cd0 0x7fc4d00070b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009ad0 tx=0x7fc4cc02bc10 comp rx=0 tx=0).stop 2023-10-14T10:33:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.737+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/496124925 shutdown_connections 2023-10-14T10:33:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.737+0000 7fc4dd7ae640 1 --2- 172.21.15.8:0/496124925 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc4d00dbb40 0x7fc4d00dbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.737+0000 7fc4dd7ae640 1 --2- 172.21.15.8:0/496124925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4d0006cd0 0x7fc4d00070b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.737+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/496124925 >> 172.21.15.8:0/496124925 conn(0x7fc4d00061b0 msgr2=0x7fc4d00065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.737+0000 7fe094597640 1 -- start start 2023-10-14T10:33:54.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.738+0000 7fe094597640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe08c1515c0 0x7fe08c0c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.738+0000 7fe094597640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe08c0c5550 0x7fe08c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.738+0000 7fe094597640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08c1545f0 con 0x7fe08c0c7630 2023-10-14T10:33:54.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.738+0000 7fe094597640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08c0c59d0 con 0x7fe08c1515c0 2023-10-14T10:33:54.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.738+0000 7fe094597640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c1519a0 con 0x7fe08c0c5550 2023-10-14T10:33:54.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.737+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/496124925 shutdown_connections 2023-10-14T10:33:54.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.737+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/496124925 wait complete. 2023-10-14T10:33:54.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.740+0000 7fe092b34640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe08c0c7630 0x7fe08c06ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34410/0 (socket says 172.21.15.8:34410) 2023-10-14T10:33:54.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.740+0000 7fe092333640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe08c1515c0 0x7fe08c0c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.740+0000 7fe091b32640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe08c0c5550 0x7fe08c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.740+0000 7fe092333640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe08c1515c0 0x7fe08c0c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:37400/0 (socket says 172.21.15.8:37400) 2023-10-14T10:33:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.740+0000 7fe092333640 1 -- 172.21.15.8:0/3364965301 learned_addr learned my addr 172.21.15.8:0/3364965301 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.741+0000 7fc4dd7ae640 1 Processor -- start 2023-10-14T10:33:54.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.741+0000 7fe091331640 1 -- 172.21.15.8:0/3364965301 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061404822 0 0) 0x7fe08c1545f0 con 0x7fe08c0c7630 2023-10-14T10:33:54.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.741+0000 7fe091331640 1 -- 172.21.15.8:0/3364965301 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe078003520 con 0x7fe08c0c7630 2023-10-14T10:33:54.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.741+0000 7fe091b32640 1 -- 172.21.15.8:0/3364965301 >> v2:172.21.15.92:3300/0 conn(0x7fe08c1515c0 msgr2=0x7fe08c0c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:54.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.741+0000 7fe091b32640 1 --2- 172.21.15.8:0/3364965301 >> v2:172.21.15.92:3300/0 conn(0x7fe08c1515c0 0x7fe08c0c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.742+0000 7fe091b32640 1 -- 172.21.15.8:0/3364965301 >> v1:172.21.15.8:6789/0 conn(0x7fe08c0c7630 legacy=0x7fe08c06ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.742+0000 7fe091b32640 1 -- 172.21.15.8:0/3364965301 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c06b910 con 0x7fe08c0c5550 2023-10-14T10:33:54.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.741+0000 7fc4dd7ae640 1 -- start start 2023-10-14T10:33:54.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.743+0000 7fe091b32640 1 --2- 172.21.15.8:0/3364965301 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe08c0c5550 0x7fe08c154a80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe084009d90 tx=0x7fe08402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=564a13b95982ff3b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.743+0000 7fc4dd7ae640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc4d0006cd0 0x7fc4d00d6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.743+0000 7fc4dd7ae640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4d00dbb40 0x7fc4d0179d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.743+0000 7fc4dd7ae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4d00dc500 0x7fc4d017a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.743+0000 7fc4dd7ae640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00de030 con 0x7fc4d00dbb40 2023-10-14T10:33:54.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.743+0000 7fc4dd7ae640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00d7700 con 0x7fc4d00dc500 2023-10-14T10:33:54.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.743+0000 7fc4dd7ae640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d0180230 con 0x7fc4d0006cd0 2023-10-14T10:33:54.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.744+0000 7fe091331640 1 -- 172.21.15.8:0/3364965301 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08402cbc0 con 0x7fe08c0c5550 2023-10-14T10:33:54.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.744+0000 7fe091331640 1 -- 172.21.15.8:0/3364965301 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08402cd20 con 0x7fe08c0c5550 2023-10-14T10:33:54.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.744+0000 7fe091331640 1 -- 172.21.15.8:0/3364965301 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084034640 con 0x7fe08c0c5550 2023-10-14T10:33:54.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.744+0000 7fc4d7fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc4d0006cd0 0x7fc4d00d6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.745+0000 7fc4d7fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc4d0006cd0 0x7fc4d00d6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:60824/0 (socket says 172.21.15.8:60824) 2023-10-14T10:33:54.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.745+0000 7fc4d7fff640 1 -- 172.21.15.8:0/4239560043 learned_addr learned my addr 172.21.15.8:0/4239560043 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.745+0000 7fc4d77fe640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4d00dbb40 0x7fc4d0179d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.745+0000 7fc4dcfad640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4d00dc500 0x7fc4d017a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.745+0000 7fe094597640 1 -- 172.21.15.8:0/3364965301 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe08c0c5550 msgr2=0x7fe08c154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.745+0000 7fe094597640 1 --2- 172.21.15.8:0/3364965301 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe08c0c5550 0x7fe08c154a80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe084009d90 tx=0x7fe08402be10 comp rx=0 tx=0).stop 2023-10-14T10:33:54.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.745+0000 7fe9d744b640 1 Processor -- start 2023-10-14T10:33:54.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7fc4d77fe640 1 -- 172.21.15.8:0/4239560043 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc4d0006cd0 msgr2=0x7fc4d00d6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7fc4d77fe640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc4d0006cd0 0x7fc4d00d6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7fc4d77fe640 1 -- 172.21.15.8:0/4239560043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4d00dc500 msgr2=0x7fc4d017a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7fe9d744b640 1 -- start start 2023-10-14T10:33:54.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7fc4d77fe640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4d00dc500 0x7fc4d017a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7fc4d77fe640 1 -- 172.21.15.8:0/4239560043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc0094d0 con 0x7fc4d00dbb40 2023-10-14T10:33:54.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7fc4dcfad640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4d00dc500 0x7fc4d017a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:54.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7fe094597640 1 -- 172.21.15.8:0/3364965301 shutdown_connections 2023-10-14T10:33:54.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7f7d23275640 1 Processor -- start 2023-10-14T10:33:54.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7fe094597640 1 --2- 172.21.15.8:0/3364965301 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe08c0c5550 0x7fe08c154a80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7fe094597640 1 --2- 172.21.15.8:0/3364965301 >> v2:172.21.15.92:3300/0 conn(0x7fe08c1515c0 0x7fe08c0c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7fe094597640 1 -- 172.21.15.8:0/3364965301 >> 172.21.15.8:0/3364965301 conn(0x7fe08c0c9730 msgr2=0x7fe08c0c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7fc4d77fe640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4d00dbb40 0x7fc4d0179d60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80697d0 tx=0x7fc4d8072530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.747+0000 7fc4d4ff9640 1 -- 172.21.15.8:0/4239560043 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8073790 con 0x7fc4d00dbb40 2023-10-14T10:33:54.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.747+0000 7fe094597640 1 -- 172.21.15.8:0/3364965301 shutdown_connections 2023-10-14T10:33:54.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.747+0000 7fc4d4ff9640 1 -- 172.21.15.8:0/4239560043 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d80738f0 con 0x7fc4d00dbb40 2023-10-14T10:33:54.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.747+0000 7fe094597640 1 -- 172.21.15.8:0/3364965301 wait complete. 2023-10-14T10:33:54.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.747+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/4239560043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d00ddb00 con 0x7fc4d00dbb40 2023-10-14T10:33:54.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.748+0000 7fe9d744b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe9d006ab00 0x7fe9d006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.748+0000 7fe9d744b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe9d00a9170 0x7fe9d00c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.748+0000 7fe9d744b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9d00af820 0x7fe9d00c5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.748+0000 7fe9d744b640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d0155040 con 0x7fe9d00a9170 2023-10-14T10:33:54.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.748+0000 7fe9d744b640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d00c4490 con 0x7fe9d006ab00 2023-10-14T10:33:54.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.748+0000 7fe9d744b640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00af490 con 0x7fe9d00af820 2023-10-14T10:33:54.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.746+0000 7f7d23275640 1 -- start start 2023-10-14T10:33:54.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.748+0000 7fe9d51e7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe9d006ab00 0x7fe9d006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.749+0000 7fe9d51e7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe9d006ab00 0x7fe9d006aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:37426/0 (socket says 172.21.15.8:37426) 2023-10-14T10:33:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.749+0000 7fe9d51e7640 1 -- 172.21.15.8:0/3736188832 learned_addr learned my addr 172.21.15.8:0/3736188832 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.748+0000 7f7d23275640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7d1c06fbf0 0x7f7d1c150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.749+0000 7f7d23275640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c0ba570 con 0x7f7d1c06de90 2023-10-14T10:33:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.749+0000 7f7d23275640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c0709a0 con 0x7f7d1c06e270 2023-10-14T10:33:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.749+0000 7f7d23275640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1c0bad80 con 0x7f7d1c06fbf0 2023-10-14T10:33:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.747+0000 7fc4d4ff9640 1 -- 172.21.15.8:0/4239560043 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d80913f0 con 0x7fc4d00dbb40 2023-10-14T10:33:54.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.749+0000 7f7d21a72640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7d1c06fbf0 0x7f7d1c150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.749+0000 7fe9d59e8640 1 --2- 172.21.15.8:0/3736188832 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9d00af820 0x7fe9d00c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.749+0000 7fe094597640 1 Processor -- start 2023-10-14T10:33:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.749+0000 7f7d21a72640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7d1c06fbf0 0x7f7d1c150ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46884/0 (socket says 172.21.15.8:46884) 2023-10-14T10:33:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.750+0000 7f7d21a72640 1 -- 172.21.15.8:0/1956462227 learned_addr learned my addr 172.21.15.8:0/1956462227 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.750+0000 7fe094597640 1 -- start start 2023-10-14T10:33:54.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.750+0000 7fe9d51e7640 1 -- 172.21.15.8:0/3736188832 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9d00af820 msgr2=0x7fe9d00c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:54.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.750+0000 7fe9d51e7640 1 --2- 172.21.15.8:0/3736188832 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9d00af820 0x7fe9d00c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.750+0000 7fe9d51e7640 1 -- 172.21.15.8:0/3736188832 >> v2:172.21.15.8:3300/0 conn(0x7fe9d00a9170 msgr2=0x7fe9d00c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:54.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.750+0000 7fe9d51e7640 1 --2- 172.21.15.8:0/3736188832 >> v2:172.21.15.8:3300/0 conn(0x7fe9d00a9170 0x7fe9d00c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.750+0000 7fe9d51e7640 1 -- 172.21.15.8:0/3736188832 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0151ae0 con 0x7fe9d006ab00 2023-10-14T10:33:54.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.750+0000 7f3324664640 1 Processor -- start 2023-10-14T10:33:54.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.750+0000 7f7d21a72640 1 -- 172.21.15.8:0/1956462227 >> v1:172.21.15.92:6789/0 conn(0x7f7d1c06e270 legacy=0x7f7d1c0bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.747+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/4239560043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d0180420 con 0x7fc4d00dbb40 2023-10-14T10:33:54.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.748+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/4239560043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc4d0043470 con 0x7fc4d00dbb40 2023-10-14T10:33:54.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.751+0000 7f7d21a72640 1 -- 172.21.15.8:0/1956462227 >> v1:172.21.15.8:6789/0 conn(0x7f7d1c06de90 legacy=0x7f7d1c0baf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:54.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.751+0000 7f3324664640 1 -- start start 2023-10-14T10:33:54.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.751+0000 7f7d21a72640 1 -- 172.21.15.8:0/1956462227 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c0ba7c0 con 0x7f7d1c06fbf0 2023-10-14T10:33:54.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.751+0000 7fe9d51e7640 1 --2- 172.21.15.8:0/3736188832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9d006ab00 0x7fe9d006aee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe9d008b3c0 tx=0x7fe9c802be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f57b9819b4931375 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.751+0000 7fe094597640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe08c0c5550 0x7fe08c148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.751+0000 7fe094597640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe08c0c7630 0x7fe08c1ec950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.752+0000 7fe094597640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe08c1515c0 0x7fe08c1ece90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.752+0000 7fe094597640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c14d5c0 con 0x7fe08c0c7630 2023-10-14T10:33:54.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.752+0000 7fe094597640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c14bc80 con 0x7fe08c1515c0 2023-10-14T10:33:54.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.752+0000 7fe092333640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe08c0c5550 0x7fe08c148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.752+0000 7f7d21a72640 1 --2- 172.21.15.8:0/1956462227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d1c06fbf0 0x7f7d1c150ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009870 tx=0x7f7d1802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805276df4aacc8a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7f3324664640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f331c14f3a0 0x7f331c071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.752+0000 7fe9cffff640 1 -- 172.21.15.8:0/3736188832 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c802ca30 con 0x7fe9d006ab00 2023-10-14T10:33:54.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7fe9cffff640 1 -- 172.21.15.8:0/3736188832 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c802cb90 con 0x7fe9d006ab00 2023-10-14T10:33:54.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7fe9cffff640 1 -- 172.21.15.8:0/3736188832 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80343f0 con 0x7fe9d006ab00 2023-10-14T10:33:54.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7f3324664640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f331c0bfee0 0x7f331c152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7f3324664640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331c0c57a0 con 0x7f331c155440 2023-10-14T10:33:54.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7f3324664640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331c06cee0 con 0x7f331c0bfee0 2023-10-14T10:33:54.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7f3324664640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c151e50 con 0x7f331c14f3a0 2023-10-14T10:33:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7f7d21271640 1 -- 172.21.15.8:0/1956462227 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1802f840 con 0x7f7d1c06fbf0 2023-10-14T10:33:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7fe094597640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c1ec4c0 con 0x7fe08c0c5550 2023-10-14T10:33:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7fe092b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe08c1515c0 0x7fe08c1ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7fe092b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe08c1515c0 0x7fe08c1ece90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:37432/0 (socket says 172.21.15.8:37432) 2023-10-14T10:33:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7fe092b34640 1 -- 172.21.15.8:0/3038239842 learned_addr learned my addr 172.21.15.8:0/3038239842 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7f3321bff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f331c155440 0x7f331c06d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34430/0 (socket says 172.21.15.8:34430) 2023-10-14T10:33:54.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7f3321bff640 1 -- 172.21.15.8:0/2815239572 learned_addr learned my addr 172.21.15.8:0/2815239572 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:54.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.752+0000 7fe092333640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe08c0c5550 0x7fe08c148630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:60852/0 (socket says 172.21.15.8:60852) 2023-10-14T10:33:54.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7fe092b34640 1 -- 172.21.15.8:0/3038239842 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe08c0c5550 msgr2=0x7fe08c148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7fe092b34640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe08c0c5550 0x7fe08c148630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7fe092b34640 1 -- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe08c0c7630 msgr2=0x7fe08c1ec950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.753+0000 7fe091b32640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe08c0c7630 0x7fe08c1ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7fe092b34640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe08c0c7630 0x7fe08c1ec950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7fe092b34640 1 -- 172.21.15.8:0/3038239842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe084009a70 con 0x7fe08c1515c0 2023-10-14T10:33:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7fe091b32640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe08c0c7630 0x7fe08c1ec950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:54.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7f3322c01640 1 --2- 172.21.15.8:0/2815239572 >> v2:172.21.15.8:3300/0 conn(0x7f331c0bfee0 0x7f331c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7fe9d744b640 1 -- 172.21.15.8:0/3736188832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9d006ab00 msgr2=0x7fe9d006aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7fe9d744b640 1 --2- 172.21.15.8:0/3736188832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9d006ab00 0x7fe9d006aee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe9d008b3c0 tx=0x7fe9c802be90 comp rx=0 tx=0).stop 2023-10-14T10:33:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7fe9d744b640 1 -- 172.21.15.8:0/3736188832 shutdown_connections 2023-10-14T10:33:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7fe9d744b640 1 --2- 172.21.15.8:0/3736188832 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9d00af820 0x7fe9d00c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7fe9d744b640 1 --2- 172.21.15.8:0/3736188832 >> v2:172.21.15.8:3300/0 conn(0x7fe9d00a9170 0x7fe9d00c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7fe9d744b640 1 --2- 172.21.15.8:0/3736188832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9d006ab00 0x7fe9d006aee0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7fe9d744b640 1 -- 172.21.15.8:0/3736188832 >> 172.21.15.8:0/3736188832 conn(0x7fe9d00ab600 msgr2=0x7fe9d00aba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7fe9d744b640 1 -- 172.21.15.8:0/3736188832 shutdown_connections 2023-10-14T10:33:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7f3322400640 1 --2- 172.21.15.8:0/2815239572 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f331c14f3a0 0x7f331c071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7fe9d744b640 1 -- 172.21.15.8:0/3736188832 wait complete. 2023-10-14T10:33:54.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7f33213fe640 1 -- 172.21.15.8:0/2815239572 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193130577 0 0) 0x7f331c0c57a0 con 0x7f331c155440 2023-10-14T10:33:54.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7f33213fe640 1 -- 172.21.15.8:0/2815239572 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3308007930 con 0x7f331c155440 2023-10-14T10:33:54.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7f3322c01640 1 -- 172.21.15.8:0/2815239572 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f331c14f3a0 msgr2=0x7f331c071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:54.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7f3322c01640 1 --2- 172.21.15.8:0/2815239572 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f331c14f3a0 0x7f331c071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7f3322c01640 1 -- 172.21.15.8:0/2815239572 >> v1:172.21.15.8:6789/0 conn(0x7f331c155440 legacy=0x7f331c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7fa22fea2640 1 Processor -- start 2023-10-14T10:33:54.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7fe092b34640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe08c1515c0 0x7fe08c1ece90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00c460 tx=0x7fe07c00c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7f3322c01640 1 -- 172.21.15.8:0/2815239572 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c0c59f0 con 0x7f331c0bfee0 2023-10-14T10:33:54.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7f7d21271640 1 -- 172.21.15.8:0/1956462227 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1802f9a0 con 0x7f7d1c06fbf0 2023-10-14T10:33:54.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.754+0000 7f7d21271640 1 -- 172.21.15.8:0/1956462227 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1802fd30 con 0x7f7d1c06fbf0 2023-10-14T10:33:54.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7fa22fea2640 1 -- start start 2023-10-14T10:33:54.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7fe082ffd640 1 -- 172.21.15.8:0/3038239842 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0074e0 con 0x7fe08c1515c0 2023-10-14T10:33:54.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7fe082ffd640 1 -- 172.21.15.8:0/3038239842 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c007640 con 0x7fe08c1515c0 2023-10-14T10:33:54.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.755+0000 7fe094597640 1 -- 172.21.15.8:0/3038239842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08c0aec20 con 0x7fe08c1515c0 2023-10-14T10:33:54.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.756+0000 7fe094597640 1 -- 172.21.15.8:0/3038239842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08c14e500 con 0x7fe08c1515c0 2023-10-14T10:33:54.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.756+0000 7f7d23275640 1 -- 172.21.15.8:0/1956462227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d1c06fbf0 msgr2=0x7f7d1c150ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.756+0000 7f7d23275640 1 --2- 172.21.15.8:0/1956462227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d1c06fbf0 0x7f7d1c150ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009870 tx=0x7f7d1802ba20 comp rx=0 tx=0).stop 2023-10-14T10:33:54.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.756+0000 7f7d23275640 1 -- 172.21.15.8:0/1956462227 shutdown_connections 2023-10-14T10:33:54.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.756+0000 7f7d23275640 1 --2- 172.21.15.8:0/1956462227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d1c06fbf0 0x7f7d1c150ac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.756+0000 7f7d23275640 1 -- 172.21.15.8:0/1956462227 >> 172.21.15.8:0/1956462227 conn(0x7f7d1c0c5290 msgr2=0x7f7d1c0c5670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.757+0000 7f7d23275640 1 -- 172.21.15.8:0/1956462227 shutdown_connections 2023-10-14T10:33:54.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.757+0000 7fc4d4ff9640 1 -- 172.21.15.8:0/4239560043 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc4d8060800 con 0x7fc4d00dbb40 2023-10-14T10:33:54.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.757+0000 7fe9d744b640 1 Processor -- start 2023-10-14T10:33:54.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.757+0000 7fa22fea2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa22814f3a0 0x7fa228071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.757+0000 7fa22fea2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2280bfee0 0x7fa228152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.757+0000 7fa22fea2640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2280c57a0 con 0x7fa228155440 2023-10-14T10:33:54.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.757+0000 7fa22fea2640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22806cee0 con 0x7fa22814f3a0 2023-10-14T10:33:54.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.757+0000 7fa22fea2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa228151e50 con 0x7fa2280bfee0 2023-10-14T10:33:54.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.757+0000 7f7d23275640 1 -- 172.21.15.8:0/1956462227 wait complete. 2023-10-14T10:33:54.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.756+0000 7fe082ffd640 1 -- 172.21.15.8:0/3038239842 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c004a20 con 0x7fe08c1515c0 2023-10-14T10:33:54.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.757+0000 7fe094597640 1 -- 172.21.15.8:0/3038239842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe074000fc0 con 0x7fe08c1515c0 2023-10-14T10:33:54.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.757+0000 7fe9d744b640 1 -- start start 2023-10-14T10:33:54.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.758+0000 7f3322c01640 1 --2- 172.21.15.8:0/2815239572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f331c0bfee0 0x7f331c152580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3314009d90 tx=0x7f331402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4363db6d94541f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7fa22d43d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa228155440 0x7fa22806d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34432/0 (socket says 172.21.15.8:34432) 2023-10-14T10:33:54.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7fa22d43d640 1 -- 172.21.15.8:0/3736434277 learned_addr learned my addr 172.21.15.8:0/3736434277 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:54.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7fa22e43f640 1 --2- 172.21.15.8:0/3736434277 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2280bfee0 0x7fa228152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7f33213fe640 1 -- 172.21.15.8:0/2815239572 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331402cb40 con 0x7f331c0bfee0 2023-10-14T10:33:54.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7f33213fe640 1 -- 172.21.15.8:0/2815239572 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331402cca0 con 0x7f331c0bfee0 2023-10-14T10:33:54.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7fa22cc3c640 1 -- 172.21.15.8:0/3736434277 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360223302 0 0) 0x7fa2280c57a0 con 0x7fa228155440 2023-10-14T10:33:54.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7f33213fe640 1 -- 172.21.15.8:0/2815239572 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314034640 con 0x7f331c0bfee0 2023-10-14T10:33:54.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7fe9d744b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9d006ab00 0x7fe9d01f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7fe9d744b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9d00a9170 0x7fe9d0148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7fe9d744b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9d00af820 0x7fe9d0157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7f7d23275640 1 Processor -- start 2023-10-14T10:33:54.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7fa22cc3c640 1 -- 172.21.15.8:0/3736434277 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa214003520 con 0x7fa228155440 2023-10-14T10:33:54.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.759+0000 7fa22dc3e640 1 --2- 172.21.15.8:0/3736434277 >> v2:172.21.15.8:3300/0 conn(0x7fa22814f3a0 0x7fa228071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7fe9d744b640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d01f2190 con 0x7fe9d00a9170 2023-10-14T10:33:54.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7fe9d744b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00c0be0 con 0x7fe9d00af820 2023-10-14T10:33:54.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7fe9d744b640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00c0e30 con 0x7fe9d006ab00 2023-10-14T10:33:54.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7fe9d51e7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9d006ab00 0x7fe9d01f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7f7d23275640 1 -- start start 2023-10-14T10:33:54.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7fe9d59e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9d00af820 0x7fe9d0157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7fc4d4ff9640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc4bc06ae70 0x7fc4bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7fe9d59e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9d00af820 0x7fe9d0157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:37446/0 (socket says 172.21.15.8:37446) 2023-10-14T10:33:54.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7fe9d59e8640 1 -- 172.21.15.8:0/2399986934 learned_addr learned my addr 172.21.15.8:0/2399986934 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7fc4d4ff9640 1 -- 172.21.15.8:0/4239560043 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4d81030b0 con 0x7fc4d00dbb40 2023-10-14T10:33:54.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7fa22dc3e640 1 -- 172.21.15.8:0/3736434277 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2280bfee0 msgr2=0x7fa228152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:54.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7fa22dc3e640 1 --2- 172.21.15.8:0/3736434277 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2280bfee0 0x7fa228152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7fa22dc3e640 1 -- 172.21.15.8:0/3736434277 >> v1:172.21.15.8:6789/0 conn(0x7fa228155440 legacy=0x7fa22806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.760+0000 7fa22dc3e640 1 -- 172.21.15.8:0/3736434277 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2280c59f0 con 0x7fa22814f3a0 2023-10-14T10:33:54.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7f3324664640 1 -- 172.21.15.8:0/2815239572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f331c0bfee0 msgr2=0x7f331c152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7f3324664640 1 --2- 172.21.15.8:0/2815239572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f331c0bfee0 0x7f331c152580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3314009d90 tx=0x7f331402bd90 comp rx=0 tx=0).stop 2023-10-14T10:33:54.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7fc4d4ff9640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] conn(0x7fc4bc073010 0x7fc4bc075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7f3324664640 1 -- 172.21.15.8:0/2815239572 shutdown_connections 2023-10-14T10:33:54.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7f3324664640 1 --2- 172.21.15.8:0/2815239572 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f331c0bfee0 0x7f331c152580 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7f3324664640 1 --2- 172.21.15.8:0/2815239572 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f331c14f3a0 0x7f331c071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7f3324664640 1 -- 172.21.15.8:0/2815239572 >> 172.21.15.8:0/2815239572 conn(0x7f331c0a74d0 msgr2=0x7f331c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7fc4d4ff9640 1 -- 172.21.15.8:0/4239560043 --> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4bc075ae0 con 0x7fc4bc073010 2023-10-14T10:33:54.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7fc4d4ff9640 1 -- 172.21.15.8:0/4239560043 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4d8103460 con 0x7fc4d00dbb40 2023-10-14T10:33:54.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7fe9d59e8640 1 -- 172.21.15.8:0/2399986934 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9d006ab00 msgr2=0x7fe9d01f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7fe9d59e8640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9d006ab00 0x7fe9d01f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7fe9d59e8640 1 -- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9d00a9170 msgr2=0x7fe9d0148030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T10:33:54.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7fe082ffd640 1 -- 172.21.15.8:0/3038239842 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe07c004b80 con 0x7fe08c1515c0 2023-10-14T10:33:54.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.761+0000 7fa22dc3e640 1 --2- 172.21.15.8:0/3736434277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa22814f3a0 0x7fa228071f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa2240097a0 tx=0x7fa22402b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb228587425a74e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.762+0000 7f3324664640 1 -- 172.21.15.8:0/2815239572 shutdown_connections 2023-10-14T10:33:54.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.762+0000 7fe9d49e6640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9d00a9170 0x7fe9d0148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.762+0000 7fe9d59e8640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9d00a9170 0x7fe9d0148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.762+0000 7f7d23275640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d1c06de90 0x7f7d1c1482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.762+0000 7fe9d59e8640 1 -- 172.21.15.8:0/2399986934 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c8009b30 con 0x7fe9d00af820 2023-10-14T10:33:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.762+0000 7f7d23275640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d1c06e270 0x7f7d1c14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.762+0000 7f7d23275640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d1c06fbf0 0x7f7d1c14c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7f7d22273640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d1c06de90 0x7f7d1c1482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7f7d22273640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d1c06de90 0x7f7d1c1482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:60880/0 (socket says 172.21.15.8:60880) 2023-10-14T10:33:54.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7fe9d59e8640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9d00af820 0x7fe9d0157330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000c550 tx=0x7fe9c000ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0a9880 con 0x7f7d1c06e270 2023-10-14T10:33:54.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c14b8b0 con 0x7f7d1c06fbf0 2023-10-14T10:33:54.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c0aa200 con 0x7f7d1c06de90 2023-10-14T10:33:54.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7fa22cc3c640 1 -- 172.21.15.8:0/3736434277 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218001670 con 0x7fa22814f3a0 2023-10-14T10:33:54.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7fa22cc3c640 1 -- 172.21.15.8:0/3736434277 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22402e050 con 0x7fa22814f3a0 2023-10-14T10:33:54.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7f7d21a72640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d1c06e270 0x7f7d1c14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7f7d22273640 1 -- 172.21.15.8:0/130282269 learned_addr learned my addr 172.21.15.8:0/130282269 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7fe9cdffb640 1 -- 172.21.15.8:0/2399986934 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0004220 con 0x7fe9d00af820 2023-10-14T10:33:54.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7fe9cdffb640 1 -- 172.21.15.8:0/2399986934 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c0004380 con 0x7fe9d00af820 2023-10-14T10:33:54.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7fe9cdffb640 1 -- 172.21.15.8:0/2399986934 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0003830 con 0x7fe9d00af820 2023-10-14T10:33:54.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7fe9d744b640 1 -- 172.21.15.8:0/2399986934 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d00c1110 con 0x7fe9d00af820 2023-10-14T10:33:54.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.762+0000 7fc4d7fff640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc4bc06ae70 0x7fc4bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7fc4dcfad640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] conn(0x7fc4bc073010 0x7fc4bc075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.764+0000 7fc4dcfad640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] conn(0x7fc4bc073010 0x7fc4bc075430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7fe082ffd640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe07006af40 0x7fe07006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7fe082ffd640 1 -- 172.21.15.8:0/3038239842 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe07c089300 con 0x7fe08c1515c0 2023-10-14T10:33:54.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.763+0000 7fe082ffd640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] conn(0x7fe070073160 0x7fe070075580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.762+0000 7f3324664640 1 -- 172.21.15.8:0/2815239572 wait complete. 2023-10-14T10:33:54.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.764+0000 7fe9d744b640 1 -- 172.21.15.8:0/2399986934 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d0156b30 con 0x7fe9d00af820 2023-10-14T10:33:54.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.764+0000 7f7d22a74640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d1c06fbf0 0x7f7d1c14c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.764+0000 7fa22cc3c640 1 -- 172.21.15.8:0/3736434277 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224030730 con 0x7fa22814f3a0 2023-10-14T10:33:54.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.764+0000 7fe092333640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe07006af40 0x7fe07006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.765+0000 7f3324664640 1 Processor -- start 2023-10-14T10:33:54.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.765+0000 7fc4d4ff9640 1 -- 172.21.15.8:0/4239560043 <== osd.0 v2:172.21.15.8:6809/2227649583 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc4bc075ae0 con 0x7fc4bc073010 2023-10-14T10:33:54.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.765+0000 7fa22fea2640 1 -- 172.21.15.8:0/3736434277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa22814f3a0 msgr2=0x7fa228071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.764+0000 7f7d21a72640 1 -- 172.21.15.8:0/130282269 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d1c06de90 msgr2=0x7f7d1c1482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.765+0000 7fe091b32640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] conn(0x7fe070073160 0x7fe070075580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.764+0000 7f7d21a72640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d1c06de90 0x7f7d1c1482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.764+0000 7f7d21a72640 1 -- 172.21.15.8:0/130282269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d1c06fbf0 msgr2=0x7f7d1c14c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.764+0000 7f7d21a72640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d1c06fbf0 0x7f7d1c14c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.764+0000 7f7d21a72640 1 -- 172.21.15.8:0/130282269 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d180094d0 con 0x7f7d1c06e270 2023-10-14T10:33:54.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.765+0000 7fa22fea2640 1 --2- 172.21.15.8:0/3736434277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa22814f3a0 0x7fa228071f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa2240097a0 tx=0x7fa22402b630 comp rx=0 tx=0).stop 2023-10-14T10:33:54.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.765+0000 7fe082ffd640 1 -- 172.21.15.8:0/3038239842 --> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe070075c30 con 0x7fe070073160 2023-10-14T10:33:54.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.765+0000 7fe9d744b640 1 -- 172.21.15.8:0/2399986934 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9d00c46a0 con 0x7fe9d00af820 2023-10-14T10:33:54.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.766+0000 7fa22fea2640 1 -- 172.21.15.8:0/3736434277 shutdown_connections 2023-10-14T10:33:54.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.766+0000 7fa22fea2640 1 --2- 172.21.15.8:0/3736434277 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2280bfee0 0x7fa228152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.766+0000 7fa22fea2640 1 --2- 172.21.15.8:0/3736434277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa22814f3a0 0x7fa228071f90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.766+0000 7fc69450f640 1 Processor -- start 2023-10-14T10:33:54.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.766+0000 7fa22fea2640 1 -- 172.21.15.8:0/3736434277 >> 172.21.15.8:0/3736434277 conn(0x7fa2280a74d0 msgr2=0x7fa2280a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.766+0000 7fa22fea2640 1 -- 172.21.15.8:0/3736434277 shutdown_connections 2023-10-14T10:33:54.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.766+0000 7fc4d7fff640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc4bc06ae70 0x7fc4bc06d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc037040 tx=0x7fc4cc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.766+0000 7fa22fea2640 1 -- 172.21.15.8:0/3736434277 wait complete. 2023-10-14T10:33:54.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.766+0000 7fc69450f640 1 -- start start 2023-10-14T10:33:54.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.766+0000 7f7d21a72640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d1c06e270 0x7f7d1c14bfe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7d18033000 tx=0x7f7d18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.766+0000 7fe092333640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe07006af40 0x7fe07006d400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe088009b30 tx=0x7fe088009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.767+0000 7fe082ffd640 1 -- 172.21.15.8:0/3038239842 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe07c0896b0 con 0x7fe08c1515c0 2023-10-14T10:33:54.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.767+0000 7f7d12ffd640 1 -- 172.21.15.8:0/130282269 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18037d10 con 0x7f7d1c06e270 2023-10-14T10:33:54.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.767+0000 7f747e8f2640 1 Processor -- start 2023-10-14T10:33:54.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.767+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1c0a92c0 con 0x7f7d1c06e270 2023-10-14T10:33:54.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.767+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1c14bac0 con 0x7f7d1c06e270 2023-10-14T10:33:54.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.768+0000 7fe091b32640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] conn(0x7fe070073160 0x7fe070075580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.768+0000 7f3324664640 1 -- start start 2023-10-14T10:33:54.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.768+0000 7fc69450f640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc68c1559f0 0x7fc68c0aa300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.768+0000 7fc69450f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc68c1591e0 0x7fc68c1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.768+0000 7fc69450f640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c0a8a40 con 0x7fc68c159f20 2023-10-14T10:33:54.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.768+0000 7fc69450f640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68c1584f0 con 0x7fc68c1559f0 2023-10-14T10:33:54.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.768+0000 7fc69450f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c158700 con 0x7fc68c1591e0 2023-10-14T10:33:54.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7fc692aac640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc68c159f20 0x7fc68c0c57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:56918/0 (socket says 172.21.15.8:56918) 2023-10-14T10:33:54.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7fc692aac640 1 -- 172.21.15.8:0/1422616874 learned_addr learned my addr 172.21.15.8:0/1422616874 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:54.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7fc6922ab640 1 --2- 172.21.15.8:0/1422616874 >> v2:172.21.15.92:3300/0 conn(0x7fc68c1559f0 0x7fc68c0aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7fc691aaa640 1 --2- 172.21.15.8:0/1422616874 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc68c1591e0 0x7fc68c1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7fc6912a9640 1 -- 172.21.15.8:0/1422616874 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177372506 0 0) 0x7fc68c0a8a40 con 0x7fc68c159f20 2023-10-14T10:33:54.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7fc6912a9640 1 -- 172.21.15.8:0/1422616874 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc678003520 con 0x7fc68c159f20 2023-10-14T10:33:54.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7fa22fea2640 1 Processor -- start 2023-10-14T10:33:54.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.767+0000 7f747e8f2640 1 -- start start 2023-10-14T10:33:54.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7f747e8f2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f74781559f0 0x7f74780aa300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7f747e8f2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74781591e0 0x7f74781599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7f747e8f2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7478159f20 0x7f74780c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7f747e8f2640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74781584f0 con 0x7f7478159f20 2023-10-14T10:33:54.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7f747e8f2640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74780a8a40 con 0x7f74781559f0 2023-10-14T10:33:54.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7f747e8f2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7478158700 con 0x7f74781591e0 2023-10-14T10:33:54.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7fc6922ab640 1 -- 172.21.15.8:0/1422616874 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc68c1591e0 msgr2=0x7fc68c1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:54.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7f3324664640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331c0bfee0 0x7f331c143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7f3324664640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f331c14f3a0 0x7f331c148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7fc6922ab640 1 --2- 172.21.15.8:0/1422616874 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc68c1591e0 0x7fc68c1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7fc6922ab640 1 -- 172.21.15.8:0/1422616874 >> v1:172.21.15.92:6789/0 conn(0x7fc68c159f20 legacy=0x7fc68c0c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7fc6922ab640 1 -- 172.21.15.8:0/1422616874 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c1589e0 con 0x7fc68c1559f0 2023-10-14T10:33:54.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7f3324664640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f331c155440 0x7f331c1e8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7f3324664640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c1e5f00 con 0x7f331c14f3a0 2023-10-14T10:33:54.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7f3324664640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c14b4d0 con 0x7f331c0bfee0 2023-10-14T10:33:54.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7f3324664640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c14aeb0 con 0x7f331c155440 2023-10-14T10:33:54.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.768+0000 7f7d12ffd640 1 -- 172.21.15.8:0/130282269 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d18037e70 con 0x7f7d1c06e270 2023-10-14T10:33:54.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.768+0000 7f7d12ffd640 1 -- 172.21.15.8:0/130282269 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18041620 con 0x7f7d1c06e270 2023-10-14T10:33:54.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.769+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d04000fc0 con 0x7f7d1c06e270 2023-10-14T10:33:54.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7f747ce8f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7478159f20 0x7f74780c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7fe9cdffb640 1 -- 172.21.15.8:0/2399986934 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe9c0003990 con 0x7fe9d00af820 2023-10-14T10:33:54.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7f747ce8f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7478159f20 0x7f74780c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46928/0 (socket says 172.21.15.8:46928) 2023-10-14T10:33:54.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7f747ce8f640 1 -- 172.21.15.8:0/2003986740 learned_addr learned my addr 172.21.15.8:0/2003986740 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7f74777fe640 1 --2- 172.21.15.8:0/2003986740 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74781591e0 0x7f74781599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7fc691aaa640 1 --2- 172.21.15.8:0/1422616874 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc68c1591e0 0x7fc68c1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:33:54.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.771+0000 7f3322c01640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f331c155440 0x7f331c1e8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7f7477fff640 1 --2- 172.21.15.8:0/2003986740 >> v2:172.21.15.92:3300/0 conn(0x7f74781559f0 0x7f74780aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.771+0000 7f3322c01640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f331c155440 0x7f331c1e8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:60908/0 (socket says 172.21.15.8:60908) 2023-10-14T10:33:54.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.771+0000 7f747ce8f640 1 -- 172.21.15.8:0/2003986740 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74781591e0 msgr2=0x7f74781599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:54.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.771+0000 7f747ce8f640 1 --2- 172.21.15.8:0/2003986740 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74781591e0 0x7f74781599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.771+0000 7f747ce8f640 1 -- 172.21.15.8:0/2003986740 >> v2:172.21.15.92:3300/0 conn(0x7f74781559f0 msgr2=0x7f74780aa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:54.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.771+0000 7f747ce8f640 1 --2- 172.21.15.8:0/2003986740 >> v2:172.21.15.92:3300/0 conn(0x7f74781559f0 0x7f74780aa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.771+0000 7f747ce8f640 1 -- 172.21.15.8:0/2003986740 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74781589e0 con 0x7f7478159f20 2023-10-14T10:33:54.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.770+0000 7fa22fea2640 1 -- start start 2023-10-14T10:33:54.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.771+0000 7f74777fe640 1 --2- 172.21.15.8:0/2003986740 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74781591e0 0x7f74781599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:54.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.771+0000 7f3322c01640 1 -- 172.21.15.8:0/4228645147 learned_addr learned my addr 172.21.15.8:0/4228645147 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.771+0000 7f3322400640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331c0bfee0 0x7f331c143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7f3322400640 1 -- 172.21.15.8:0/4228645147 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f331c155440 msgr2=0x7f331c1e8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7f3321bff640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f331c14f3a0 0x7f331c148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7f3322400640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f331c155440 0x7f331c1e8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7f3322400640 1 -- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f331c14f3a0 msgr2=0x7f331c148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7f3322400640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f331c14f3a0 0x7f331c148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7f3322400640 1 -- 172.21.15.8:0/4228645147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3314009a70 con 0x7f331c0bfee0 2023-10-14T10:33:54.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7fe082ffd640 1 -- 172.21.15.8:0/3038239842 <== osd.1 v2:172.21.15.8:6800/1766897298 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fe070075c30 con 0x7fe070073160 2023-10-14T10:33:54.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7f3321bff640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f331c14f3a0 0x7f331c148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:54.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.773+0000 7f3322400640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331c0bfee0 0x7f331c143200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f330c00d620 tx=0x7f330c00dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7fe9cdffb640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe9bc06af40 0x7fe9bc06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7fe9cdffb640 1 -- 172.21.15.8:0/2399986934 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9c00897b0 con 0x7fe9d00af820 2023-10-14T10:33:54.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7fe9cdffb640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] conn(0x7fe9bc073160 0x7fe9bc075580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7fe9cdffb640 1 -- 172.21.15.8:0/2399986934 --> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9bc075c30 con 0x7fe9bc073160 2023-10-14T10:33:54.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7fe9cdffb640 1 -- 172.21.15.8:0/2399986934 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9c0089b60 con 0x7fe9d00af820 2023-10-14T10:33:54.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7fa22fea2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2280bfee0 0x7fa228154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7fa22fea2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa22814f3a0 0x7fa2281f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7fa22fea2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa228155440 0x7fa228151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7fa22fea2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281548c0 con 0x7fa2280bfee0 2023-10-14T10:33:54.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7fa22fea2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281f0ee0 con 0x7fa22814f3a0 2023-10-14T10:33:54.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.772+0000 7fa22fea2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa228153530 con 0x7fa228155440 2023-10-14T10:33:54.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.773+0000 7fe9d51e7640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe9bc06af40 0x7fe9bc06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.773+0000 7fc6922ab640 1 --2- 172.21.15.8:0/1422616874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c1559f0 0x7fc68c0aa300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc688009d90 tx=0x7fc68802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78104b7a0b5702aa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.773+0000 7fa22dc3e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2280bfee0 0x7fa228154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.773+0000 7f747ce8f640 1 --2- 172.21.15.8:0/2003986740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7478159f20 0x7f74780c57a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f747806e120 tx=0x7f747002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3f01d8a82954d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.773+0000 7fa22d43d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa22814f3a0 0x7fa2281f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.773+0000 7fa22d43d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa22814f3a0 0x7fa2281f19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:37478/0 (socket says 172.21.15.8:37478) 2023-10-14T10:33:54.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.773+0000 7fa22d43d640 1 -- 172.21.15.8:0/905148233 learned_addr learned my addr 172.21.15.8:0/905148233 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.773+0000 7fe9d49e6640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] conn(0x7fe9bc073160 0x7fe9bc075580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.773+0000 7f3312ffd640 1 -- 172.21.15.8:0/4228645147 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00b620 con 0x7f331c0bfee0 2023-10-14T10:33:54.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.773+0000 7f3312ffd640 1 -- 172.21.15.8:0/4228645147 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c00b780 con 0x7f331c0bfee0 2023-10-14T10:33:54.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.773+0000 7f3312ffd640 1 -- 172.21.15.8:0/4228645147 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00bb10 con 0x7f331c0bfee0 2023-10-14T10:33:54.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7f3324664640 1 -- 172.21.15.8:0/4228645147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331c14a580 con 0x7f331c0bfee0 2023-10-14T10:33:54.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7fa22e43f640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa228155440 0x7fa228151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7fa22d43d640 1 -- 172.21.15.8:0/905148233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa228155440 msgr2=0x7fa228151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7fa22d43d640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa228155440 0x7fa228151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7fa22d43d640 1 -- 172.21.15.8:0/905148233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2280bfee0 msgr2=0x7fa228154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7fa22d43d640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2280bfee0 0x7fa228154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7fa22d43d640 1 -- 172.21.15.8:0/905148233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa224009400 con 0x7fa22814f3a0 2023-10-14T10:33:54.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7f3324664640 1 -- 172.21.15.8:0/4228645147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331c14ab40 con 0x7f331c0bfee0 2023-10-14T10:33:54.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7f7476ffd640 1 -- 172.21.15.8:0/2003986740 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747002c9f0 con 0x7f7478159f20 2023-10-14T10:33:54.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7f7476ffd640 1 -- 172.21.15.8:0/2003986740 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747002cb50 con 0x7f7478159f20 2023-10-14T10:33:54.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7f7476ffd640 1 -- 172.21.15.8:0/2003986740 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74700343f0 con 0x7f7478159f20 2023-10-14T10:33:54.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7fe9d51e7640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe9bc06af40 0x7fe9bc06d400 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8035000 tx=0x7fe9c8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.775+0000 7fe9d49e6640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] conn(0x7fe9bc073160 0x7fe9bc075580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7fc6912a9640 1 -- 172.21.15.8:0/1422616874 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68802cbc0 con 0x7fc68c1559f0 2023-10-14T10:33:54.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7fc6912a9640 1 -- 172.21.15.8:0/1422616874 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68802cd20 con 0x7fc68c1559f0 2023-10-14T10:33:54.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7fc6912a9640 1 -- 172.21.15.8:0/1422616874 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688034660 con 0x7fc68c1559f0 2023-10-14T10:33:54.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.775+0000 7fc69450f640 1 -- 172.21.15.8:0/1422616874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c1559f0 msgr2=0x7fc68c0aa300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.775+0000 7fc69450f640 1 --2- 172.21.15.8:0/1422616874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c1559f0 0x7fc68c0aa300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc688009d90 tx=0x7fc68802be10 comp rx=0 tx=0).stop 2023-10-14T10:33:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.776+0000 7fc69450f640 1 -- 172.21.15.8:0/1422616874 shutdown_connections 2023-10-14T10:33:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.776+0000 7fc69450f640 1 --2- 172.21.15.8:0/1422616874 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc68c1591e0 0x7fc68c1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.776+0000 7fc69450f640 1 --2- 172.21.15.8:0/1422616874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c1559f0 0x7fc68c0aa300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.776+0000 7fc69450f640 1 -- 172.21.15.8:0/1422616874 >> 172.21.15.8:0/1422616874 conn(0x7fc68c0a74d0 msgr2=0x7fc68c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.774+0000 7fa22d43d640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa22814f3a0 0x7fa2281f19a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa21800cac0 tx=0x7fa21800cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.775+0000 7fa21e7fc640 1 -- 172.21.15.8:0/905148233 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218005ce0 con 0x7fa22814f3a0 2023-10-14T10:33:54.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.775+0000 7fa21e7fc640 1 -- 172.21.15.8:0/905148233 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa218005e40 con 0x7fa22814f3a0 2023-10-14T10:33:54.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.776+0000 7fc69450f640 1 -- 172.21.15.8:0/1422616874 shutdown_connections 2023-10-14T10:33:54.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.775+0000 7fa22fea2640 1 -- 172.21.15.8:0/905148233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa228153810 con 0x7fa22814f3a0 2023-10-14T10:33:54.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.775+0000 7fa22fea2640 1 -- 172.21.15.8:0/905148233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2281f1480 con 0x7fa22814f3a0 2023-10-14T10:33:54.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.776+0000 7fa21e7fc640 1 -- 172.21.15.8:0/905148233 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180072b0 con 0x7fa22814f3a0 2023-10-14T10:33:54.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.776+0000 7f3324664640 1 -- 172.21.15.8:0/4228645147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f331c0c5fb0 con 0x7f331c0bfee0 2023-10-14T10:33:54.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.776+0000 7fc69450f640 1 -- 172.21.15.8:0/1422616874 wait complete. 2023-10-14T10:33:54.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.776+0000 7fe9cdffb640 1 -- 172.21.15.8:0/2399986934 <== osd.3 v2:172.21.15.8:6816/3324744175 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fe9bc075c30 con 0x7fe9bc073160 2023-10-14T10:33:54.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.776+0000 7f747e8f2640 1 -- 172.21.15.8:0/2003986740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7478159f20 msgr2=0x7f74780c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.776+0000 7f747e8f2640 1 --2- 172.21.15.8:0/2003986740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7478159f20 0x7f74780c57a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f747806e120 tx=0x7f747002be50 comp rx=0 tx=0).stop 2023-10-14T10:33:54.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.777+0000 7fa22fea2640 1 -- 172.21.15.8:0/905148233 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa2280c5fb0 con 0x7fa22814f3a0 2023-10-14T10:33:54.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.777+0000 7f747e8f2640 1 -- 172.21.15.8:0/2003986740 shutdown_connections 2023-10-14T10:33:54.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.777+0000 7f747e8f2640 1 --2- 172.21.15.8:0/2003986740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7478159f20 0x7f74780c57a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.777+0000 7f747e8f2640 1 --2- 172.21.15.8:0/2003986740 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74781591e0 0x7f74781599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.777+0000 7f747e8f2640 1 --2- 172.21.15.8:0/2003986740 >> v2:172.21.15.92:3300/0 conn(0x7f74781559f0 0x7f74780aa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.777+0000 7f747e8f2640 1 -- 172.21.15.8:0/2003986740 >> 172.21.15.8:0/2003986740 conn(0x7f74780a74d0 msgr2=0x7f74780a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.777+0000 7f747e8f2640 1 -- 172.21.15.8:0/2003986740 shutdown_connections 2023-10-14T10:33:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.777+0000 7f747e8f2640 1 -- 172.21.15.8:0/2003986740 wait complete. 2023-10-14T10:33:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.779+0000 7fc69450f640 1 Processor -- start 2023-10-14T10:33:54.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.778+0000 7f3312ffd640 1 -- 172.21.15.8:0/4228645147 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f330c00bc70 con 0x7f331c0bfee0 2023-10-14T10:33:54.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.779+0000 7fa21e7fc640 1 -- 172.21.15.8:0/905148233 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa218007410 con 0x7fa22814f3a0 2023-10-14T10:33:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.779+0000 7fc69450f640 1 -- start start 2023-10-14T10:33:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.777+0000 7f7d12ffd640 1 -- 172.21.15.8:0/130282269 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7d18041780 con 0x7f7d1c06e270 2023-10-14T10:33:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.779+0000 7f7d12ffd640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7d0006aea0 0x7f7d0006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.779+0000 7f7d12ffd640 1 -- 172.21.15.8:0/130282269 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d1803c070 con 0x7f7d1c06e270 2023-10-14T10:33:54.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.780+0000 7f7d12ffd640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] conn(0x7f7d000730c0 0x7f7d000754e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.780+0000 7f7d12ffd640 1 -- 172.21.15.8:0/130282269 --> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d00075b90 con 0x7f7d000730c0 2023-10-14T10:33:54.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.780+0000 7f7d12ffd640 1 -- 172.21.15.8:0/130282269 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d180acf20 con 0x7f7d1c06e270 2023-10-14T10:33:54.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.780+0000 7f7d22273640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7d0006aea0 0x7f7d0006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.780+0000 7f747e8f2640 1 Processor -- start 2023-10-14T10:33:54.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.780+0000 7f3312ffd640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f330006af40 0x7f330006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.780+0000 7f3312ffd640 1 -- 172.21.15.8:0/4228645147 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f330c089a20 con 0x7f331c0bfee0 2023-10-14T10:33:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.780+0000 7f747e8f2640 1 -- start start 2023-10-14T10:33:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7f3321bff640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f330006af40 0x7f330006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7f3312ffd640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] conn(0x7f3300073160 0x7f3300075580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7f3312ffd640 1 -- 172.21.15.8:0/4228645147 --> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3300075c30 con 0x7f3300073160 2023-10-14T10:33:54.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7f3312ffd640 1 -- 172.21.15.8:0/4228645147 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f330c08e2a0 con 0x7f331c0bfee0 2023-10-14T10:33:54.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7fa21e7fc640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa20c06ae70 0x7fa20c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7fa21e7fc640 1 -- 172.21.15.8:0/905148233 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2180899d0 con 0x7fa22814f3a0 2023-10-14T10:33:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7fa21e7fc640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] conn(0x7fa20c073010 0x7fa20c075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7fa21e7fc640 1 -- 172.21.15.8:0/905148233 --> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa20c075ae0 con 0x7fa20c073010 2023-10-14T10:33:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7fa21e7fc640 1 -- 172.21.15.8:0/905148233 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa218089d80 con 0x7fa22814f3a0 2023-10-14T10:33:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7fc69450f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc68c1559f0 0x7fc68c1f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7fc69450f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c1591e0 0x7fc68c0711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.782+0000 7fa22e43f640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] conn(0x7fa20c073010 0x7fa20c075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7fa22dc3e640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa20c06ae70 0x7fa20c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7f3322c01640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] conn(0x7f3300073160 0x7f3300075580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.782+0000 7f747e8f2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74781559f0 0x7f74781410a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.782+0000 7f747e8f2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74781591e0 0x7f747813f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.782+0000 7f747e8f2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7478159f20 0x7f7478146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7f747e8f2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7478141680 con 0x7f74781591e0 2023-10-14T10:33:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7f747e8f2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7478141960 con 0x7f74781559f0 2023-10-14T10:33:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7f747e8f2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747813e8a0 con 0x7f7478159f20 2023-10-14T10:33:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7fa22e43f640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] conn(0x7fa20c073010 0x7fa20c075430 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7f74777fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74781591e0 0x7f747813f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7f3321bff640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f330006af40 0x7f330006d400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f331c1e9550 tx=0x7f3318009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7f74777fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74781591e0 0x7f747813f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46974/0 (socket says 172.21.15.8:46974) 2023-10-14T10:33:54.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7f74777fe640 1 -- 172.21.15.8:0/3953654060 learned_addr learned my addr 172.21.15.8:0/3953654060 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7f7d22a74640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] conn(0x7f7d000730c0 0x7f7d000754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.782+0000 7f7d22273640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7d0006aea0 0x7f7d0006d360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0018b0 tx=0x7f7d0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.781+0000 7fc69450f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc68c159f20 0x7fc68c1535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.782+0000 7fc692aac640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc68c159f20 0x7fc68c1535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.784+0000 7f747ce8f640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7478159f20 0x7f7478146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.784+0000 7f7477fff640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74781559f0 0x7f74781410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.782+0000 7fc692aac640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc68c159f20 0x7fc68c1535f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46960/0 (socket says 172.21.15.8:46960) 2023-10-14T10:33:54.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.782+0000 7fc692aac640 1 -- 172.21.15.8:0/1322832331 learned_addr learned my addr 172.21.15.8:0/1322832331 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:54.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.782+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c154a40 con 0x7fc68c159f20 2023-10-14T10:33:54.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.782+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0c2a20 con 0x7fc68c1591e0 2023-10-14T10:33:54.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.782+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0c2d00 con 0x7fc68c1559f0 2023-10-14T10:33:54.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.782+0000 7fc691aaa640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c1591e0 0x7fc68c0711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7fc692aac640 1 -- 172.21.15.8:0/1322832331 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc68c1559f0 msgr2=0x7fc68c1f0d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T10:33:54.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7fc692aac640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc68c1559f0 0x7fc68c1f0d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7fc692aac640 1 -- 172.21.15.8:0/1322832331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c1591e0 msgr2=0x7fc68c0711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7fc692aac640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc68c1591e0 0x7fc68c0711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7fc692aac640 1 -- 172.21.15.8:0/1322832331 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c009400 con 0x7fc68c159f20 2023-10-14T10:33:54.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.783+0000 7fc692aac640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc68c159f20 0x7fc68c1535f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc68400c3e0 tx=0x7fc68400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.784+0000 7f74777fe640 1 -- 172.21.15.8:0/3953654060 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7478159f20 msgr2=0x7f7478146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.784+0000 7f74777fe640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7478159f20 0x7f7478146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.784+0000 7f74777fe640 1 -- 172.21.15.8:0/3953654060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74781559f0 msgr2=0x7f74781410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.784+0000 7f74777fe640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74781559f0 0x7f74781410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.784+0000 7f74777fe640 1 -- 172.21.15.8:0/3953654060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470009b30 con 0x7f74781591e0 2023-10-14T10:33:54.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.784+0000 7f7d22a74640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] conn(0x7f7d000730c0 0x7f7d000754e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.784+0000 7fc682ffd640 1 -- 172.21.15.8:0/1322832331 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684005ae0 con 0x7fc68c159f20 2023-10-14T10:33:54.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.784+0000 7fc682ffd640 1 -- 172.21.15.8:0/1322832331 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc684005c40 con 0x7fc68c159f20 2023-10-14T10:33:54.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.784+0000 7fc682ffd640 1 -- 172.21.15.8:0/1322832331 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6840070d0 con 0x7fc68c159f20 2023-10-14T10:33:54.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.784+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc688009a70 con 0x7fc68c159f20 2023-10-14T10:33:54.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.785+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c155040 con 0x7fc68c159f20 2023-10-14T10:33:54.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.785+0000 7f74777fe640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74781591e0 0x7f747813f380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f746c00d7d0 tx=0x7f746c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.786+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc68c158cc0 con 0x7fc68c159f20 2023-10-14T10:33:54.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.786+0000 7f7474ff9640 1 -- 172.21.15.8:0/3953654060 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0096a0 con 0x7f74781591e0 2023-10-14T10:33:54.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.786+0000 7f7474ff9640 1 -- 172.21.15.8:0/3953654060 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c009800 con 0x7f74781591e0 2023-10-14T10:33:54.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.786+0000 7f747e8f2640 1 -- 172.21.15.8:0/3953654060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74780aa9c0 con 0x7f74781591e0 2023-10-14T10:33:54.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.786+0000 7f7474ff9640 1 -- 172.21.15.8:0/3953654060 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0096a0 con 0x7f74781591e0 2023-10-14T10:33:54.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.786+0000 7f747e8f2640 1 -- 172.21.15.8:0/3953654060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747813ee60 con 0x7f74781591e0 2023-10-14T10:33:54.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.785+0000 7f3322c01640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] conn(0x7f3300073160 0x7f3300075580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.787+0000 7f7d12ffd640 1 -- 172.21.15.8:0/130282269 <== osd.4 v2:172.21.15.92:6800/90605776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f7d00075b90 con 0x7f7d000730c0 2023-10-14T10:33:54.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.787+0000 7fa21e7fc640 1 -- 172.21.15.8:0/905148233 <== osd.5 v2:172.21.15.92:6808/995873713 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa20c075ae0 con 0x7fa20c073010 2023-10-14T10:33:54.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.788+0000 7fa22dc3e640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa20c06ae70 0x7fa20c06d330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa224034000 tx=0x7fa224008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.787+0000 7f3312ffd640 1 -- 172.21.15.8:0/4228645147 <== osd.2 v2:172.21.15.8:6808/430494339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3300075c30 con 0x7f3300073160 2023-10-14T10:33:54.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.788+0000 7f747e8f2640 1 -- 172.21.15.8:0/3953654060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7458000fc0 con 0x7f74781591e0 2023-10-14T10:33:54.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.790+0000 7fc682ffd640 1 -- 172.21.15.8:0/1322832331 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc684007250 con 0x7fc68c159f20 2023-10-14T10:33:54.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.791+0000 7fc682ffd640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc67006aea0 0x7fc67006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.791+0000 7fc682ffd640 1 -- 172.21.15.8:0/1322832331 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc68409a460 con 0x7fc68c159f20 2023-10-14T10:33:54.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.792+0000 7fc682ffd640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] conn(0x7fc6700730c0 0x7fc6700754e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.792+0000 7fc682ffd640 1 -- 172.21.15.8:0/1322832331 --> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc670075b90 con 0x7fc6700730c0 2023-10-14T10:33:54.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.792+0000 7fc682ffd640 1 -- 172.21.15.8:0/1322832331 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc68409a810 con 0x7fc68c159f20 2023-10-14T10:33:54.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.790+0000 7f7474ff9640 1 -- 172.21.15.8:0/3953654060 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f746c009970 con 0x7f74781591e0 2023-10-14T10:33:54.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.792+0000 7f7474ff9640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f746406af00 0x7f746406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.792+0000 7f7474ff9640 1 -- 172.21.15.8:0/3953654060 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f746c0594a0 con 0x7f74781591e0 2023-10-14T10:33:54.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.792+0000 7f7474ff9640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] conn(0x7f74640730a0 0x7f74640754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:54.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.793+0000 7fc6922ab640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc67006aea0 0x7fc67006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.793+0000 7f7474ff9640 1 -- 172.21.15.8:0/3953654060 --> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7464075b70 con 0x7f74640730a0 2023-10-14T10:33:54.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.793+0000 7f7477fff640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f746406af00 0x7f746406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.793+0000 7f7474ff9640 1 -- 172.21.15.8:0/3953654060 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f746c0550e0 con 0x7f74781591e0 2023-10-14T10:33:54.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.794+0000 7f747ce8f640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] conn(0x7f74640730a0 0x7f74640754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.794+0000 7fc691aaa640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] conn(0x7fc6700730c0 0x7fc6700754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.794+0000 7fc6922ab640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc67006aea0 0x7fc67006d360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc688036000 tx=0x7fc688030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.795+0000 7f7477fff640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f746406af00 0x7f746406d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74680099b0 tx=0x7f7468008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.795+0000 7fc691aaa640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] conn(0x7fc6700730c0 0x7fc6700754e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.795+0000 7f747ce8f640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] conn(0x7f74640730a0 0x7f74640754c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:54.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.798+0000 7f7474ff9640 1 -- 172.21.15.8:0/3953654060 <== osd.7 v2:172.21.15.92:6824/3211925769 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f7464075b70 con 0x7f74640730a0 2023-10-14T10:33:54.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.798+0000 7fc682ffd640 1 -- 172.21.15.8:0/1322832331 <== osd.6 v2:172.21.15.92:6809/1491462275 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc670075b90 con 0x7fc6700730c0 2023-10-14T10:33:54.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.805+0000 7fe9d744b640 1 -- 172.21.15.8:0/2399986934 --> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe9d0154aa0 con 0x7fe9bc073160 2023-10-14T10:33:54.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.804+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/4239560043 --> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc4d00db1b0 con 0x7fc4bc073010 2023-10-14T10:33:54.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.805+0000 7fc4d4ff9640 1 -- 172.21.15.8:0/4239560043 <== osd.0 v2:172.21.15.8:6809/2227649583 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc4c4001340 con 0x7fc4bc073010 2023-10-14T10:33:54.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.806+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] conn(0x7fc4bc073010 msgr2=0x7fc4bc075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.806+0000 7fc4dd7ae640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] conn(0x7fc4bc073010 0x7fc4bc075430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.808+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc4bc06ae70 msgr2=0x7fc4bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.808+0000 7fc4dd7ae640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc4bc06ae70 0x7fc4bc06d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc037040 tx=0x7fc4cc030000 comp rx=0 tx=0).stop 2023-10-14T10:33:54.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.808+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4d00dbb40 msgr2=0x7fc4d0179d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.808+0000 7fc4dd7ae640 1 --2- 172.21.15.8:0/4239560043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4d00dbb40 0x7fc4d0179d60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80697d0 tx=0x7fc4d8072530 comp rx=0 tx=0).stop 2023-10-14T10:33:54.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.808+0000 7fc4dcfad640 1 -- 172.21.15.8:0/4239560043 reap_dead start 2023-10-14T10:33:54.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.808+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/4239560043 shutdown_connections 2023-10-14T10:33:54.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.808+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/4239560043 >> 172.21.15.8:0/4239560043 conn(0x7fc4d00061b0 msgr2=0x7fc4d00d80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.808+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/4239560043 shutdown_connections 2023-10-14T10:33:54.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.808+0000 7fc4dd7ae640 1 -- 172.21.15.8:0/4239560043 wait complete. 2023-10-14T10:33:54.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.809+0000 7fe094597640 1 -- 172.21.15.8:0/3038239842 --> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe074002cb0 con 0x7fe070073160 2023-10-14T10:33:54.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.809+0000 7fe9cdffb640 1 -- 172.21.15.8:0/2399986934 <== osd.3 v2:172.21.15.8:6816/3324744175 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe9c400a380 con 0x7fe9bc073160 2023-10-14T10:33:54.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.809+0000 7f3324664640 1 -- 172.21.15.8:0/4228645147 --> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f331c0c5cd0 con 0x7f3300073160 2023-10-14T10:33:54.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.811+0000 7f3312ffd640 1 -- 172.21.15.8:0/4228645147 <== osd.2 v2:172.21.15.8:6808/430494339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3300075c30 con 0x7f3300073160 2023-10-14T10:33:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.811+0000 7f3324664640 1 -- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] conn(0x7f3300073160 msgr2=0x7f3300075580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.811+0000 7f3324664640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] conn(0x7f3300073160 0x7f3300075580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.811+0000 7fe9d744b640 1 -- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] conn(0x7fe9bc073160 msgr2=0x7fe9bc075580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.811+0000 7fe9d744b640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] conn(0x7fe9bc073160 0x7fe9bc075580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.812+0000 7f3324664640 1 -- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f330006af40 msgr2=0x7f330006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.812+0000 7f3324664640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f330006af40 0x7f330006d400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f331c1e9550 tx=0x7f3318009040 comp rx=0 tx=0).stop 2023-10-14T10:33:54.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.812+0000 7f3324664640 1 -- 172.21.15.8:0/4228645147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331c0bfee0 msgr2=0x7f331c143200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.812+0000 7f3324664640 1 --2- 172.21.15.8:0/4228645147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f331c0bfee0 0x7f331c143200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f330c00d620 tx=0x7f330c00dae0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.812+0000 7f3322c01640 1 -- 172.21.15.8:0/4228645147 reap_dead start 2023-10-14T10:33:54.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.812+0000 7f3324664640 1 -- 172.21.15.8:0/4228645147 shutdown_connections 2023-10-14T10:33:54.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.812+0000 7f3324664640 1 -- 172.21.15.8:0/4228645147 >> 172.21.15.8:0/4228645147 conn(0x7f331c0a74d0 msgr2=0x7f331c0c04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.812+0000 7fe9d744b640 1 -- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe9bc06af40 msgr2=0x7fe9bc06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.812+0000 7fe9d744b640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe9bc06af40 0x7fe9bc06d400 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8035000 tx=0x7fe9c8030000 comp rx=0 tx=0).stop 2023-10-14T10:33:54.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.812+0000 7fe9d744b640 1 -- 172.21.15.8:0/2399986934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9d00af820 msgr2=0x7fe9d0157330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.812+0000 7fe9d744b640 1 --2- 172.21.15.8:0/2399986934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9d00af820 0x7fe9d0157330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000c550 tx=0x7fe9c000ca10 comp rx=0 tx=0).stop 2023-10-14T10:33:54.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.812+0000 7fe9d59e8640 1 -- 172.21.15.8:0/2399986934 reap_dead start 2023-10-14T10:33:54.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.813+0000 7fe9d744b640 1 -- 172.21.15.8:0/2399986934 shutdown_connections 2023-10-14T10:33:54.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.813+0000 7fe9d744b640 1 -- 172.21.15.8:0/2399986934 >> 172.21.15.8:0/2399986934 conn(0x7fe9d00ab600 msgr2=0x7fe9d0154070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.813+0000 7fe082ffd640 1 -- 172.21.15.8:0/3038239842 <== osd.1 v2:172.21.15.8:6800/1766897298 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe074002cb0 con 0x7fe070073160 2023-10-14T10:33:54.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.813+0000 7f3324664640 1 -- 172.21.15.8:0/4228645147 shutdown_connections 2023-10-14T10:33:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.813+0000 7f3324664640 1 -- 172.21.15.8:0/4228645147 wait complete. 2023-10-14T10:33:54.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.813+0000 7fe9d744b640 1 -- 172.21.15.8:0/2399986934 shutdown_connections 2023-10-14T10:33:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.813+0000 7fe9d744b640 1 -- 172.21.15.8:0/2399986934 wait complete. 2023-10-14T10:33:54.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.814+0000 7fe094597640 1 -- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] conn(0x7fe070073160 msgr2=0x7fe070075580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.814+0000 7fe094597640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] conn(0x7fe070073160 0x7fe070075580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.814+0000 7fe094597640 1 -- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe07006af40 msgr2=0x7fe07006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.814+0000 7fe094597640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe07006af40 0x7fe07006d400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe088009b30 tx=0x7fe088009240 comp rx=0 tx=0).stop 2023-10-14T10:33:54.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.814+0000 7fe094597640 1 -- 172.21.15.8:0/3038239842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe08c1515c0 msgr2=0x7fe08c1ece90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.814+0000 7fe094597640 1 --2- 172.21.15.8:0/3038239842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe08c1515c0 0x7fe08c1ece90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00c460 tx=0x7fe07c00c920 comp rx=0 tx=0).stop 2023-10-14T10:33:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.814+0000 7fe092b34640 1 -- 172.21.15.8:0/3038239842 reap_dead start 2023-10-14T10:33:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.814+0000 7fe094597640 1 -- 172.21.15.8:0/3038239842 shutdown_connections 2023-10-14T10:33:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.815+0000 7fe094597640 1 -- 172.21.15.8:0/3038239842 >> 172.21.15.8:0/3038239842 conn(0x7fe08c0c9730 msgr2=0x7fe08c1537a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.815+0000 7fe094597640 1 -- 172.21.15.8:0/3038239842 shutdown_connections 2023-10-14T10:33:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.815+0000 7fe094597640 1 -- 172.21.15.8:0/3038239842 wait complete. 2023-10-14T10:33:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.821+0000 7fa22fea2640 1 -- 172.21.15.8:0/905148233 --> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa2280c5cd0 con 0x7fa20c073010 2023-10-14T10:33:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.822+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 --> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7d04002cb0 con 0x7f7d000730c0 2023-10-14T10:33:54.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.822+0000 7fa21e7fc640 1 -- 172.21.15.8:0/905148233 <== osd.5 v2:172.21.15.92:6808/995873713 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa22000f040 con 0x7fa20c073010 2023-10-14T10:33:54.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.823+0000 7f7d12ffd640 1 -- 172.21.15.8:0/130282269 <== osd.4 v2:172.21.15.92:6800/90605776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7d04002cb0 con 0x7f7d000730c0 2023-10-14T10:33:54.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.823+0000 7fa22fea2640 1 -- 172.21.15.8:0/905148233 >> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] conn(0x7fa20c073010 msgr2=0x7fa20c075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.823+0000 7fa22fea2640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] conn(0x7fa20c073010 0x7fa20c075430 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.824+0000 7fa22fea2640 1 -- 172.21.15.8:0/905148233 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa20c06ae70 msgr2=0x7fa20c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.824+0000 7fa22fea2640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa20c06ae70 0x7fa20c06d330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa224034000 tx=0x7fa224008030 comp rx=0 tx=0).stop 2023-10-14T10:33:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.824+0000 7fa22fea2640 1 -- 172.21.15.8:0/905148233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa22814f3a0 msgr2=0x7fa2281f19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.824+0000 7fa22fea2640 1 --2- 172.21.15.8:0/905148233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa22814f3a0 0x7fa2281f19a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa21800cac0 tx=0x7fa21800cf80 comp rx=0 tx=0).stop 2023-10-14T10:33:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.824+0000 7fa22e43f640 1 -- 172.21.15.8:0/905148233 reap_dead start 2023-10-14T10:33:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.824+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 >> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] conn(0x7f7d000730c0 msgr2=0x7f7d000754e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.824+0000 7fa22fea2640 1 -- 172.21.15.8:0/905148233 shutdown_connections 2023-10-14T10:33:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.824+0000 7fa22fea2640 1 -- 172.21.15.8:0/905148233 >> 172.21.15.8:0/905148233 conn(0x7fa2280a74d0 msgr2=0x7fa22806d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.824+0000 7f7d23275640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] conn(0x7f7d000730c0 0x7f7d000754e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.824+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7d0006aea0 msgr2=0x7f7d0006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.825+0000 7f7d23275640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7d0006aea0 0x7f7d0006d360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0018b0 tx=0x7f7d0c009040 comp rx=0 tx=0).stop 2023-10-14T10:33:54.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.825+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d1c06e270 msgr2=0x7f7d1c14bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.825+0000 7f7d23275640 1 --2- 172.21.15.8:0/130282269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d1c06e270 0x7f7d1c14bfe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7d18033000 tx=0x7f7d18004730 comp rx=0 tx=0).stop 2023-10-14T10:33:54.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.825+0000 7f7d22a74640 1 -- 172.21.15.8:0/130282269 reap_dead start 2023-10-14T10:33:54.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.825+0000 7fa22fea2640 1 -- 172.21.15.8:0/905148233 shutdown_connections 2023-10-14T10:33:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.826+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 shutdown_connections 2023-10-14T10:33:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.826+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 >> 172.21.15.8:0/130282269 conn(0x7f7d1c0c5290 msgr2=0x7f7d1c0732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.826+0000 7fa22fea2640 1 -- 172.21.15.8:0/905148233 wait complete. 2023-10-14T10:33:54.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.826+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 shutdown_connections 2023-10-14T10:33:54.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.826+0000 7f7d23275640 1 -- 172.21.15.8:0/130282269 wait complete. 2023-10-14T10:33:54.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.828+0000 7f747e8f2640 1 -- 172.21.15.8:0/3953654060 --> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7458002cb0 con 0x7f74640730a0 2023-10-14T10:33:54.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.830+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 --> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc68c153310 con 0x7fc6700730c0 2023-10-14T10:33:54.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.830+0000 7f7474ff9640 1 -- 172.21.15.8:0/3953654060 <== osd.7 v2:172.21.15.92:6824/3211925769 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7458002cb0 con 0x7f74640730a0 2023-10-14T10:33:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.831+0000 7fc682ffd640 1 -- 172.21.15.8:0/1322832331 <== osd.6 v2:172.21.15.92:6809/1491462275 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc68c153310 con 0x7fc6700730c0 2023-10-14T10:33:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.831+0000 7f747e8f2640 1 -- 172.21.15.8:0/3953654060 >> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] conn(0x7f74640730a0 msgr2=0x7f74640754c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.831+0000 7f747e8f2640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] conn(0x7f74640730a0 0x7f74640754c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.831+0000 7f747e8f2640 1 -- 172.21.15.8:0/3953654060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f746406af00 msgr2=0x7f746406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.831+0000 7f747e8f2640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f746406af00 0x7f746406d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74680099b0 tx=0x7f7468008040 comp rx=0 tx=0).stop 2023-10-14T10:33:54.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.831+0000 7f747e8f2640 1 -- 172.21.15.8:0/3953654060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74781591e0 msgr2=0x7f747813f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.831+0000 7f747e8f2640 1 --2- 172.21.15.8:0/3953654060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74781591e0 0x7f747813f380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f746c00d7d0 tx=0x7f746c00dc90 comp rx=0 tx=0).stop 2023-10-14T10:33:54.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.832+0000 7f747ce8f640 1 -- 172.21.15.8:0/3953654060 reap_dead start 2023-10-14T10:33:54.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.832+0000 7f747e8f2640 1 -- 172.21.15.8:0/3953654060 shutdown_connections 2023-10-14T10:33:54.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.832+0000 7f747e8f2640 1 -- 172.21.15.8:0/3953654060 >> 172.21.15.8:0/3953654060 conn(0x7f74780a74d0 msgr2=0x7f7478153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.832+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 >> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] conn(0x7fc6700730c0 msgr2=0x7fc6700754e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.927 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-10-14T10:33:54.927 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T10:33:54.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.832+0000 7fc69450f640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] conn(0x7fc6700730c0 0x7fc6700754e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.833+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc67006aea0 msgr2=0x7fc67006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.833+0000 7f747e8f2640 1 -- 172.21.15.8:0/3953654060 shutdown_connections 2023-10-14T10:33:54.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.833+0000 7f747e8f2640 1 -- 172.21.15.8:0/3953654060 wait complete. 2023-10-14T10:33:54.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.833+0000 7fc69450f640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc67006aea0 0x7fc67006d360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc688036000 tx=0x7fc688030000 comp rx=0 tx=0).stop 2023-10-14T10:33:54.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.833+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc68c159f20 msgr2=0x7fc68c1535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:54.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.833+0000 7fc69450f640 1 --2- 172.21.15.8:0/1322832331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc68c159f20 0x7fc68c1535f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc68400c3e0 tx=0x7fc68400c8a0 comp rx=0 tx=0).stop 2023-10-14T10:33:54.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.833+0000 7fc692aac640 1 -- 172.21.15.8:0/1322832331 reap_dead start 2023-10-14T10:33:54.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.836+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 shutdown_connections 2023-10-14T10:33:54.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.836+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 >> 172.21.15.8:0/1322832331 conn(0x7fc68c0a74d0 msgr2=0x7fc68c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:54.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.836+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 shutdown_connections 2023-10-14T10:33:54.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:54.836+0000 7fc69450f640 1 -- 172.21.15.8:0/1322832331 wait complete. 2023-10-14T10:33:54.932 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-10-14T10:33:54.932 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T10:33:54.933 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-10-14T10:33:54.934 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T10:33:54.934 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-10-14T10:33:54.935 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T10:33:54.936 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-10-14T10:33:54.936 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T10:33:54.937 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-10-14T10:33:54.938 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T10:33:54.938 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-10-14T10:33:54.939 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T10:33:54.940 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-10-14T10:33:54.940 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T10:33:55.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.278+0000 7fa1f7183640 1 Processor -- start 2023-10-14T10:33:55.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.278+0000 7fa1f7183640 1 -- start start 2023-10-14T10:33:55.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.280+0000 7fa1f7183640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa1f00c5550 0x7fa1f0154a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.280+0000 7fa1f7183640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f01545f0 con 0x7fa1f01515c0 2023-10-14T10:33:55.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.280+0000 7fa1f7183640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f01519a0 con 0x7fa1f00c4f80 2023-10-14T10:33:55.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.280+0000 7fa1f7183640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f00c59e0 con 0x7fa1f00c5550 2023-10-14T10:33:55.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.280+0000 7fa1f5720640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa1f00c5550 0x7fa1f0154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.281+0000 7fa1f5720640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa1f00c5550 0x7fa1f0154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46976/0 (socket says 172.21.15.8:46976) 2023-10-14T10:33:55.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.281+0000 7fa1f5720640 1 -- 172.21.15.8:0/4201339749 learned_addr learned my addr 172.21.15.8:0/4201339749 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:55.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.281+0000 7fa1f4f1f640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa1f01515c0 0x7fa1f00c7630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34442/0 (socket says 172.21.15.8:34442) 2023-10-14T10:33:55.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.282+0000 7fa1f5720640 1 -- 172.21.15.8:0/4201339749 >> v1:172.21.15.92:6789/0 conn(0x7fa1f00c4f80 legacy=0x7fa1f006ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:55.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.282+0000 7fa1f5720640 1 -- 172.21.15.8:0/4201339749 >> v1:172.21.15.8:6789/0 conn(0x7fa1f01515c0 legacy=0x7fa1f00c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:55.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.282+0000 7fa1f5720640 1 -- 172.21.15.8:0/4201339749 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00c7d40 con 0x7fa1f00c5550 2023-10-14T10:33:55.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.283+0000 7fdf39c4f640 1 Processor -- start 2023-10-14T10:33:55.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.284+0000 7fa1f5720640 1 --2- 172.21.15.8:0/4201339749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f00c5550 0x7fa1f0154a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009e50 tx=0x7fa1e802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f94bfc49f235b1f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.285+0000 7fa1e77fe640 1 -- 172.21.15.8:0/4201339749 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e802ca80 con 0x7fa1f00c5550 2023-10-14T10:33:55.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.284+0000 7fdf39c4f640 1 -- start start 2023-10-14T10:33:55.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.285+0000 7fa1e77fe640 1 -- 172.21.15.8:0/4201339749 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e802cbe0 con 0x7fa1f00c5550 2023-10-14T10:33:55.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.285+0000 7fa1e77fe640 1 -- 172.21.15.8:0/4201339749 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80343f0 con 0x7fa1f00c5550 2023-10-14T10:33:55.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.286+0000 7fdf39c4f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdf341561b0 0x7fdf34155560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.286+0000 7fdf39c4f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdf34152880 0x7fdf340a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.286+0000 7fdf39c4f640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdf34152d00 0x7fdf340c2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.286+0000 7fdf39c4f640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf341523f0 con 0x7fdf341561b0 2023-10-14T10:33:55.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.286+0000 7fdf39c4f640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3413ade0 con 0x7fdf34152d00 2023-10-14T10:33:55.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.286+0000 7fdf39c4f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3413b0c0 con 0x7fdf34152880 2023-10-14T10:33:55.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.286+0000 7fa1f7183640 1 -- 172.21.15.8:0/4201339749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f00c5550 msgr2=0x7fa1f0154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.286+0000 7fa1f7183640 1 --2- 172.21.15.8:0/4201339749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f00c5550 0x7fa1f0154a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009e50 tx=0x7fa1e802bee0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.287+0000 7fdf337fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdf341561b0 0x7fdf34155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.287+0000 7fdf337fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdf341561b0 0x7fdf34155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46986/0 (socket says 172.21.15.8:46986) 2023-10-14T10:33:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.287+0000 7fdf337fe640 1 -- 172.21.15.8:0/3526210259 learned_addr learned my addr 172.21.15.8:0/3526210259 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.287+0000 7fdf32ffd640 1 --2- 172.21.15.8:0/3526210259 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdf34152880 0x7fdf340a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.287+0000 7fdf33fff640 1 --2- 172.21.15.8:0/3526210259 >> v2:172.21.15.92:3300/0 conn(0x7fdf34152d00 0x7fdf340c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.287+0000 7fa1f7183640 1 -- 172.21.15.8:0/4201339749 shutdown_connections 2023-10-14T10:33:55.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.287+0000 7fa1f7183640 1 --2- 172.21.15.8:0/4201339749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f00c5550 0x7fa1f0154a80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.287+0000 7fa1f7183640 1 -- 172.21.15.8:0/4201339749 >> 172.21.15.8:0/4201339749 conn(0x7fa1f00c9730 msgr2=0x7fa1f00c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.288+0000 7fdf33fff640 1 -- 172.21.15.8:0/3526210259 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdf34152880 msgr2=0x7fdf340a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:55.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.288+0000 7fdf33fff640 1 --2- 172.21.15.8:0/3526210259 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdf34152880 0x7fdf340a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.288+0000 7fdf33fff640 1 -- 172.21.15.8:0/3526210259 >> v2:172.21.15.8:3300/0 conn(0x7fdf341561b0 msgr2=0x7fdf34155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.288+0000 7fdf33fff640 1 --2- 172.21.15.8:0/3526210259 >> v2:172.21.15.8:3300/0 conn(0x7fdf341561b0 0x7fdf34155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.288+0000 7fdf33fff640 1 -- 172.21.15.8:0/3526210259 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3413b3a0 con 0x7fdf34152d00 2023-10-14T10:33:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.288+0000 7fdf337fe640 1 --2- 172.21.15.8:0/3526210259 >> v2:172.21.15.8:3300/0 conn(0x7fdf341561b0 0x7fdf34155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:33:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.289+0000 7fa1f7183640 1 -- 172.21.15.8:0/4201339749 shutdown_connections 2023-10-14T10:33:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.289+0000 7fdf33fff640 1 --2- 172.21.15.8:0/3526210259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf34152d00 0x7fdf340c2170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdf340a9bc0 tx=0x7fdf2c02bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b8499894ee722b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.290+0000 7fdf327fc640 1 -- 172.21.15.8:0/3526210259 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c02cb50 con 0x7fdf34152d00 2023-10-14T10:33:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.291+0000 7fdf327fc640 1 -- 172.21.15.8:0/3526210259 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c02ccb0 con 0x7fdf34152d00 2023-10-14T10:33:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.291+0000 7fdf327fc640 1 -- 172.21.15.8:0/3526210259 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c034660 con 0x7fdf34152d00 2023-10-14T10:33:55.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.289+0000 7fa1f7183640 1 -- 172.21.15.8:0/4201339749 wait complete. 2023-10-14T10:33:55.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.291+0000 7fa1f7183640 1 Processor -- start 2023-10-14T10:33:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.292+0000 7fdf39c4f640 1 -- 172.21.15.8:0/3526210259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf34152d00 msgr2=0x7fdf340c2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.292+0000 7fdf39c4f640 1 --2- 172.21.15.8:0/3526210259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf34152d00 0x7fdf340c2170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdf340a9bc0 tx=0x7fdf2c02bda0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.292+0000 7efe7d4ad640 1 Processor -- start 2023-10-14T10:33:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.292+0000 7fa1f7183640 1 -- start start 2023-10-14T10:33:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.293+0000 7fa1f7183640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1f00c4f80 0x7fa1f0153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.293+0000 7fa1f7183640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f00c5550 0x7fa1f00aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.293+0000 7fa1f7183640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f01515c0 0x7fa1f0146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.293+0000 7fa1f7183640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0157e70 con 0x7fa1f01515c0 2023-10-14T10:33:55.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.293+0000 7fa1f7183640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0157260 con 0x7fa1f00c5550 2023-10-14T10:33:55.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.293+0000 7fa1f7183640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0157540 con 0x7fa1f00c4f80 2023-10-14T10:33:55.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.294+0000 7fdf39c4f640 1 -- 172.21.15.8:0/3526210259 shutdown_connections 2023-10-14T10:33:55.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.294+0000 7fdf39c4f640 1 --2- 172.21.15.8:0/3526210259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf34152d00 0x7fdf340c2170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.293+0000 7efe7d4ad640 1 -- start start 2023-10-14T10:33:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.294+0000 7fdf39c4f640 1 --2- 172.21.15.8:0/3526210259 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdf34152880 0x7fdf340a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.294+0000 7fdf39c4f640 1 --2- 172.21.15.8:0/3526210259 >> v2:172.21.15.8:3300/0 conn(0x7fdf341561b0 0x7fdf34155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.294+0000 7fdf39c4f640 1 -- 172.21.15.8:0/3526210259 >> 172.21.15.8:0/3526210259 conn(0x7fdf3406a200 msgr2=0x7fdf3406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.294+0000 7fa1f4f1f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1f00c4f80 0x7fa1f0153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.294+0000 7fa1f4f1f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1f00c4f80 0x7fa1f0153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:60954/0 (socket says 172.21.15.8:60954) 2023-10-14T10:33:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.294+0000 7fa1f4f1f640 1 -- 172.21.15.8:0/3445121846 learned_addr learned my addr 172.21.15.8:0/3445121846 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:55.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.294+0000 7fa1f5720640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f01515c0 0x7fa1f0146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.294+0000 7fa1e7fff640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f00c5550 0x7fa1f00aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7efe7d4ad640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efe78155a80 0x7efe780719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7fa1f4f1f640 1 -- 172.21.15.8:0/3445121846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f00c5550 msgr2=0x7fa1f00aa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7fa1f4f1f640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f00c5550 0x7fa1f00aa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7efe7d4ad640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7efe7815b940 0x7efe7815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7efe7d4ad640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe78072060 con 0x7efe780ba3e0 2023-10-14T10:33:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7fccac9e2640 1 Processor -- start 2023-10-14T10:33:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7fa1f4f1f640 1 -- 172.21.15.8:0/3445121846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f01515c0 msgr2=0x7fa1f0146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7fa1f4f1f640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f01515c0 0x7fa1f0146ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7fa1f4f1f640 1 -- 172.21.15.8:0/3445121846 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8009b30 con 0x7fa1f00c4f80 2023-10-14T10:33:55.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7fdf39c4f640 1 -- 172.21.15.8:0/3526210259 shutdown_connections 2023-10-14T10:33:55.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7fccac9e2640 1 -- start start 2023-10-14T10:33:55.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7fa1f5720640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f01515c0 0x7fa1f0146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7efe7d4ad640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe781584f0 con 0x7efe78155a80 2023-10-14T10:33:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.295+0000 7efe7d4ad640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe78159270 con 0x7efe7815b940 2023-10-14T10:33:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.296+0000 7efe777fe640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7efe780ba3e0 0x7efe780c2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:56942/0 (socket says 172.21.15.8:56942) 2023-10-14T10:33:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.296+0000 7efe777fe640 1 -- 172.21.15.8:0/3989462953 learned_addr learned my addr 172.21.15.8:0/3989462953 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.296+0000 7f46b4905640 1 Processor -- start 2023-10-14T10:33:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.296+0000 7fa1f4f1f640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1f00c4f80 0x7fa1f0153bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000c450 tx=0x7fa1e000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.296+0000 7efe7ccac640 1 --2- 172.21.15.8:0/3989462953 >> v2:172.21.15.92:3300/0 conn(0x7efe7815b940 0x7efe7815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.296+0000 7fa1e57fa640 1 -- 172.21.15.8:0/3445121846 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0007480 con 0x7fa1f00c4f80 2023-10-14T10:33:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.296+0000 7efe77fff640 1 --2- 172.21.15.8:0/3989462953 >> v2:172.21.15.8:3300/0 conn(0x7efe78155a80 0x7efe780719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.296+0000 7efe76ffd640 1 -- 172.21.15.8:0/3989462953 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198000319 0 0) 0x7efe78072060 con 0x7efe780ba3e0 2023-10-14T10:33:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.297+0000 7efe76ffd640 1 -- 172.21.15.8:0/3989462953 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe60003520 con 0x7efe780ba3e0 2023-10-14T10:33:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.297+0000 7fa1f7183640 1 -- 172.21.15.8:0/3445121846 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f0157820 con 0x7fa1f00c4f80 2023-10-14T10:33:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.296+0000 7fdf39c4f640 1 -- 172.21.15.8:0/3526210259 wait complete. 2023-10-14T10:33:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.297+0000 7efe7ccac640 1 -- 172.21.15.8:0/3989462953 >> v2:172.21.15.8:3300/0 conn(0x7efe78155a80 msgr2=0x7efe780719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:55.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.296+0000 7f46b4905640 1 -- start start 2023-10-14T10:33:55.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.297+0000 7efe7ccac640 1 --2- 172.21.15.8:0/3989462953 >> v2:172.21.15.8:3300/0 conn(0x7efe78155a80 0x7efe780719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.297+0000 7efe7ccac640 1 -- 172.21.15.8:0/3989462953 >> v1:172.21.15.92:6789/0 conn(0x7efe780ba3e0 legacy=0x7efe780c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.297+0000 7efe7ccac640 1 -- 172.21.15.8:0/3989462953 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78158790 con 0x7efe7815b940 2023-10-14T10:33:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.298+0000 7efe77fff640 1 --2- 172.21.15.8:0/3989462953 >> v2:172.21.15.8:3300/0 conn(0x7efe78155a80 0x7efe780719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.298+0000 7f46b4905640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f46b01517a0 0x7f46b0154b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.298+0000 7f46b4905640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b00c5a70 con 0x7f46b00c54b0 2023-10-14T10:33:55.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.298+0000 7f46b4905640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b01540a0 con 0x7f46b00c4de0 2023-10-14T10:33:55.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.298+0000 7f46b4905640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b0151b80 con 0x7f46b01517a0 2023-10-14T10:33:55.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.297+0000 7fa1f7183640 1 -- 172.21.15.8:0/3445121846 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f00aab20 con 0x7fa1f00c4f80 2023-10-14T10:33:55.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.297+0000 7fa1e57fa640 1 -- 172.21.15.8:0/3445121846 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e00075e0 con 0x7fa1f00c4f80 2023-10-14T10:33:55.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.297+0000 7fa1e57fa640 1 -- 172.21.15.8:0/3445121846 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0005a50 con 0x7fa1f00c4f80 2023-10-14T10:33:55.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.299+0000 7f46add9b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f46b00c4de0 0x7f46b00c77a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:56956/0 (socket says 172.21.15.8:56956) 2023-10-14T10:33:55.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.299+0000 7f46add9b640 1 -- 172.21.15.8:0/3109785867 learned_addr learned my addr 172.21.15.8:0/3109785867 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:55.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.299+0000 7fdf39c4f640 1 Processor -- start 2023-10-14T10:33:55.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.299+0000 7efe7ccac640 1 --2- 172.21.15.8:0/3989462953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe7815b940 0x7efe7815bd80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe780c1cb0 tx=0x7efe6c02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2572e89b203f3784 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.299+0000 7fccac9e2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcca80c54b0 0x7fcca8154b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.299+0000 7fccac9e2640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca80c5a70 con 0x7fcca80c4de0 2023-10-14T10:33:55.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.300+0000 7fccac9e2640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca81540a0 con 0x7fcca81517a0 2023-10-14T10:33:55.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.300+0000 7fccac9e2640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca8151b80 con 0x7fcca80c54b0 2023-10-14T10:33:55.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.300+0000 7fcca5d9b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fcca80c4de0 0x7fcca80c43b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34462/0 (socket says 172.21.15.8:34462) 2023-10-14T10:33:55.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.300+0000 7fcca5d9b640 1 -- 172.21.15.8:0/2984765655 learned_addr learned my addr 172.21.15.8:0/2984765655 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:55.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.300+0000 7f46ae59c640 1 --2- 172.21.15.8:0/3109785867 >> v2:172.21.15.8:3300/0 conn(0x7f46b01517a0 0x7f46b0154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.300+0000 7efe76ffd640 1 -- 172.21.15.8:0/3989462953 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0317e0 con 0x7efe7815b940 2023-10-14T10:33:55.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.299+0000 7fdf39c4f640 1 -- start start 2023-10-14T10:33:55.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fdf39c4f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdf34152880 0x7fdf34154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fdf39c4f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf34152d00 0x7fdf340be560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fdf39c4f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf341561b0 0x7fdf340beaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fdf39c4f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf34138b70 con 0x7fdf341561b0 2023-10-14T10:33:55.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fdf39c4f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf341390a0 con 0x7fdf34152d00 2023-10-14T10:33:55.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fdf39c4f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf34139380 con 0x7fdf34152880 2023-10-14T10:33:55.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7efe76ffd640 1 -- 172.21.15.8:0/3989462953 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c031940 con 0x7efe7815b940 2023-10-14T10:33:55.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7efe76ffd640 1 -- 172.21.15.8:0/3989462953 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c031d10 con 0x7efe7815b940 2023-10-14T10:33:55.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7f46ae59c640 1 -- 172.21.15.8:0/3109785867 >> v1:172.21.15.92:6789/0 conn(0x7f46b00c4de0 legacy=0x7f46b00c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7f46ae59c640 1 -- 172.21.15.8:0/3109785867 >> v1:172.21.15.8:6789/0 conn(0x7f46b00c54b0 legacy=0x7f46b00c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fdf337fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdf34152880 0x7fdf34154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fdf337fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdf34152880 0x7fdf34154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:60958/0 (socket says 172.21.15.8:60958) 2023-10-14T10:33:55.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fa1f7183640 1 -- 172.21.15.8:0/3445121846 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d0005250 con 0x7fa1f00c4f80 2023-10-14T10:33:55.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fdf337fe640 1 -- 172.21.15.8:0/3366111945 learned_addr learned my addr 172.21.15.8:0/3366111945 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:55.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fcca6d9d640 1 --2- 172.21.15.8:0/2984765655 >> v2:172.21.15.92:3300/0 conn(0x7fcca80c54b0 0x7fcca8154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272804555 0 0) 0x7fcca81540a0 con 0x7fcca81517a0 2023-10-14T10:33:55.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc90003520 con 0x7fcca81517a0 2023-10-14T10:33:55.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7fdf32ffd640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf34152d00 0x7fdf340be560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7efe7d4ad640 1 -- 172.21.15.8:0/3989462953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe7815b940 msgr2=0x7efe7815bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7efe7d4ad640 1 --2- 172.21.15.8:0/3989462953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe7815b940 0x7efe7815bd80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe780c1cb0 tx=0x7efe6c02b880 comp rx=0 tx=0).stop 2023-10-14T10:33:55.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7fdf33fff640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf341561b0 0x7fdf340beaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7efe7d4ad640 1 -- 172.21.15.8:0/3989462953 shutdown_connections 2023-10-14T10:33:55.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7efe7d4ad640 1 --2- 172.21.15.8:0/3989462953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe7815b940 0x7efe7815bd80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7efe7d4ad640 1 --2- 172.21.15.8:0/3989462953 >> v2:172.21.15.8:3300/0 conn(0x7efe78155a80 0x7efe780719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 <== mon.1 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4097055488 0 0) 0x7fcc90003520 con 0x7fcca81517a0 2023-10-14T10:33:55.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 >> v2:172.21.15.92:3300/0 conn(0x7fcca80c54b0 msgr2=0x7fcca8154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:55.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7fcca559a640 1 --2- 172.21.15.8:0/2984765655 >> v2:172.21.15.92:3300/0 conn(0x7fcca80c54b0 0x7fcca8154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 >> v1:172.21.15.8:6789/0 conn(0x7fcca80c4de0 legacy=0x7fcca80c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:55.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7efe7d4ad640 1 -- 172.21.15.8:0/3989462953 >> 172.21.15.8:0/3989462953 conn(0x7efe7806a200 msgr2=0x7efe7806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7fa1e57fa640 1 -- 172.21.15.8:0/3445121846 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa1e0005bb0 con 0x7fa1f00c4f80 2023-10-14T10:33:55.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7fdf337fe640 1 -- 172.21.15.8:0/3366111945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf34152d00 msgr2=0x7fdf340be560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7fdf337fe640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf34152d00 0x7fdf340be560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7fdf337fe640 1 -- 172.21.15.8:0/3366111945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf341561b0 msgr2=0x7fdf340beaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7fdf337fe640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf341561b0 0x7fdf340beaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.302+0000 7fdf337fe640 1 -- 172.21.15.8:0/3366111945 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf240094d0 con 0x7fdf34152880 2023-10-14T10:33:55.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.303+0000 7fdf337fe640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdf34152880 0x7fdf34154a20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400e9b0 tx=0x7fdf2400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.303+0000 7efe7d4ad640 1 -- 172.21.15.8:0/3989462953 shutdown_connections 2023-10-14T10:33:55.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.303+0000 7efe7d4ad640 1 -- 172.21.15.8:0/3989462953 wait complete. 2023-10-14T10:33:55.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.301+0000 7f46ae59c640 1 -- 172.21.15.8:0/3109785867 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b00c5ce0 con 0x7f46b01517a0 2023-10-14T10:33:55.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.303+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80c5ce0 con 0x7fcca81517a0 2023-10-14T10:33:55.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.303+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 <== mon.1 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fcca00019f0 con 0x7fcca81517a0 2023-10-14T10:33:55.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.303+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 >> v1:172.21.15.92:6789/0 conn(0x7fcca81517a0 legacy=0x7fcca80c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.303+0000 7fcca559a640 1 --2- 172.21.15.8:0/2984765655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc90003970 0x7fcc90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.303+0000 7fcca559a640 1 --2- 172.21.15.8:0/2984765655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc900047c0 0x7fcc90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.303+0000 7fcca559a640 1 --2- 172.21.15.8:0/2984765655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc900052a0 0x7fcc9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.304+0000 7f46ae59c640 1 --2- 172.21.15.8:0/3109785867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46b01517a0 0x7f46b0154b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46a00097a0 tx=0x7f46a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6efa671e3727e2c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.303+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca8151b80 con 0x7fcc900047c0 2023-10-14T10:33:55.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.303+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9000c1a0 con 0x7fcc900052a0 2023-10-14T10:33:55.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.303+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9000c360 con 0x7fcc90003970 2023-10-14T10:33:55.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.304+0000 7fcca5d9b640 1 --2- 172.21.15.8:0/2984765655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc900047c0 0x7fcc90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.304+0000 7fcca6d9d640 1 --2- 172.21.15.8:0/2984765655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc900052a0 0x7fcc9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.304+0000 7fcca659c640 1 --2- 172.21.15.8:0/2984765655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc90003970 0x7fcc90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.304+0000 7fa1e57fa640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa1dc06ae70 0x7fa1dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.304+0000 7fa1e57fa640 1 -- 172.21.15.8:0/3445121846 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1e0088b30 con 0x7fa1f00c4f80 2023-10-14T10:33:55.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.305+0000 7fcca5d9b640 1 -- 172.21.15.8:0/2984765655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc90003970 msgr2=0x7fcc90003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:55.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.305+0000 7f88edab4640 1 Processor -- start 2023-10-14T10:33:55.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.305+0000 7f46ad59a640 1 -- 172.21.15.8:0/3109785867 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0031830 con 0x7f46b01517a0 2023-10-14T10:33:55.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.305+0000 7f46ad59a640 1 -- 172.21.15.8:0/3109785867 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a0031990 con 0x7f46b01517a0 2023-10-14T10:33:55.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.305+0000 7f46ad59a640 1 -- 172.21.15.8:0/3109785867 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0031d20 con 0x7f46b01517a0 2023-10-14T10:33:55.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.305+0000 7fcca5d9b640 1 --2- 172.21.15.8:0/2984765655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc90003970 0x7fcc90003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.305+0000 7fcca5d9b640 1 -- 172.21.15.8:0/2984765655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc900052a0 msgr2=0x7fcc9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:55.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.305+0000 7f88edab4640 1 -- start start 2023-10-14T10:33:55.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.305+0000 7fcca5d9b640 1 --2- 172.21.15.8:0/2984765655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc900052a0 0x7fcc9000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.305+0000 7fcca5d9b640 1 -- 172.21.15.8:0/2984765655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80c5ce0 con 0x7fcc900047c0 2023-10-14T10:33:55.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.305+0000 7fcca6d9d640 1 -- 172.21.15.8:0/2984765655 reap_dead start 2023-10-14T10:33:55.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.306+0000 7efe7d4ad640 1 Processor -- start 2023-10-14T10:33:55.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.305+0000 7fa1e7fff640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa1dc06ae70 0x7fa1dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.306+0000 7efe7d4ad640 1 -- start start 2023-10-14T10:33:55.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.306+0000 7f46b4905640 1 -- 172.21.15.8:0/3109785867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46b01517a0 msgr2=0x7f46b0154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.306+0000 7f46b4905640 1 --2- 172.21.15.8:0/3109785867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46b01517a0 0x7f46b0154b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46a00097a0 tx=0x7f46a002b8d0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.306+0000 7f045227e640 1 Processor -- start 2023-10-14T10:33:55.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.306+0000 7f045227e640 1 -- start start 2023-10-14T10:33:55.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7fa1e7fff640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa1dc06ae70 0x7fa1dc06d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00bfad0 tx=0x7fa1ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7f46b4905640 1 -- 172.21.15.8:0/3109785867 shutdown_connections 2023-10-14T10:33:55.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7f46b4905640 1 --2- 172.21.15.8:0/3109785867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46b01517a0 0x7f46b0154b60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7f88edab4640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f88e814e0f0 0x7f88e80719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7f88edab4640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 0x7f88e80c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7f88edab4640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e8154060 con 0x7f88e80c2670 2023-10-14T10:33:55.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7f88edab4640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e814e4d0 con 0x7f88e814e0f0 2023-10-14T10:33:55.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7f88edab4640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e8154ce0 con 0x7f88e80ba150 2023-10-14T10:33:55.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7f46b4905640 1 -- 172.21.15.8:0/3109785867 >> 172.21.15.8:0/3109785867 conn(0x7f46b00c98a0 msgr2=0x7f46b00c9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7fcca5d9b640 1 --2- 172.21.15.8:0/2984765655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc900047c0 0x7fcc90004c40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcc98001810 tx=0x7fcc900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200ccd1dd0aa0733 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7f46b4905640 1 -- 172.21.15.8:0/3109785867 shutdown_connections 2023-10-14T10:33:55.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7f46b4905640 1 -- 172.21.15.8:0/3109785867 wait complete. 2023-10-14T10:33:55.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98004aa0 con 0x7fcc900047c0 2023-10-14T10:33:55.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9802e070 con 0x7fcc900047c0 2023-10-14T10:33:55.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7fcca559a640 1 -- 172.21.15.8:0/2984765655 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98004e00 con 0x7fcc900047c0 2023-10-14T10:33:55.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7f88ed2b3640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f88e80c2670 0x7f88e8157640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34478/0 (socket says 172.21.15.8:34478) 2023-10-14T10:33:55.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7f88ed2b3640 1 -- 172.21.15.8:0/237285938 learned_addr learned my addr 172.21.15.8:0/237285938 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:55.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7f88e7fff640 1 --2- 172.21.15.8:0/237285938 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 0x7f88e80c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7efe7d4ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe780ba3e0 0x7efe781507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7efe7d4ad640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efe78155a80 0x7efe781f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.307+0000 7efe7d4ad640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe7815b940 0x7efe781f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7efe7d4ad640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7814c310 con 0x7efe7815b940 2023-10-14T10:33:55.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7efe7d4ad640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7814e620 con 0x7efe780ba3e0 2023-10-14T10:33:55.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7efe7d4ad640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7814daa0 con 0x7efe78155a80 2023-10-14T10:33:55.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7efe7ccac640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe7815b940 0x7efe781f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7efe7ccac640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe7815b940 0x7efe781f1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47052/0 (socket says 172.21.15.8:47052) 2023-10-14T10:33:55.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7efe7ccac640 1 -- 172.21.15.8:0/2022652849 learned_addr learned my addr 172.21.15.8:0/2022652849 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:55.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7f88ecab2640 1 --2- 172.21.15.8:0/237285938 >> v2:172.21.15.92:3300/0 conn(0x7f88e814e0f0 0x7f88e80719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7f88e77fe640 1 -- 172.21.15.8:0/237285938 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900908713 0 0) 0x7f88e8154060 con 0x7f88e80c2670 2023-10-14T10:33:55.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7f88e77fe640 1 -- 172.21.15.8:0/237285938 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88d8003520 con 0x7f88e80c2670 2023-10-14T10:33:55.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7efe77fff640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe780ba3e0 0x7efe781507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7fccac9e2640 1 -- 172.21.15.8:0/2984765655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc900047c0 msgr2=0x7fcc90004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7fccac9e2640 1 --2- 172.21.15.8:0/2984765655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc900047c0 0x7fcc90004c40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcc98001810 tx=0x7fcc900057f0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7efe7ccac640 1 -- 172.21.15.8:0/2022652849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efe78155a80 msgr2=0x7efe781f0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7efe7ccac640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efe78155a80 0x7efe781f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7efe7ccac640 1 -- 172.21.15.8:0/2022652849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe780ba3e0 msgr2=0x7efe781507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7efe7ccac640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe780ba3e0 0x7efe781507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7efe7ccac640 1 -- 172.21.15.8:0/2022652849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c009400 con 0x7efe7815b940 2023-10-14T10:33:55.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7f88e7fff640 1 -- 172.21.15.8:0/237285938 >> v2:172.21.15.92:3300/0 conn(0x7f88e814e0f0 msgr2=0x7f88e80719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:55.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7f88e7fff640 1 --2- 172.21.15.8:0/237285938 >> v2:172.21.15.92:3300/0 conn(0x7f88e814e0f0 0x7f88e80719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7f88e7fff640 1 -- 172.21.15.8:0/237285938 >> v1:172.21.15.8:6789/0 conn(0x7f88e80c2670 legacy=0x7f88e8157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.308+0000 7f88e7fff640 1 -- 172.21.15.8:0/237285938 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8154340 con 0x7f88e80ba150 2023-10-14T10:33:55.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7fccac9e2640 1 -- 172.21.15.8:0/2984765655 shutdown_connections 2023-10-14T10:33:55.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7fccac9e2640 1 --2- 172.21.15.8:0/2984765655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc900047c0 0x7fcc90004c40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7fccac9e2640 1 -- 172.21.15.8:0/2984765655 >> 172.21.15.8:0/2984765655 conn(0x7fcca80c98a0 msgr2=0x7fcca80c9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7f045227e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f04440d10f0 0x7f04440daf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7f045227e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044404dd80 0x7f044404e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7f045227e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044404b120 con 0x7f044404efd0 2023-10-14T10:33:55.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7f045227e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044404c220 con 0x7f04440d10f0 2023-10-14T10:33:55.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7f045227e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04440db4c0 con 0x7f044404dd80 2023-10-14T10:33:55.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7fccac9e2640 1 -- 172.21.15.8:0/2984765655 shutdown_connections 2023-10-14T10:33:55.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7efe7ccac640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe7815b940 0x7efe781f1200 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efe6c02b8c0 tx=0x7efe6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.309+0000 7fccac9e2640 1 -- 172.21.15.8:0/2984765655 wait complete. 2023-10-14T10:33:55.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.310+0000 7f045127c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f04440d10f0 0x7f04440daf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.310+0000 7efe74ff9640 1 -- 172.21.15.8:0/2022652849 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c032880 con 0x7efe7815b940 2023-10-14T10:33:55.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.310+0000 7efe74ff9640 1 -- 172.21.15.8:0/2022652849 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c032a00 con 0x7efe7815b940 2023-10-14T10:33:55.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.310+0000 7efe74ff9640 1 -- 172.21.15.8:0/2022652849 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c032db0 con 0x7efe7815b940 2023-10-14T10:33:55.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.310+0000 7efe7d4ad640 1 -- 172.21.15.8:0/2022652849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7814dcf0 con 0x7efe7815b940 2023-10-14T10:33:55.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.310+0000 7f0451a7d640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f044404efd0 0x7f044404f420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:56972/0 (socket says 172.21.15.8:56972) 2023-10-14T10:33:55.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.310+0000 7f0451a7d640 1 -- 172.21.15.8:0/845824765 learned_addr learned my addr 172.21.15.8:0/845824765 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:55.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.310+0000 7f0450a7b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044404dd80 0x7f044404e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.310+0000 7f88e7fff640 1 --2- 172.21.15.8:0/237285938 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 0x7f88e80c2130 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f88d40097a0 tx=0x7f88d402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9076e7c51afb2dac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.310+0000 7efe7d4ad640 1 -- 172.21.15.8:0/2022652849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7814e2b0 con 0x7efe7815b940 2023-10-14T10:33:55.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.311+0000 7f46b4905640 1 Processor -- start 2023-10-14T10:33:55.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.311+0000 7f0443fff640 1 -- 172.21.15.8:0/845824765 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584475470 0 0) 0x7f044404b120 con 0x7f044404efd0 2023-10-14T10:33:55.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.311+0000 7f46b4905640 1 -- start start 2023-10-14T10:33:55.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.311+0000 7f0443fff640 1 -- 172.21.15.8:0/845824765 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0438003520 con 0x7f044404efd0 2023-10-14T10:33:55.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.311+0000 7f045127c640 1 -- 172.21.15.8:0/845824765 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044404dd80 msgr2=0x7f044404e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:55.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.311+0000 7f045127c640 1 --2- 172.21.15.8:0/845824765 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044404dd80 0x7f044404e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.311+0000 7f045127c640 1 -- 172.21.15.8:0/845824765 >> v1:172.21.15.92:6789/0 conn(0x7f044404efd0 legacy=0x7f044404f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.312+0000 7fccac9e2640 1 Processor -- start 2023-10-14T10:33:55.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.311+0000 7f045127c640 1 -- 172.21.15.8:0/845824765 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044404a5e0 con 0x7f04440d10f0 2023-10-14T10:33:55.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.312+0000 7f0450a7b640 1 --2- 172.21.15.8:0/845824765 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044404dd80 0x7f044404e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:55.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.312+0000 7f46b4905640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b00c4de0 0x7f46b00aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.312+0000 7f46b4905640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b00c54b0 0x7f46b0146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.312+0000 7f46b4905640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46b01517a0 0x7f46b0147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.312+0000 7f46b4905640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b0156660 con 0x7f46b01517a0 2023-10-14T10:33:55.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.312+0000 7f46b4905640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b0147570 con 0x7f46b00c54b0 2023-10-14T10:33:55.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.312+0000 7f46b4905640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b01f0df0 con 0x7f46b00c4de0 2023-10-14T10:33:55.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.312+0000 7fccac9e2640 1 -- start start 2023-10-14T10:33:55.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.313+0000 7efe7d4ad640 1 -- 172.21.15.8:0/2022652849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe780baec0 con 0x7efe7815b940 2023-10-14T10:33:55.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.313+0000 7f46aed9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46b01517a0 0x7f46b0147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.313+0000 7f46aed9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46b01517a0 0x7f46b0147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47064/0 (socket says 172.21.15.8:47064) 2023-10-14T10:33:55.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.313+0000 7f46aed9d640 1 -- 172.21.15.8:0/1557526471 learned_addr learned my addr 172.21.15.8:0/1557526471 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:55.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.313+0000 7f46ae59c640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b00c4de0 0x7f46b00aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.313+0000 7f46add9b640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b00c54b0 0x7f46b0146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.313+0000 7f045127c640 1 --2- 172.21.15.8:0/845824765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04440d10f0 0x7f04440daf80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04480097a0 tx=0x7f044802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ccd5614c669bb65 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.313+0000 7f46aed9d640 1 -- 172.21.15.8:0/1557526471 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b00c4de0 msgr2=0x7f46b00aaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.313+0000 7f46aed9d640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b00c4de0 0x7f46b00aaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7f46aed9d640 1 -- 172.21.15.8:0/1557526471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b00c54b0 msgr2=0x7f46b0146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7f46aed9d640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b00c54b0 0x7f46b0146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7f46aed9d640 1 -- 172.21.15.8:0/1557526471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0009400 con 0x7f46b01517a0 2023-10-14T10:33:55.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7efe74ff9640 1 -- 172.21.15.8:0/2022652849 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efe6c0453f0 con 0x7efe7815b940 2023-10-14T10:33:55.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7f2ce6687640 1 Processor -- start 2023-10-14T10:33:55.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7f46add9b640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b00c54b0 0x7f46b0146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:55.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7f46aed9d640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46b01517a0 0x7f46b0147030 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c7a0 tx=0x7f46a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7f0443fff640 1 -- 172.21.15.8:0/845824765 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04480316f0 con 0x7f04440d10f0 2023-10-14T10:33:55.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7f0443fff640 1 -- 172.21.15.8:0/845824765 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0448031850 con 0x7f04440d10f0 2023-10-14T10:33:55.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7fccac9e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc900047c0 0x7fcca81e9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7fccac9e2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcca814d0e0 0x7fcca814ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7fccac9e2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca8152b50 0x7fcca8145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7f2ce6687640 1 -- start start 2023-10-14T10:33:55.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7f0443fff640 1 -- 172.21.15.8:0/845824765 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448031bc0 con 0x7f04440d10f0 2023-10-14T10:33:55.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7fccac9e2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca81e8e60 con 0x7fcca8152b50 2023-10-14T10:33:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7fccac9e2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca81e93e0 con 0x7fcc900047c0 2023-10-14T10:33:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.314+0000 7fccac9e2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca81e9db0 con 0x7fcca814d0e0 2023-10-14T10:33:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7fcca5d9b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcca814d0e0 0x7fcca814ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7fcca659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc900047c0 0x7fcca81e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7fcca5d9b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcca814d0e0 0x7fcca814ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:32768/0 (socket says 172.21.15.8:32768) 2023-10-14T10:33:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7fcca5d9b640 1 -- 172.21.15.8:0/1957933315 learned_addr learned my addr 172.21.15.8:0/1957933315 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7fcca6d9d640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca8152b50 0x7fcca8145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7f045227e640 1 -- 172.21.15.8:0/845824765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04440d10f0 msgr2=0x7f04440daf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7efe74ff9640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efe6406aec0 0x7efe6406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7f045227e640 1 --2- 172.21.15.8:0/845824765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04440d10f0 0x7f04440daf80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04480097a0 tx=0x7f044802b790 comp rx=0 tx=0).stop 2023-10-14T10:33:55.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7efe74ff9640 1 -- 172.21.15.8:0/2022652849 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe6c0ab530 con 0x7efe7815b940 2023-10-14T10:33:55.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7efe77fff640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efe6406aec0 0x7efe6406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7fcca5d9b640 1 -- 172.21.15.8:0/1957933315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc900047c0 msgr2=0x7fcca81e9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7fcca5d9b640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc900047c0 0x7fcca81e9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7fcca5d9b640 1 -- 172.21.15.8:0/1957933315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca8152b50 msgr2=0x7fcca8145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7fcca5d9b640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca8152b50 0x7fcca8145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7fcca5d9b640 1 -- 172.21.15.8:0/1957933315 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca814bf80 con 0x7fcca814d0e0 2023-10-14T10:33:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7f045227e640 1 -- 172.21.15.8:0/845824765 shutdown_connections 2023-10-14T10:33:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7f045227e640 1 --2- 172.21.15.8:0/845824765 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044404dd80 0x7f044404e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7f045227e640 1 --2- 172.21.15.8:0/845824765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04440d10f0 0x7f04440daf80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.315+0000 7f045227e640 1 -- 172.21.15.8:0/845824765 >> 172.21.15.8:0/845824765 conn(0x7f044404c6e0 msgr2=0x7f044404caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.316+0000 7fcca5d9b640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcca814d0e0 0x7fcca814ba40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc9802bcc0 tx=0x7fcc98001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.316+0000 7f045227e640 1 -- 172.21.15.8:0/845824765 shutdown_connections 2023-10-14T10:33:55.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.316+0000 7f2ce6687640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce006e120 0x7f2ce014d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.316+0000 7f045227e640 1 -- 172.21.15.8:0/845824765 wait complete. 2023-10-14T10:33:55.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.316+0000 7f2ce6687640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2ce0071f60 0x7f2ce006da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.316+0000 7f2ce6687640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce00a8b50 con 0x7f2ce0150170 2023-10-14T10:33:55.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.316+0000 7f2ce6687640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce00c0990 con 0x7f2ce0071f60 2023-10-14T10:33:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.316+0000 7f2ce6687640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce0150ce0 con 0x7f2ce006e120 2023-10-14T10:33:55.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.316+0000 7efe77fff640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efe6406aec0 0x7efe6406d380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe781513c0 tx=0x7efe68008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.317+0000 7f2ce4c24640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2ce0150170 0x7f2ce01505d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34486/0 (socket says 172.21.15.8:34486) 2023-10-14T10:33:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.317+0000 7f2ce4c24640 1 -- 172.21.15.8:0/3992225245 learned_addr learned my addr 172.21.15.8:0/3992225245 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:55.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.317+0000 7f2cdffff640 1 --2- 172.21.15.8:0/3992225245 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce006e120 0x7f2ce014d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.317+0000 7f2cd77fe640 1 --2- 172.21.15.8:0/3992225245 >> v2:172.21.15.8:3300/0 conn(0x7f2ce0071f60 0x7f2ce006da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.317+0000 7f2cd77fe640 1 -- 172.21.15.8:0/3992225245 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce006e120 msgr2=0x7f2ce014d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.317+0000 7f2cd77fe640 1 --2- 172.21.15.8:0/3992225245 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce006e120 0x7f2ce014d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.317+0000 7f2cd77fe640 1 -- 172.21.15.8:0/3992225245 >> v1:172.21.15.8:6789/0 conn(0x7f2ce0150170 legacy=0x7f2ce01505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.317+0000 7f2cd77fe640 1 -- 172.21.15.8:0/3992225245 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce00aa9d0 con 0x7f2ce0071f60 2023-10-14T10:33:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.318+0000 7f045227e640 1 Processor -- start 2023-10-14T10:33:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.318+0000 7f045227e640 1 -- start start 2023-10-14T10:33:55.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.318+0000 7f2cd77fe640 1 --2- 172.21.15.8:0/3992225245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ce0071f60 0x7f2ce006da40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80097d0 tx=0x7f2cc802d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76965a3337d7936 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.319+0000 7f045227e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044404dd80 0x7f0444048320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.319+0000 7f045227e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f044404efd0 0x7f0444170b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.319+0000 7f045227e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04440d10f0 0x7f04440d3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.319+0000 7f045227e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04440305f0 con 0x7f04440d10f0 2023-10-14T10:33:55.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.319+0000 7f045227e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0444048860 con 0x7f044404efd0 2023-10-14T10:33:55.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.319+0000 7f045227e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0444048a70 con 0x7f044404dd80 2023-10-14T10:33:55.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.319+0000 7f0451a7d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04440d10f0 0x7f04440d3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.319+0000 7f0451a7d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04440d10f0 0x7f04440d3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47080/0 (socket says 172.21.15.8:47080) 2023-10-14T10:33:55.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.320+0000 7f0451a7d640 1 -- 172.21.15.8:0/2696153002 learned_addr learned my addr 172.21.15.8:0/2696153002 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:55.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.320+0000 7f045127c640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044404dd80 0x7f0444048320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.320+0000 7f469effd640 1 -- 172.21.15.8:0/1557526471 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a800a9f0 con 0x7f46b01517a0 2023-10-14T10:33:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.320+0000 7f469effd640 1 -- 172.21.15.8:0/1557526471 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a800ab50 con 0x7f46b01517a0 2023-10-14T10:33:55.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.320+0000 7f469effd640 1 -- 172.21.15.8:0/1557526471 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8012420 con 0x7f46b01517a0 2023-10-14T10:33:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.320+0000 7f0450a7b640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f044404efd0 0x7f0444170b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.320+0000 7efe74ff9640 1 -- 172.21.15.8:0/2022652849 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efe6c076870 con 0x7efe7815b940 2023-10-14T10:33:55.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.320+0000 7f2cdf7fe640 1 -- 172.21.15.8:0/3992225245 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8032860 con 0x7f2ce0071f60 2023-10-14T10:33:55.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.320+0000 7f2cdf7fe640 1 -- 172.21.15.8:0/3992225245 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc80329c0 con 0x7f2ce0071f60 2023-10-14T10:33:55.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.320+0000 7f2cdf7fe640 1 -- 172.21.15.8:0/3992225245 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8032d50 con 0x7f2ce0071f60 2023-10-14T10:33:55.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.320+0000 7f46b4905640 1 -- 172.21.15.8:0/1557526471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b01f1910 con 0x7f46b01517a0 2023-10-14T10:33:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.320+0000 7f46b4905640 1 -- 172.21.15.8:0/1557526471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b01f0fe0 con 0x7f46b01517a0 2023-10-14T10:33:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f2ce6687640 1 -- 172.21.15.8:0/3992225245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ce0071f60 msgr2=0x7f2ce006da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f2ce6687640 1 --2- 172.21.15.8:0/3992225245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ce0071f60 0x7f2ce006da40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80097d0 tx=0x7f2cc802d9a0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f0451a7d640 1 -- 172.21.15.8:0/2696153002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044404dd80 msgr2=0x7f0444048320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f0451a7d640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044404dd80 0x7f0444048320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f0451a7d640 1 -- 172.21.15.8:0/2696153002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f044404efd0 msgr2=0x7f0444170b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f0451a7d640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f044404efd0 0x7f0444170b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f0451a7d640 1 -- 172.21.15.8:0/2696153002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0448009400 con 0x7f04440d10f0 2023-10-14T10:33:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f0450a7b640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f044404efd0 0x7f0444170b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f2ce6687640 1 -- 172.21.15.8:0/3992225245 shutdown_connections 2023-10-14T10:33:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f2ce6687640 1 --2- 172.21.15.8:0/3992225245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ce0071f60 0x7f2ce006da40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f2ce6687640 1 --2- 172.21.15.8:0/3992225245 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce006e120 0x7f2ce014d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f2ce6687640 1 -- 172.21.15.8:0/3992225245 >> 172.21.15.8:0/3992225245 conn(0x7f2ce00a74d0 msgr2=0x7f2ce00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f045127c640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044404dd80 0x7f0444048320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:33:55.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f2ce6687640 1 -- 172.21.15.8:0/3992225245 shutdown_connections 2023-10-14T10:33:55.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.321+0000 7f0451a7d640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04440d10f0 0x7f04440d3cc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f044c02cb70 tx=0x7f044c067230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.322+0000 7f0441ffb640 1 -- 172.21.15.8:0/2696153002 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0723d0 con 0x7f04440d10f0 2023-10-14T10:33:55.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.322+0000 7f46b4905640 1 -- 172.21.15.8:0/1557526471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b0154340 con 0x7f46b01517a0 2023-10-14T10:33:55.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.322+0000 7f0441ffb640 1 -- 172.21.15.8:0/2696153002 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c073790 con 0x7f04440d10f0 2023-10-14T10:33:55.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.322+0000 7f0441ffb640 1 -- 172.21.15.8:0/2696153002 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0739c0 con 0x7f04440d10f0 2023-10-14T10:33:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.322+0000 7f045227e640 1 -- 172.21.15.8:0/2696153002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0444048d50 con 0x7f04440d10f0 2023-10-14T10:33:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.322+0000 7f045227e640 1 -- 172.21.15.8:0/2696153002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0444049310 con 0x7f04440d10f0 2023-10-14T10:33:55.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.323+0000 7f469effd640 1 -- 172.21.15.8:0/1557526471 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f46a8012580 con 0x7f46b01517a0 2023-10-14T10:33:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.322+0000 7f2ce6687640 1 -- 172.21.15.8:0/3992225245 wait complete. 2023-10-14T10:33:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.324+0000 7f88e77fe640 1 -- 172.21.15.8:0/237285938 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d402d040 con 0x7f88e80ba150 2023-10-14T10:33:55.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.324+0000 7f469effd640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f469006aec0 0x7f469006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.324+0000 7f2ce6687640 1 Processor -- start 2023-10-14T10:33:55.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.324+0000 7fa1e57fa640 1 -- 172.21.15.8:0/3445121846 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1e0053bf0 con 0x7fa1f00c4f80 2023-10-14T10:33:55.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.324+0000 7f2ce6687640 1 -- start start 2023-10-14T10:33:55.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.324+0000 7f469effd640 1 -- 172.21.15.8:0/1557526471 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46a8089be0 con 0x7f46b01517a0 2023-10-14T10:33:55.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.325+0000 7f46ae59c640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f469006aec0 0x7f469006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.324+0000 7fcc96ffd640 1 -- 172.21.15.8:0/1957933315 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98038070 con 0x7fcca814d0e0 2023-10-14T10:33:55.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.325+0000 7fcc96ffd640 1 -- 172.21.15.8:0/1957933315 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc98007270 con 0x7fcca814d0e0 2023-10-14T10:33:55.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.325+0000 7fcc96ffd640 1 -- 172.21.15.8:0/1957933315 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9803b040 con 0x7fcca814d0e0 2023-10-14T10:33:55.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.325+0000 7fccac9e2640 1 -- 172.21.15.8:0/1957933315 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca814d570 con 0x7fcca814d0e0 2023-10-14T10:33:55.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.325+0000 7f88e77fe640 1 -- 172.21.15.8:0/237285938 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d4031810 con 0x7f88e80ba150 2023-10-14T10:33:55.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7f88e77fe640 1 -- 172.21.15.8:0/237285938 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4031b80 con 0x7f88e80ba150 2023-10-14T10:33:55.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7f2ce6687640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce006e120 0x7f2ce014dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7f46ae59c640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f469006aec0 0x7f469006d380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f46a0036000 tx=0x7f46a003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7f2ce6687640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ce0071f60 0x7f2ce01ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7f2ce6687640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ce0150170 0x7f2ce014a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7f2ce6687640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce014e750 con 0x7f2ce0150170 2023-10-14T10:33:55.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7f2ce6687640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce014c4e0 con 0x7f2ce0071f60 2023-10-14T10:33:55.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7f2ce6687640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce014caf0 con 0x7f2ce006e120 2023-10-14T10:33:55.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.324+0000 7f045227e640 1 -- 172.21.15.8:0/2696153002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0444035c70 con 0x7f04440d10f0 2023-10-14T10:33:55.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7fdf1bfff640 1 -- 172.21.15.8:0/3366111945 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400c9a0 con 0x7fdf34152880 2023-10-14T10:33:55.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7f0441ffb640 1 -- 172.21.15.8:0/2696153002 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f044c073b20 con 0x7f04440d10f0 2023-10-14T10:33:55.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7fdf1bfff640 1 -- 172.21.15.8:0/3366111945 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2400cb00 con 0x7fdf34152880 2023-10-14T10:33:55.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7fdf1bfff640 1 -- 172.21.15.8:0/3366111945 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400ce70 con 0x7fdf34152880 2023-10-14T10:33:55.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7f2ce4c24640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ce0150170 0x7f2ce014a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7fccac9e2640 1 -- 172.21.15.8:0/1957933315 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca81e9070 con 0x7fcca814d0e0 2023-10-14T10:33:55.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.327+0000 7f2ce4c24640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ce0150170 0x7f2ce014a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47082/0 (socket says 172.21.15.8:47082) 2023-10-14T10:33:55.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7f88edab4640 1 -- 172.21.15.8:0/237285938 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 msgr2=0x7f88e80c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.326+0000 7f88edab4640 1 --2- 172.21.15.8:0/237285938 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 0x7f88e80c2130 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f88d40097a0 tx=0x7f88d402b8b0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.327+0000 7f88edab4640 1 -- 172.21.15.8:0/237285938 shutdown_connections 2023-10-14T10:33:55.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.327+0000 7f2ce4c24640 1 -- 172.21.15.8:0/3078815770 learned_addr learned my addr 172.21.15.8:0/3078815770 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:55.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.327+0000 7f88edab4640 1 --2- 172.21.15.8:0/237285938 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 0x7f88e80c2130 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.327+0000 7f88edab4640 1 --2- 172.21.15.8:0/237285938 >> v2:172.21.15.92:3300/0 conn(0x7f88e814e0f0 0x7f88e80719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.327+0000 7f88edab4640 1 -- 172.21.15.8:0/237285938 >> 172.21.15.8:0/237285938 conn(0x7f88e806a200 msgr2=0x7f88e806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.328+0000 7f88edab4640 1 -- 172.21.15.8:0/237285938 shutdown_connections 2023-10-14T10:33:55.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.328+0000 7f88edab4640 1 -- 172.21.15.8:0/237285938 wait complete. 2023-10-14T10:33:55.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.328+0000 7f0441ffb640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f043006af70 0x7f043006d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.328+0000 7f0441ffb640 1 -- 172.21.15.8:0/2696153002 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f044c102b10 con 0x7f04440d10f0 2023-10-14T10:33:55.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.328+0000 7fccac9e2640 1 -- 172.21.15.8:0/1957933315 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca814da90 con 0x7fcca814d0e0 2023-10-14T10:33:55.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.328+0000 7fdf39c4f640 1 -- 172.21.15.8:0/3366111945 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c009a70 con 0x7fdf34152880 2023-10-14T10:33:55.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.328+0000 7fdf39c4f640 1 -- 172.21.15.8:0/3366111945 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf340be040 con 0x7fdf34152880 2023-10-14T10:33:55.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.328+0000 7f045127c640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f043006af70 0x7f043006d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.329+0000 7f045127c640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f043006af70 0x7f043006d430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0448036000 tx=0x7f0448008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.330+0000 7f2ce4c24640 1 -- 172.21.15.8:0/3078815770 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce006e120 msgr2=0x7f2ce014dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.328+0000 7f2cd77fe640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ce0071f60 0x7f2ce01ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.330+0000 7f2cdffff640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce006e120 0x7f2ce014dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.330+0000 7fcc96ffd640 1 -- 172.21.15.8:0/1957933315 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcc98030070 con 0x7fcca814d0e0 2023-10-14T10:33:55.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.330+0000 7f2ce4c24640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce006e120 0x7f2ce014dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.331+0000 7f88edab4640 1 Processor -- start 2023-10-14T10:33:55.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.330+0000 7f2ce4c24640 1 -- 172.21.15.8:0/3078815770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ce0071f60 msgr2=0x7f2ce01ed9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.330+0000 7f2ce4c24640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ce0071f60 0x7f2ce01ed9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.330+0000 7f2ce4c24640 1 -- 172.21.15.8:0/3078815770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc8009400 con 0x7f2ce0150170 2023-10-14T10:33:55.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.330+0000 7f2cd77fe640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ce0071f60 0x7f2ce01ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:55.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.330+0000 7f2cdffff640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce006e120 0x7f2ce014dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:55.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.330+0000 7fdf19ffb640 1 -- 172.21.15.8:0/3366111945 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0c005250 con 0x7fdf34152880 2023-10-14T10:33:55.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.331+0000 7f88edab4640 1 -- start start 2023-10-14T10:33:55.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.331+0000 7f2ce4c24640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ce0150170 0x7f2ce014a400 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800cbf0 tx=0x7f2cd800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.331+0000 7fcc96ffd640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fcc8806aef0 0x7fcc8806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.331+0000 7fcc96ffd640 1 -- 172.21.15.8:0/1957933315 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc980a9a20 con 0x7fcca814d0e0 2023-10-14T10:33:55.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.331+0000 7fcca659c640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fcc8806aef0 0x7fcc8806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.332+0000 7f88edab4640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 0x7f88e81f9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.332+0000 7f88edab4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e80c2670 0x7f88e8150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.332+0000 7f88edab4640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e814e0f0 0x7f88e81f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.332+0000 7f88edab4640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e81510d0 con 0x7f88e814e0f0 2023-10-14T10:33:55.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.332+0000 7f88edab4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e81fa050 con 0x7f88e80c2670 2023-10-14T10:33:55.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.332+0000 7f88edab4640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e81f9d70 con 0x7f88e80ba150 2023-10-14T10:33:55.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.332+0000 7fcca659c640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fcc8806aef0 0x7fcc8806d3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcca804f3d0 tx=0x7fcca0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.333+0000 7f469effd640 1 -- 172.21.15.8:0/1557526471 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46b0154340 con 0x7f46b01517a0 2023-10-14T10:33:55.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.333+0000 7f88e7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e80c2670 0x7f88e8150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.333+0000 7f88e7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e80c2670 0x7f88e8150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:37642/0 (socket says 172.21.15.8:37642) 2023-10-14T10:33:55.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.334+0000 7f88ecab2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 0x7f88e81f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.334+0000 7f88ecab2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 0x7f88e81f9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:32798/0 (socket says 172.21.15.8:32798) 2023-10-14T10:33:55.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.334+0000 7f88ecab2640 1 -- 172.21.15.8:0/121045433 learned_addr learned my addr 172.21.15.8:0/121045433 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:55.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.333+0000 7fdf1bfff640 1 -- 172.21.15.8:0/3366111945 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdf24013470 con 0x7fdf34152880 2023-10-14T10:33:55.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.334+0000 7fdf1bfff640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fdf2006aec0 0x7fdf2006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.334+0000 7f88ed2b3640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e814e0f0 0x7f88e81f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.335+0000 7fdf32ffd640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fdf2006aec0 0x7fdf2006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.335+0000 7fdf32ffd640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fdf2006aec0 0x7fdf2006d380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdf34160b70 tx=0x7fdf28009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.335+0000 7f88ecab2640 1 -- 172.21.15.8:0/121045433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e80c2670 msgr2=0x7f88e8150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.335+0000 7f88ecab2640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e80c2670 0x7f88e8150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.335+0000 7f88ecab2640 1 -- 172.21.15.8:0/121045433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e814e0f0 msgr2=0x7f88e81f2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.335+0000 7f88ecab2640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e814e0f0 0x7f88e81f2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.335+0000 7f88ecab2640 1 -- 172.21.15.8:0/121045433 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4009400 con 0x7f88e80ba150 2023-10-14T10:33:55.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.336+0000 7f88ecab2640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 0x7f88e81f9380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00d800 tx=0x7f88dc00dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.341+0000 7f2cdd7fa640 1 -- 172.21.15.8:0/3078815770 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd800ad40 con 0x7f2ce0150170 2023-10-14T10:33:55.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.341+0000 7f2ce6687640 1 -- 172.21.15.8:0/3078815770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce00c4f60 con 0x7f2ce0150170 2023-10-14T10:33:55.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.341+0000 7f0441ffb640 1 -- 172.21.15.8:0/2696153002 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f044c0cdba0 con 0x7f04440d10f0 2023-10-14T10:33:55.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.342+0000 7f2ce6687640 1 -- 172.21.15.8:0/3078815770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce0143370 con 0x7f2ce0150170 2023-10-14T10:33:55.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.342+0000 7f2cdd7fa640 1 -- 172.21.15.8:0/3078815770 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd8012400 con 0x7f2ce0150170 2023-10-14T10:33:55.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.342+0000 7f2cdd7fa640 1 -- 172.21.15.8:0/3078815770 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd800aea0 con 0x7f2ce0150170 2023-10-14T10:33:55.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.343+0000 7f2ce6687640 1 -- 172.21.15.8:0/3078815770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc4005250 con 0x7f2ce0150170 2023-10-14T10:33:55.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.346+0000 7f2cdd7fa640 1 -- 172.21.15.8:0/3078815770 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2cd8012770 con 0x7f2ce0150170 2023-10-14T10:33:55.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.346+0000 7f88e57fa640 1 -- 172.21.15.8:0/121045433 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc00b6c0 con 0x7f88e80ba150 2023-10-14T10:33:55.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.346+0000 7fdf1bfff640 1 -- 172.21.15.8:0/3366111945 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf24058920 con 0x7fdf34152880 2023-10-14T10:33:55.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.346+0000 7f88edab4640 1 -- 172.21.15.8:0/121045433 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e814f660 con 0x7f88e80ba150 2023-10-14T10:33:55.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.347+0000 7f88edab4640 1 -- 172.21.15.8:0/121045433 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e814fc20 con 0x7f88e80ba150 2023-10-14T10:33:55.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.347+0000 7f2cdd7fa640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2cc006ae70 0x7f2cc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.348+0000 7f2cdd7fa640 1 -- 172.21.15.8:0/3078815770 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cd8089670 con 0x7f2ce0150170 2023-10-14T10:33:55.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.348+0000 7f2cdffff640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2cc006ae70 0x7f2cc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.348+0000 7fcc96ffd640 1 -- 172.21.15.8:0/1957933315 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcca814da90 con 0x7fcca814d0e0 2023-10-14T10:33:55.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.349+0000 7f2cdffff640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2cc006ae70 0x7f2cc006d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000ab20 tx=0x7f2cd0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.349+0000 7f88edab4640 1 -- 172.21.15.8:0/121045433 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e80c61d0 con 0x7f88e80ba150 2023-10-14T10:33:55.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.354+0000 7f2cdd7fa640 1 -- 172.21.15.8:0/3078815770 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2cd80547b0 con 0x7f2ce0150170 2023-10-14T10:33:55.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.358+0000 7f88e57fa640 1 -- 172.21.15.8:0/121045433 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc00b820 con 0x7f88e80ba150 2023-10-14T10:33:55.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.358+0000 7f88e57fa640 1 -- 172.21.15.8:0/121045433 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc00bbb0 con 0x7f88e80ba150 2023-10-14T10:33:55.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.360+0000 7fdf1bfff640 1 -- 172.21.15.8:0/3366111945 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf24054c60 con 0x7fdf34152880 2023-10-14T10:33:55.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.362+0000 7f88e57fa640 1 -- 172.21.15.8:0/121045433 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f88dc00bd10 con 0x7f88e80ba150 2023-10-14T10:33:55.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.364+0000 7f88e57fa640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f88cc06ae70 0x7f88cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:55.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.364+0000 7f88e57fa640 1 -- 172.21.15.8:0/121045433 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88dc08a5b0 con 0x7f88e80ba150 2023-10-14T10:33:55.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.365+0000 7f88e7fff640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f88cc06ae70 0x7f88cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:55.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.366+0000 7f88e7fff640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f88cc06ae70 0x7f88cc06d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f88d4036000 tx=0x7f88d403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:55.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.371+0000 7f88e57fa640 1 -- 172.21.15.8:0/121045433 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88dc0556d0 con 0x7f88e80ba150 2023-10-14T10:33:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.744+0000 7fa1f7183640 1 -- 172.21.15.8:0/3445121846 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa1d0005500 con 0x7fa1f00c4f80 2023-10-14T10:33:55.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.745+0000 7fa1e57fa640 1 -- 172.21.15.8:0/3445121846 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa1e0017090 con 0x7fa1f00c4f80 2023-10-14T10:33:55.750 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-10-14T10:33:55.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.749+0000 7fa1f7183640 1 -- 172.21.15.8:0/3445121846 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa1dc06ae70 msgr2=0x7fa1dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.749+0000 7fa1f7183640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa1dc06ae70 0x7fa1dc06d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00bfad0 tx=0x7fa1ec009040 comp rx=0 tx=0).stop 2023-10-14T10:33:55.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.749+0000 7fa1f7183640 1 -- 172.21.15.8:0/3445121846 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1f00c4f80 msgr2=0x7fa1f0153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.749+0000 7fa1f7183640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1f00c4f80 0x7fa1f0153bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000c450 tx=0x7fa1e000c910 comp rx=0 tx=0).stop 2023-10-14T10:33:55.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.750+0000 7fa1f7183640 1 -- 172.21.15.8:0/3445121846 shutdown_connections 2023-10-14T10:33:55.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.750+0000 7fa1f7183640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa1dc06ae70 0x7fa1dc06d330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.750+0000 7fa1f7183640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f01515c0 0x7fa1f0146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.750+0000 7fa1f7183640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f00c5550 0x7fa1f00aa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.750+0000 7fa1f7183640 1 --2- 172.21.15.8:0/3445121846 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1f00c4f80 0x7fa1f0153bf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.750+0000 7fa1f7183640 1 -- 172.21.15.8:0/3445121846 >> 172.21.15.8:0/3445121846 conn(0x7fa1f00c9730 msgr2=0x7fa1f014dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.750+0000 7fa1f7183640 1 -- 172.21.15.8:0/3445121846 shutdown_connections 2023-10-14T10:33:55.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.751+0000 7fa1f7183640 1 -- 172.21.15.8:0/3445121846 wait complete. 2023-10-14T10:33:55.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.756+0000 7f46b4905640 1 -- 172.21.15.8:0/1557526471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f46b0154340 con 0x7f46b01517a0 2023-10-14T10:33:55.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.756+0000 7f469effd640 1 -- 172.21.15.8:0/1557526471 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f46b0154340 con 0x7f46b01517a0 2023-10-14T10:33:55.762 INFO:teuthology.orchestra.run.smithi008.stdout:55834574851 2023-10-14T10:33:55.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.760+0000 7efe7d4ad640 1 -- 172.21.15.8:0/2022652849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe780619f0 con 0x7efe7815b940 2023-10-14T10:33:55.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.761+0000 7efe74ff9640 1 -- 172.21.15.8:0/2022652849 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe6c079e90 con 0x7efe7815b940 2023-10-14T10:33:55.763 INFO:teuthology.orchestra.run.smithi008.stdout:55834574851 2023-10-14T10:33:55.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.762+0000 7f46b4905640 1 -- 172.21.15.8:0/1557526471 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f469006aec0 msgr2=0x7f469006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.762+0000 7f46b4905640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f469006aec0 0x7f469006d380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f46a0036000 tx=0x7f46a003c040 comp rx=0 tx=0).stop 2023-10-14T10:33:55.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.762+0000 7f46b4905640 1 -- 172.21.15.8:0/1557526471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46b01517a0 msgr2=0x7f46b0147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.762+0000 7f46b4905640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46b01517a0 0x7f46b0147030 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c7a0 tx=0x7f46a800cc60 comp rx=0 tx=0).stop 2023-10-14T10:33:55.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.764+0000 7f46b4905640 1 -- 172.21.15.8:0/1557526471 shutdown_connections 2023-10-14T10:33:55.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.764+0000 7f46b4905640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f469006aec0 0x7f469006d380 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.764+0000 7f46b4905640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46b01517a0 0x7f46b0147030 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.764+0000 7f46b4905640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b00c54b0 0x7f46b0146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.764+0000 7f46b4905640 1 --2- 172.21.15.8:0/1557526471 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b00c4de0 0x7f46b00aaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.764+0000 7f46b4905640 1 -- 172.21.15.8:0/1557526471 >> 172.21.15.8:0/1557526471 conn(0x7f46b00c98a0 msgr2=0x7f46b00c4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.764+0000 7f46b4905640 1 -- 172.21.15.8:0/1557526471 shutdown_connections 2023-10-14T10:33:55.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.764+0000 7f46b4905640 1 -- 172.21.15.8:0/1557526471 wait complete. 2023-10-14T10:33:55.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.764+0000 7efe7d4ad640 1 -- 172.21.15.8:0/2022652849 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efe6406aec0 msgr2=0x7efe6406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.764+0000 7efe7d4ad640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efe6406aec0 0x7efe6406d380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe781513c0 tx=0x7efe68008040 comp rx=0 tx=0).stop 2023-10-14T10:33:55.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.764+0000 7efe7d4ad640 1 -- 172.21.15.8:0/2022652849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe7815b940 msgr2=0x7efe781f1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.764+0000 7efe7d4ad640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe7815b940 0x7efe781f1200 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efe6c02b8c0 tx=0x7efe6c0046c0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.765+0000 7efe7d4ad640 1 -- 172.21.15.8:0/2022652849 shutdown_connections 2023-10-14T10:33:55.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.765+0000 7efe7d4ad640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efe6406aec0 0x7efe6406d380 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.765+0000 7efe7d4ad640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe7815b940 0x7efe781f1200 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.765+0000 7efe7d4ad640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efe78155a80 0x7efe781f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.765+0000 7efe7d4ad640 1 --2- 172.21.15.8:0/2022652849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe780ba3e0 0x7efe781507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.765+0000 7efe7d4ad640 1 -- 172.21.15.8:0/2022652849 >> 172.21.15.8:0/2022652849 conn(0x7efe7806a200 msgr2=0x7efe78152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.765+0000 7efe7d4ad640 1 -- 172.21.15.8:0/2022652849 shutdown_connections 2023-10-14T10:33:55.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.765+0000 7efe7d4ad640 1 -- 172.21.15.8:0/2022652849 wait complete. 2023-10-14T10:33:55.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.0 2023-10-14T10:33:55.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.780+0000 7f045227e640 1 -- 172.21.15.8:0/2696153002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0444006950 con 0x7f04440d10f0 2023-10-14T10:33:55.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.781+0000 7f0441ffb640 1 -- 172.21.15.8:0/2696153002 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f044c08d090 con 0x7f04440d10f0 2023-10-14T10:33:55.783 INFO:teuthology.orchestra.run.smithi008.stdout:55834574851 2023-10-14T10:33:55.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.784+0000 7fdf19ffb640 1 -- 172.21.15.8:0/3366111945 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdf0c005500 con 0x7fdf34152880 2023-10-14T10:33:55.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.785+0000 7f045227e640 1 -- 172.21.15.8:0/2696153002 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f043006af70 msgr2=0x7f043006d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.785+0000 7f045227e640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f043006af70 0x7f043006d430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0448036000 tx=0x7f0448008030 comp rx=0 tx=0).stop 2023-10-14T10:33:55.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.785+0000 7f045227e640 1 -- 172.21.15.8:0/2696153002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04440d10f0 msgr2=0x7f04440d3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.785+0000 7fdf1bfff640 1 -- 172.21.15.8:0/3366111945 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf24017090 con 0x7fdf34152880 2023-10-14T10:33:55.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.785+0000 7f045227e640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04440d10f0 0x7f04440d3cc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f044c02cb70 tx=0x7f044c067230 comp rx=0 tx=0).stop 2023-10-14T10:33:55.788 INFO:teuthology.orchestra.run.smithi008.stdout:55834574851 2023-10-14T10:33:55.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.785+0000 7f045227e640 1 -- 172.21.15.8:0/2696153002 shutdown_connections 2023-10-14T10:33:55.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.785+0000 7f045227e640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f043006af70 0x7f043006d430 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.785+0000 7f045227e640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04440d10f0 0x7f04440d3cc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.785+0000 7f045227e640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f044404efd0 0x7f0444170b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.785+0000 7f045227e640 1 --2- 172.21.15.8:0/2696153002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044404dd80 0x7f0444048320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.786+0000 7f045227e640 1 -- 172.21.15.8:0/2696153002 >> 172.21.15.8:0/2696153002 conn(0x7f044404c6e0 msgr2=0x7f04440dac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.786+0000 7f045227e640 1 -- 172.21.15.8:0/2696153002 shutdown_connections 2023-10-14T10:33:55.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.786+0000 7f045227e640 1 -- 172.21.15.8:0/2696153002 wait complete. 2023-10-14T10:33:55.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.787+0000 7fccac9e2640 1 -- 172.21.15.8:0/1957933315 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcca814da90 con 0x7fcca814d0e0 2023-10-14T10:33:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.787+0000 7fdf19ffb640 1 -- 172.21.15.8:0/3366111945 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fdf2006aec0 msgr2=0x7fdf2006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.787+0000 7fdf19ffb640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fdf2006aec0 0x7fdf2006d380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdf34160b70 tx=0x7fdf28009190 comp rx=0 tx=0).stop 2023-10-14T10:33:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.787+0000 7fdf19ffb640 1 -- 172.21.15.8:0/3366111945 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdf34152880 msgr2=0x7fdf34154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.787+0000 7fdf19ffb640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdf34152880 0x7fdf34154a20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400e9b0 tx=0x7fdf2400ee70 comp rx=0 tx=0).stop 2023-10-14T10:33:55.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.788+0000 7fdf19ffb640 1 -- 172.21.15.8:0/3366111945 shutdown_connections 2023-10-14T10:33:55.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.788+0000 7fdf19ffb640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fdf2006aec0 0x7fdf2006d380 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.788+0000 7fdf19ffb640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf341561b0 0x7fdf340beaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.788+0000 7fdf19ffb640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf34152d00 0x7fdf340be560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.788+0000 7fdf19ffb640 1 --2- 172.21.15.8:0/3366111945 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdf34152880 0x7fdf34154a20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.788+0000 7fdf19ffb640 1 -- 172.21.15.8:0/3366111945 >> 172.21.15.8:0/3366111945 conn(0x7fdf3406a200 msgr2=0x7fdf340c3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.788+0000 7fdf19ffb640 1 -- 172.21.15.8:0/3366111945 shutdown_connections 2023-10-14T10:33:55.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.788+0000 7fdf19ffb640 1 -- 172.21.15.8:0/3366111945 wait complete. 2023-10-14T10:33:55.794 INFO:teuthology.orchestra.run.smithi008.stdout:55834574852 2023-10-14T10:33:55.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.788+0000 7fcc96ffd640 1 -- 172.21.15.8:0/1957933315 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcca814da90 con 0x7fcca814d0e0 2023-10-14T10:33:55.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.2 2023-10-14T10:33:55.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.1 2023-10-14T10:33:55.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7f2ce6687640 1 -- 172.21.15.8:0/3078815770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2cc40057d0 con 0x7f2ce0150170 2023-10-14T10:33:55.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7fccac9e2640 1 -- 172.21.15.8:0/1957933315 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fcc8806aef0 msgr2=0x7fcc8806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7fccac9e2640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fcc8806aef0 0x7fcc8806d3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcca804f3d0 tx=0x7fcca0009040 comp rx=0 tx=0).stop 2023-10-14T10:33:55.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7fccac9e2640 1 -- 172.21.15.8:0/1957933315 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcca814d0e0 msgr2=0x7fcca814ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7fccac9e2640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcca814d0e0 0x7fcca814ba40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc9802bcc0 tx=0x7fcc98001120 comp rx=0 tx=0).stop 2023-10-14T10:33:55.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7fccac9e2640 1 -- 172.21.15.8:0/1957933315 shutdown_connections 2023-10-14T10:33:55.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7fccac9e2640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fcc8806aef0 0x7fcc8806d3b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7fccac9e2640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca8152b50 0x7fcca8145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7fccac9e2640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcca814d0e0 0x7fcca814ba40 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc9802bcc0 tx=0x7fcc98001120 comp rx=0 tx=0).stop 2023-10-14T10:33:55.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7fccac9e2640 1 --2- 172.21.15.8:0/1957933315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc900047c0 0x7fcca81e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7fccac9e2640 1 -- 172.21.15.8:0/1957933315 >> 172.21.15.8:0/1957933315 conn(0x7fcca80c98a0 msgr2=0x7fcca814b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7fccac9e2640 1 -- 172.21.15.8:0/1957933315 shutdown_connections 2023-10-14T10:33:55.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7fccac9e2640 1 -- 172.21.15.8:0/1957933315 wait complete. 2023-10-14T10:33:55.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.792+0000 7f2cdd7fa640 1 -- 172.21.15.8:0/3078815770 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2cd8001be0 con 0x7f2ce0150170 2023-10-14T10:33:55.801 INFO:teuthology.orchestra.run.smithi008.stdout:55834574851 2023-10-14T10:33:55.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.796+0000 7f2ce6687640 1 -- 172.21.15.8:0/3078815770 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2cc006ae70 msgr2=0x7f2cc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.796+0000 7f2ce6687640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2cc006ae70 0x7f2cc006d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000ab20 tx=0x7f2cd0008040 comp rx=0 tx=0).stop 2023-10-14T10:33:55.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.796+0000 7f2ce6687640 1 -- 172.21.15.8:0/3078815770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ce0150170 msgr2=0x7f2ce014a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.796+0000 7f2ce6687640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ce0150170 0x7f2ce014a400 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800cbf0 tx=0x7f2cd800a430 comp rx=0 tx=0).stop 2023-10-14T10:33:55.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.796+0000 7f2ce6687640 1 -- 172.21.15.8:0/3078815770 shutdown_connections 2023-10-14T10:33:55.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.796+0000 7f2ce6687640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2cc006ae70 0x7f2cc006d330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.796+0000 7f2ce6687640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ce0150170 0x7f2ce014a400 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.796+0000 7f2ce6687640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ce0071f60 0x7f2ce01ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.796+0000 7f2ce6687640 1 --2- 172.21.15.8:0/3078815770 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce006e120 0x7f2ce014dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.796+0000 7f2ce6687640 1 -- 172.21.15.8:0/3078815770 >> 172.21.15.8:0/3078815770 conn(0x7f2ce00a74d0 msgr2=0x7f2ce006fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.796+0000 7f2ce6687640 1 -- 172.21.15.8:0/3078815770 shutdown_connections 2023-10-14T10:33:55.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.796+0000 7f2ce6687640 1 -- 172.21.15.8:0/3078815770 wait complete. 2023-10-14T10:33:55.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.805+0000 7f88edab4640 1 -- 172.21.15.8:0/121045433 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f88e80619f0 con 0x7f88e80ba150 2023-10-14T10:33:55.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.806+0000 7f88e57fa640 1 -- 172.21.15.8:0/121045433 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88dc058cf0 con 0x7f88e80ba150 2023-10-14T10:33:55.808 INFO:teuthology.orchestra.run.smithi008.stdout:55834574852 2023-10-14T10:33:55.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.3 2023-10-14T10:33:55.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.810+0000 7f88edab4640 1 -- 172.21.15.8:0/121045433 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f88cc06ae70 msgr2=0x7f88cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.810+0000 7f88edab4640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f88cc06ae70 0x7f88cc06d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f88d4036000 tx=0x7f88d403c040 comp rx=0 tx=0).stop 2023-10-14T10:33:55.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.810+0000 7f88edab4640 1 -- 172.21.15.8:0/121045433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 msgr2=0x7f88e81f9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:55.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.810+0000 7f88edab4640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 0x7f88e81f9380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00d800 tx=0x7f88dc00dcc0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.810+0000 7f88edab4640 1 -- 172.21.15.8:0/121045433 shutdown_connections 2023-10-14T10:33:55.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.810+0000 7f88edab4640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f88cc06ae70 0x7f88cc06d330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.810+0000 7f88edab4640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e814e0f0 0x7f88e81f2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.810+0000 7f88edab4640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e80c2670 0x7f88e8150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.810+0000 7f88edab4640 1 --2- 172.21.15.8:0/121045433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e80ba150 0x7f88e81f9380 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:55.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.810+0000 7f88edab4640 1 -- 172.21.15.8:0/121045433 >> 172.21.15.8:0/121045433 conn(0x7f88e806a200 msgr2=0x7f88e80c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:55.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.811+0000 7f88edab4640 1 -- 172.21.15.8:0/121045433 shutdown_connections 2023-10-14T10:33:55.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:55.811+0000 7f88edab4640 1 -- 172.21.15.8:0/121045433 wait complete. 2023-10-14T10:33:55.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.7 2023-10-14T10:33:55.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.4 2023-10-14T10:33:55.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.6 2023-10-14T10:33:55.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.5 2023-10-14T10:33:56.783 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T10:33:56.796 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T10:33:56.798 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T10:33:56.814 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T10:33:56.817 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T10:33:56.820 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T10:33:56.824 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T10:33:56.830 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T10:33:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.093+0000 7f286079e640 1 Processor -- start 2023-10-14T10:33:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.093+0000 7f286079e640 1 -- start start 2023-10-14T10:33:57.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.095+0000 7f286079e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f28581515c0 0x7f28580c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.095+0000 7f286079e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f28580c5550 0x7f2858154a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.095+0000 7f286079e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28580c7630 0x7f285806ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.095+0000 7f286079e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28580c59d0 con 0x7f28581515c0 2023-10-14T10:33:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.095+0000 7f286079e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28581545f0 con 0x7f28580c5550 2023-10-14T10:33:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.095+0000 7f286079e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28581519a0 con 0x7f28580c7630 2023-10-14T10:33:57.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.096+0000 7f285ed3b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28580c7630 0x7f285806ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.096+0000 7f285ed3b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28580c7630 0x7f285806ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:58248/0 (socket says 172.21.15.8:58248) 2023-10-14T10:33:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.096+0000 7f285ed3b640 1 -- 172.21.15.8:0/3735469150 learned_addr learned my addr 172.21.15.8:0/3735469150 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.097+0000 7f285dd39640 1 --2- 172.21.15.8:0/3735469150 >> v2:172.21.15.92:3300/0 conn(0x7f28580c5550 0x7f2858154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.097+0000 7f285e53a640 1 --2- 172.21.15.8:0/3735469150 >> v2:172.21.15.8:3300/0 conn(0x7f28581515c0 0x7f28580c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.098+0000 7f285ed3b640 1 -- 172.21.15.8:0/3735469150 >> v2:172.21.15.92:3300/0 conn(0x7f28580c5550 msgr2=0x7f2858154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.098+0000 7f285ed3b640 1 --2- 172.21.15.8:0/3735469150 >> v2:172.21.15.92:3300/0 conn(0x7f28580c5550 0x7f2858154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.098+0000 7f285ed3b640 1 -- 172.21.15.8:0/3735469150 >> v2:172.21.15.8:3300/0 conn(0x7f28581515c0 msgr2=0x7f28580c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.098+0000 7f285ed3b640 1 --2- 172.21.15.8:0/3735469150 >> v2:172.21.15.8:3300/0 conn(0x7f28581515c0 0x7f28580c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.098+0000 7f285ed3b640 1 -- 172.21.15.8:0/3735469150 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285806b910 con 0x7f28580c7630 2023-10-14T10:33:57.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.100+0000 7f285ed3b640 1 --2- 172.21.15.8:0/3735469150 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28580c7630 0x7f285806ac40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f28580ca430 tx=0x7f285002be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5b95b8f01740ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.101+0000 7f285d538640 1 -- 172.21.15.8:0/3735469150 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285002c9f0 con 0x7f28580c7630 2023-10-14T10:33:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.101+0000 7f285d538640 1 -- 172.21.15.8:0/3735469150 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285002cb50 con 0x7f28580c7630 2023-10-14T10:33:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.101+0000 7f285d538640 1 -- 172.21.15.8:0/3735469150 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28500343f0 con 0x7f28580c7630 2023-10-14T10:33:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.102+0000 7f286079e640 1 -- 172.21.15.8:0/3735469150 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28580c7630 msgr2=0x7f285806ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.103+0000 7f286079e640 1 --2- 172.21.15.8:0/3735469150 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28580c7630 0x7f285806ac40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f28580ca430 tx=0x7f285002be50 comp rx=0 tx=0).stop 2023-10-14T10:33:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.103+0000 7f286079e640 1 -- 172.21.15.8:0/3735469150 shutdown_connections 2023-10-14T10:33:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.103+0000 7f286079e640 1 --2- 172.21.15.8:0/3735469150 >> v2:172.21.15.92:3300/0 conn(0x7f28580c5550 0x7f2858154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.103+0000 7f286079e640 1 --2- 172.21.15.8:0/3735469150 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28580c7630 0x7f285806ac40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.103+0000 7f286079e640 1 --2- 172.21.15.8:0/3735469150 >> v2:172.21.15.8:3300/0 conn(0x7f28581515c0 0x7f28580c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.103+0000 7f286079e640 1 -- 172.21.15.8:0/3735469150 >> 172.21.15.8:0/3735469150 conn(0x7f28580c9730 msgr2=0x7f28580c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.104+0000 7f286079e640 1 -- 172.21.15.8:0/3735469150 shutdown_connections 2023-10-14T10:33:57.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.104+0000 7f286079e640 1 -- 172.21.15.8:0/3735469150 wait complete. 2023-10-14T10:33:57.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.108+0000 7f286079e640 1 Processor -- start 2023-10-14T10:33:57.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.108+0000 7f286079e640 1 -- start start 2023-10-14T10:33:57.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.110+0000 7f286079e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28580c5550 0x7f285814e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.110+0000 7f286079e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28580c7630 0x7f28581e9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.110+0000 7f286079e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28581515c0 0x7f285814c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.110+0000 7f286079e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580aae20 con 0x7f28580c5550 2023-10-14T10:33:57.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.110+0000 7f286079e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285814d160 con 0x7f28581515c0 2023-10-14T10:33:57.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.110+0000 7f286079e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285814ce00 con 0x7f28580c7630 2023-10-14T10:33:57.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.112+0000 7f285ed3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28581515c0 0x7f285814c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.112+0000 7f285e53a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28580c5550 0x7f285814e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.112+0000 7f285e53a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28580c5550 0x7f285814e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40538/0 (socket says 172.21.15.8:40538) 2023-10-14T10:33:57.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.112+0000 7f285e53a640 1 -- 172.21.15.8:0/2060742844 learned_addr learned my addr 172.21.15.8:0/2060742844 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:57.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.113+0000 7f285dd39640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28580c7630 0x7f28581e9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.113+0000 7f285e53a640 1 -- 172.21.15.8:0/2060742844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28580c7630 msgr2=0x7f28581e9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.113+0000 7f285e53a640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28580c7630 0x7f28581e9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.113+0000 7f285e53a640 1 -- 172.21.15.8:0/2060742844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28581515c0 msgr2=0x7f285814c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.113+0000 7f285e53a640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28581515c0 0x7f285814c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.114+0000 7f285e53a640 1 -- 172.21.15.8:0/2060742844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2850009b30 con 0x7f28580c5550 2023-10-14T10:33:57.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.115+0000 7f285e53a640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28580c5550 0x7f285814e250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f284800e9b0 tx=0x7f284800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.115+0000 7f284effd640 1 -- 172.21.15.8:0/2060742844 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848009670 con 0x7f28580c5550 2023-10-14T10:33:57.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.116+0000 7f284effd640 1 -- 172.21.15.8:0/2060742844 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284800c9a0 con 0x7f28580c5550 2023-10-14T10:33:57.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.116+0000 7f284effd640 1 -- 172.21.15.8:0/2060742844 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848009670 con 0x7f28580c5550 2023-10-14T10:33:57.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.116+0000 7f286079e640 1 -- 172.21.15.8:0/2060742844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28581e9e50 con 0x7f28580c5550 2023-10-14T10:33:57.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.116+0000 7f286079e640 1 -- 172.21.15.8:0/2060742844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285814ba90 con 0x7f28580c5550 2023-10-14T10:33:57.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.121+0000 7f284effd640 1 -- 172.21.15.8:0/2060742844 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f284800cb10 con 0x7f28580c5550 2023-10-14T10:33:57.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.122+0000 7f284effd640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f283c06aed0 0x7f283c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.123+0000 7f286079e640 1 -- 172.21.15.8:0/2060742844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2858154260 con 0x7f28580c5550 2023-10-14T10:33:57.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.123+0000 7f284effd640 1 -- 172.21.15.8:0/2060742844 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2848089590 con 0x7f28580c5550 2023-10-14T10:33:57.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.124+0000 7f285dd39640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f283c06aed0 0x7f283c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.125+0000 7f285dd39640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f283c06aed0 0x7f283c06d390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f28581467f0 tx=0x7f2854008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.135+0000 7f284effd640 1 -- 172.21.15.8:0/2060742844 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2858154260 con 0x7f28580c5550 2023-10-14T10:33:57.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.143+0000 7f7121a4f640 1 Processor -- start 2023-10-14T10:33:57.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.143+0000 7f7121a4f640 1 -- start start 2023-10-14T10:33:57.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.144+0000 7fda78e1a640 1 Processor -- start 2023-10-14T10:33:57.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.144+0000 7fda78e1a640 1 -- start start 2023-10-14T10:33:57.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.146+0000 7fda78e1a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fda741515c0 0x7fda740c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.145+0000 7f7121a4f640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f711c1515c0 0x7f711c0c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.145+0000 7f7121a4f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f711c0c5550 0x7f711c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.145+0000 7f7121a4f640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711c1545f0 con 0x7f711c0c7630 2023-10-14T10:33:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.145+0000 7f7121a4f640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c0c59d0 con 0x7f711c0c5550 2023-10-14T10:33:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.145+0000 7f7121a4f640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c1519a0 con 0x7f711c1515c0 2023-10-14T10:33:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.146+0000 7f711affd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f711c1515c0 0x7f711c0c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.146+0000 7f711affd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f711c1515c0 0x7f711c0c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:45756/0 (socket says 172.21.15.8:45756) 2023-10-14T10:33:57.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.146+0000 7f711affd640 1 -- 172.21.15.8:0/1675727080 learned_addr learned my addr 172.21.15.8:0/1675727080 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:57.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.146+0000 7fda78e1a640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda741545f0 con 0x7fda74154a80 2023-10-14T10:33:57.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.146+0000 7fda78e1a640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda741519a0 con 0x7fda740c5550 2023-10-14T10:33:57.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.146+0000 7fda78e1a640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda740c59d0 con 0x7fda741515c0 2023-10-14T10:33:57.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.147+0000 7f711affd640 1 -- 172.21.15.8:0/1675727080 >> v2:172.21.15.8:3300/0 conn(0x7f711c0c5550 msgr2=0x7f711c154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.147+0000 7f711affd640 1 --2- 172.21.15.8:0/1675727080 >> v2:172.21.15.8:3300/0 conn(0x7f711c0c5550 0x7f711c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.147+0000 7f711affd640 1 -- 172.21.15.8:0/1675727080 >> v1:172.21.15.92:6789/0 conn(0x7f711c0c7630 legacy=0x7f711c06ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.147+0000 7f711affd640 1 -- 172.21.15.8:0/1675727080 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c06b910 con 0x7f711c1515c0 2023-10-14T10:33:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.147+0000 7fda71d9b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fda740c5550 0x7fda740c7630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:60792/0 (socket says 172.21.15.8:60792) 2023-10-14T10:33:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.147+0000 7fda71d9b640 1 -- 172.21.15.8:0/4178342137 learned_addr learned my addr 172.21.15.8:0/4178342137 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.147+0000 7fda7259c640 1 --2- 172.21.15.8:0/4178342137 >> v2:172.21.15.8:3300/0 conn(0x7fda741515c0 0x7fda740c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.148+0000 7fda7159a640 1 -- 172.21.15.8:0/4178342137 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414873450 0 0) 0x7fda741519a0 con 0x7fda740c5550 2023-10-14T10:33:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.149+0000 7f711affd640 1 --2- 172.21.15.8:0/1675727080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c1515c0 0x7f711c0c4f80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f711c08a710 tx=0x7f711402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9df741502fe78059 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.149+0000 7fda7159a640 1 -- 172.21.15.8:0/4178342137 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda60003520 con 0x7fda740c5550 2023-10-14T10:33:57.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.149+0000 7fda7159a640 1 -- 172.21.15.8:0/4178342137 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768120066 0 0) 0x7fda741545f0 con 0x7fda74154a80 2023-10-14T10:33:57.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.149+0000 7fda7159a640 1 -- 172.21.15.8:0/4178342137 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda741519a0 con 0x7fda74154a80 2023-10-14T10:33:57.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.149+0000 7fda7259c640 1 -- 172.21.15.8:0/4178342137 >> v1:172.21.15.92:6789/0 conn(0x7fda740c5550 legacy=0x7fda740c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.149+0000 7fda7259c640 1 -- 172.21.15.8:0/4178342137 >> v1:172.21.15.8:6789/0 conn(0x7fda74154a80 legacy=0x7fda7406ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.149+0000 7fda7259c640 1 -- 172.21.15.8:0/4178342137 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda740c7d40 con 0x7fda741515c0 2023-10-14T10:33:57.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.150+0000 7f7119ffb640 1 -- 172.21.15.8:0/1675727080 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114031870 con 0x7f711c1515c0 2023-10-14T10:33:57.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.150+0000 7f7119ffb640 1 -- 172.21.15.8:0/1675727080 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71140319d0 con 0x7f711c1515c0 2023-10-14T10:33:57.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.150+0000 7f7119ffb640 1 -- 172.21.15.8:0/1675727080 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114031d60 con 0x7f711c1515c0 2023-10-14T10:33:57.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.151+0000 7f7121a4f640 1 -- 172.21.15.8:0/1675727080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c1515c0 msgr2=0x7f711c0c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.152+0000 7f7121a4f640 1 --2- 172.21.15.8:0/1675727080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c1515c0 0x7f711c0c4f80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f711c08a710 tx=0x7f711402b910 comp rx=0 tx=0).stop 2023-10-14T10:33:57.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.152+0000 7fda7259c640 1 --2- 172.21.15.8:0/4178342137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda741515c0 0x7fda740c4f80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda64009d90 tx=0x7fda6402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2637a20587901 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.152+0000 7fda7159a640 1 -- 172.21.15.8:0/4178342137 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6402cb40 con 0x7fda741515c0 2023-10-14T10:33:57.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.152+0000 7fda7159a640 1 -- 172.21.15.8:0/4178342137 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6402cca0 con 0x7fda741515c0 2023-10-14T10:33:57.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.152+0000 7f7121a4f640 1 -- 172.21.15.8:0/1675727080 shutdown_connections 2023-10-14T10:33:57.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.152+0000 7fda7159a640 1 -- 172.21.15.8:0/4178342137 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64034660 con 0x7fda741515c0 2023-10-14T10:33:57.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.152+0000 7f7121a4f640 1 --2- 172.21.15.8:0/1675727080 >> v2:172.21.15.8:3300/0 conn(0x7f711c0c5550 0x7f711c154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.152+0000 7f7121a4f640 1 --2- 172.21.15.8:0/1675727080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c1515c0 0x7f711c0c4f80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.152+0000 7f7121a4f640 1 -- 172.21.15.8:0/1675727080 >> 172.21.15.8:0/1675727080 conn(0x7f711c0c9730 msgr2=0x7f711c0c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.153+0000 7f7121a4f640 1 -- 172.21.15.8:0/1675727080 shutdown_connections 2023-10-14T10:33:57.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.153+0000 7fda78e1a640 1 -- 172.21.15.8:0/4178342137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda741515c0 msgr2=0x7fda740c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.153+0000 7fda78e1a640 1 --2- 172.21.15.8:0/4178342137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda741515c0 0x7fda740c4f80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda64009d90 tx=0x7fda6402bd90 comp rx=0 tx=0).stop 2023-10-14T10:33:57.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.153+0000 7f7121a4f640 1 -- 172.21.15.8:0/1675727080 wait complete. 2023-10-14T10:33:57.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.154+0000 7fda78e1a640 1 -- 172.21.15.8:0/4178342137 shutdown_connections 2023-10-14T10:33:57.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.154+0000 7fda78e1a640 1 --2- 172.21.15.8:0/4178342137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda741515c0 0x7fda740c4f80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.154+0000 7fda78e1a640 1 -- 172.21.15.8:0/4178342137 >> 172.21.15.8:0/4178342137 conn(0x7fda740c9730 msgr2=0x7fda740c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.155+0000 7f7d4b59e640 1 Processor -- start 2023-10-14T10:33:57.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.155+0000 7fda78e1a640 1 -- 172.21.15.8:0/4178342137 shutdown_connections 2023-10-14T10:33:57.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.155+0000 7f7d4b59e640 1 -- start start 2023-10-14T10:33:57.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.156+0000 7fda78e1a640 1 -- 172.21.15.8:0/4178342137 wait complete. 2023-10-14T10:33:57.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.156+0000 7f7121a4f640 1 Processor -- start 2023-10-14T10:33:57.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.156+0000 7f7121a4f640 1 -- start start 2023-10-14T10:33:57.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.157+0000 7f7d4b59e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7d4400acf0 0x7f7d440d8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.157+0000 7f7d4b59e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d440d8790 0x7f7d440e2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.157+0000 7f7d4b59e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d440314f0 con 0x7f7d440d5900 2023-10-14T10:33:57.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.157+0000 7f7121a4f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0c5550 0x7f711c155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.157+0000 7f7121a4f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f711c0c7630 0x7f711c14c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.157+0000 7f7121a4f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c1515c0 0x7f711c0bab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.158+0000 7f7121a4f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c1570a0 con 0x7f711c0c5550 2023-10-14T10:33:57.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.157+0000 7f7d4b59e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4400b6f0 con 0x7f7d4400acf0 2023-10-14T10:33:57.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.157+0000 7f7d4b59e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44046af0 con 0x7f7d440d8790 2023-10-14T10:33:57.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.158+0000 7f7121a4f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c14b860 con 0x7f711c1515c0 2023-10-14T10:33:57.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.158+0000 7f7121a4f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c14d330 con 0x7f711c0c7630 2023-10-14T10:33:57.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.158+0000 7f7d4a59c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7d440d5900 0x7f7d44006ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46730/0 (socket says 172.21.15.8:46730) 2023-10-14T10:33:57.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.158+0000 7f711affd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0c5550 0x7f711c155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.158+0000 7f7d4a59c640 1 -- 172.21.15.8:0/275047953 learned_addr learned my addr 172.21.15.8:0/275047953 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:57.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f711b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c1515c0 0x7f711c0bab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f711b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c1515c0 0x7f711c0bab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:45770/0 (socket says 172.21.15.8:45770) 2023-10-14T10:33:57.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f711b7fe640 1 -- 172.21.15.8:0/3614497551 learned_addr learned my addr 172.21.15.8:0/3614497551 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:57.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f711a7fc640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f711c0c7630 0x7f711c14c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.158+0000 7f7d49d9b640 1 --2- 172.21.15.8:0/275047953 >> v2:172.21.15.8:3300/0 conn(0x7f7d4400acf0 0x7f7d440d8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f7d4ad9d640 1 --2- 172.21.15.8:0/275047953 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d440d8790 0x7f7d440e2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7fda78e1a640 1 Processor -- start 2023-10-14T10:33:57.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f08e0fb6640 1 Processor -- start 2023-10-14T10:33:57.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f7d4959a640 1 -- 172.21.15.8:0/275047953 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717669678 0 0) 0x7f7d440314f0 con 0x7f7d440d5900 2023-10-14T10:33:57.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f7d4959a640 1 -- 172.21.15.8:0/275047953 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d34003520 con 0x7f7d440d5900 2023-10-14T10:33:57.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f7d49d9b640 1 -- 172.21.15.8:0/275047953 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d440d8790 msgr2=0x7f7d440e2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f7d49d9b640 1 --2- 172.21.15.8:0/275047953 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d440d8790 0x7f7d440e2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f7d49d9b640 1 -- 172.21.15.8:0/275047953 >> v1:172.21.15.8:6789/0 conn(0x7f7d440d5900 legacy=0x7f7d44006ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f7d49d9b640 1 -- 172.21.15.8:0/275047953 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d440d5ce0 con 0x7f7d4400acf0 2023-10-14T10:33:57.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7f08e0fb6640 1 -- start start 2023-10-14T10:33:57.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.159+0000 7fda78e1a640 1 -- start start 2023-10-14T10:33:57.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.160+0000 7f711b7fe640 1 -- 172.21.15.8:0/3614497551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f711c0c7630 msgr2=0x7f711c14c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.160+0000 7f711b7fe640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f711c0c7630 0x7f711c14c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.160+0000 7f711b7fe640 1 -- 172.21.15.8:0/3614497551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0c5550 msgr2=0x7f711c155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.160+0000 7f711b7fe640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0c5550 0x7f711c155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.160+0000 7f711b7fe640 1 -- 172.21.15.8:0/3614497551 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71140094d0 con 0x7f711c1515c0 2023-10-14T10:33:57.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.160+0000 7f711affd640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0c5550 0x7f711c155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:33:57.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.161+0000 7f711b7fe640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c1515c0 0x7f711c0bab30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7104001eb0 tx=0x7f710400c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.161+0000 7f86988fc640 1 Processor -- start 2023-10-14T10:33:57.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.161+0000 7f7d49d9b640 1 --2- 172.21.15.8:0/275047953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4400acf0 0x7f7d440d8250 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7d400097a0 tx=0x7f7d4002b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206fa8be83a0e723 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.162+0000 7f7d4959a640 1 -- 172.21.15.8:0/275047953 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d400316f0 con 0x7f7d4400acf0 2023-10-14T10:33:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.162+0000 7f86988fc640 1 -- start start 2023-10-14T10:33:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.162+0000 7f7d4959a640 1 -- 172.21.15.8:0/275047953 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d40031850 con 0x7f7d4400acf0 2023-10-14T10:33:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.162+0000 7f7d4959a640 1 -- 172.21.15.8:0/275047953 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40031bc0 con 0x7f7d4400acf0 2023-10-14T10:33:57.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.162+0000 7fda78e1a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda740c5550 0x7fda741571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.162+0000 7f08e0fb6640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08dc151590 0x7f08dc155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.162+0000 7f08e0fb6640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08dc154a00 0x7f08dc157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.162+0000 7fda78e1a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda741515c0 0x7fda741f3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.162+0000 7fda78e1a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda74154a80 0x7fda7414bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.162+0000 7f08da59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08dc151590 0x7f08dc155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.162+0000 7f08da59c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08dc151590 0x7f08dc155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40590/0 (socket says 172.21.15.8:40590) 2023-10-14T10:33:57.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.162+0000 7f08d9d9b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08dc154a00 0x7f08dc157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7fda78e1a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7414c110 con 0x7fda74154a80 2023-10-14T10:33:57.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7fda78e1a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda74157830 con 0x7fda740c5550 2023-10-14T10:33:57.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7fda78e1a640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda74158040 con 0x7fda741515c0 2023-10-14T10:33:57.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7f7d4b59e640 1 -- 172.21.15.8:0/275047953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4400acf0 msgr2=0x7f7d440d8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7f7d4b59e640 1 --2- 172.21.15.8:0/275047953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4400acf0 0x7f7d440d8250 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7d400097a0 tx=0x7f7d4002b790 comp rx=0 tx=0).stop 2023-10-14T10:33:57.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7f72f4ac2640 1 Processor -- start 2023-10-14T10:33:57.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7f72f4ac2640 1 -- start start 2023-10-14T10:33:57.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7fda72d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda74154a80 0x7fda7414bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7fda72d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda74154a80 0x7fda7414bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40592/0 (socket says 172.21.15.8:40592) 2023-10-14T10:33:57.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7fda72d9d640 1 -- 172.21.15.8:0/3391485524 learned_addr learned my addr 172.21.15.8:0/3391485524 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:57.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f7d4b59e640 1 -- 172.21.15.8:0/275047953 shutdown_connections 2023-10-14T10:33:57.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f7d4b59e640 1 --2- 172.21.15.8:0/275047953 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d440d8790 0x7f7d440e2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f7d4b59e640 1 --2- 172.21.15.8:0/275047953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4400acf0 0x7f7d440d8250 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f7d4b59e640 1 -- 172.21.15.8:0/275047953 >> 172.21.15.8:0/275047953 conn(0x7f7d44048340 msgr2=0x7f7d44048750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7f86988fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8694151590 0x7f8694155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f86988fc640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86940ca6c0 con 0x7f86940c4210 2023-10-14T10:33:57.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f86988fc640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8694157a10 con 0x7f8694154a00 2023-10-14T10:33:57.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f86988fc640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86940c4f70 con 0x7f8694151590 2023-10-14T10:33:57.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f7d4b59e640 1 -- 172.21.15.8:0/275047953 shutdown_connections 2023-10-14T10:33:57.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f7113fff640 1 -- 172.21.15.8:0/3614497551 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040052d0 con 0x7f711c1515c0 2023-10-14T10:33:57.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f7113fff640 1 -- 172.21.15.8:0/3614497551 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7104005430 con 0x7f711c1515c0 2023-10-14T10:33:57.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f7113fff640 1 -- 172.21.15.8:0/3614497551 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7104003810 con 0x7f711c1515c0 2023-10-14T10:33:57.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7f08dad9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f08dc0c4210 0x7f08dc0c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46740/0 (socket says 172.21.15.8:46740) 2023-10-14T10:33:57.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7f08dad9d640 1 -- 172.21.15.8:0/49408204 learned_addr learned my addr 172.21.15.8:0/49408204 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:57.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7f08e0fb6640 1 -- 172.21.15.8:0/49408204 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08dc0ca6c0 con 0x7f08dc0c4210 2023-10-14T10:33:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7f08e0fb6640 1 -- 172.21.15.8:0/49408204 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08dc0c4f70 con 0x7f08dc151590 2023-10-14T10:33:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7f08e0fb6640 1 -- 172.21.15.8:0/49408204 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc157a10 con 0x7f08dc154a00 2023-10-14T10:33:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f08da59c640 1 -- 172.21.15.8:0/49408204 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08dc154a00 msgr2=0x7f08dc157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f08da59c640 1 --2- 172.21.15.8:0/49408204 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08dc154a00 0x7f08dc157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f08da59c640 1 -- 172.21.15.8:0/49408204 >> v1:172.21.15.8:6789/0 conn(0x7f08dc0c4210 legacy=0x7f08dc0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f08d959a640 1 -- 172.21.15.8:0/49408204 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676734881 0 0) 0x7f08dc0ca6c0 con 0x7f08dc0c4210 2023-10-14T10:33:57.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f08da59c640 1 -- 172.21.15.8:0/49408204 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc06c8f0 con 0x7f08dc151590 2023-10-14T10:33:57.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.163+0000 7fda7259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda740c5550 0x7fda741571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7f7121a4f640 1 -- 172.21.15.8:0/3614497551 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c14d610 con 0x7f711c1515c0 2023-10-14T10:33:57.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f8691d9b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8694154a00 0x7f8694157ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:60794/0 (socket says 172.21.15.8:60794) 2023-10-14T10:33:57.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f8691d9b640 1 -- 172.21.15.8:0/2577591197 learned_addr learned my addr 172.21.15.8:0/2577591197 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:57.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7f7121a4f640 1 -- 172.21.15.8:0/3614497551 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c14baf0 con 0x7f711c1515c0 2023-10-14T10:33:57.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751778231 0 0) 0x7f8694157a10 con 0x7f8694154a00 2023-10-14T10:33:57.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f867c003520 con 0x7f8694154a00 2023-10-14T10:33:57.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7fda7259c640 1 -- 172.21.15.8:0/3391485524 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda741515c0 msgr2=0x7fda741f3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7fda7259c640 1 --2- 172.21.15.8:0/3391485524 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda741515c0 0x7fda741f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7fda7259c640 1 -- 172.21.15.8:0/3391485524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda74154a80 msgr2=0x7fda7414bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7f72f4ac2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f72f00c4210 0x7f72f00c4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7f72f4ac2640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f00ca6c0 con 0x7f72f0155470 2023-10-14T10:33:57.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7f72f4ac2640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f0157a10 con 0x7f72f0151590 2023-10-14T10:33:57.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7f72f4ac2640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f00c4f70 con 0x7f72f00c4210 2023-10-14T10:33:57.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7fda7259c640 1 --2- 172.21.15.8:0/3391485524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda74154a80 0x7fda7414bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.165+0000 7fda7259c640 1 -- 172.21.15.8:0/3391485524 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda64009a70 con 0x7fda740c5550 2023-10-14T10:33:57.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.166+0000 7fda7259c640 1 --2- 172.21.15.8:0/3391485524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda740c5550 0x7fda741571d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fda64033000 tx=0x7fda64004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.166+0000 7f869259c640 1 --2- 172.21.15.8:0/2577591197 >> v2:172.21.15.8:3300/0 conn(0x7f8694151590 0x7f8694155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.166+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 <== mon.1 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 471466520 0 0) 0x7f867c003520 con 0x7f8694154a00 2023-10-14T10:33:57.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.166+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 >> v2:172.21.15.8:3300/0 conn(0x7f8694151590 msgr2=0x7f8694155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.164+0000 7f7d4b59e640 1 -- 172.21.15.8:0/275047953 wait complete. 2023-10-14T10:33:57.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f7d4b59e640 1 Processor -- start 2023-10-14T10:33:57.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f869159a640 1 --2- 172.21.15.8:0/2577591197 >> v2:172.21.15.8:3300/0 conn(0x7f8694151590 0x7f8694155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7fda6affd640 1 -- 172.21.15.8:0/3391485524 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6403f420 con 0x7fda740c5550 2023-10-14T10:33:57.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7fda78e1a640 1 -- 172.21.15.8:0/3391485524 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7414c870 con 0x7fda740c5550 2023-10-14T10:33:57.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7fda6affd640 1 -- 172.21.15.8:0/3391485524 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6403f580 con 0x7fda740c5550 2023-10-14T10:33:57.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f7121a4f640 1 -- 172.21.15.8:0/3614497551 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7100005250 con 0x7f711c1515c0 2023-10-14T10:33:57.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f7d4b59e640 1 -- start start 2023-10-14T10:33:57.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 >> v1:172.21.15.8:6789/0 conn(0x7f86940c4210 legacy=0x7f869415e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869406c8f0 con 0x7f8694154a00 2023-10-14T10:33:57.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 <== mon.1 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f8688001670 con 0x7f8694154a00 2023-10-14T10:33:57.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f72edd9b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f72f0155470 0x7f72f0157ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46768/0 (socket says 172.21.15.8:46768) 2023-10-14T10:33:57.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f72edd9b640 1 -- 172.21.15.8:0/4013695535 learned_addr learned my addr 172.21.15.8:0/4013695535 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:57.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7fda6affd640 1 -- 172.21.15.8:0/3391485524 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6403f420 con 0x7fda740c5550 2023-10-14T10:33:57.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7fda78e1a640 1 -- 172.21.15.8:0/3391485524 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda74157d60 con 0x7fda740c5550 2023-10-14T10:33:57.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 >> v1:172.21.15.92:6789/0 conn(0x7f8694154a00 legacy=0x7f8694157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f869159a640 1 --2- 172.21.15.8:0/2577591197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f867c003970 0x7f867c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f869159a640 1 --2- 172.21.15.8:0/2577591197 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f867c0047c0 0x7f867c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f869159a640 1 --2- 172.21.15.8:0/2577591197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f867c0052a0 0x7f867c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c00c1c0 con 0x7f867c0052a0 2023-10-14T10:33:57.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c00c330 con 0x7f867c003970 2023-10-14T10:33:57.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c00c4f0 con 0x7f867c0047c0 2023-10-14T10:33:57.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f869259c640 1 --2- 172.21.15.8:0/2577591197 >> v2:172.21.15.8:3300/0 conn(0x7f8694151590 0x7f8694155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:57.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.167+0000 7f08da59c640 1 --2- 172.21.15.8:0/49408204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08dc151590 0x7f08dc155470 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0097a0 tx=0x7f08cc02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e477c8b8d65a2b51 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.168+0000 7f869259c640 1 --2- 172.21.15.8:0/2577591197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f867c003970 0x7f867c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.168+0000 7f8691d9b640 1 --2- 172.21.15.8:0/2577591197 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f867c0047c0 0x7f867c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.168+0000 7f72eed9d640 1 --2- 172.21.15.8:0/4013695535 >> v2:172.21.15.92:3300/0 conn(0x7f72f00c4210 0x7f72f00c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.168+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640266593 0 0) 0x7f72f00ca6c0 con 0x7f72f0155470 2023-10-14T10:33:57.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.168+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72d8003520 con 0x7f72f0155470 2023-10-14T10:33:57.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2090912902 0 0) 0x7f72d8003520 con 0x7f72f0155470 2023-10-14T10:33:57.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 >> v2:172.21.15.92:3300/0 conn(0x7f72f00c4210 msgr2=0x7f72f00c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 --2- 172.21.15.8:0/4013695535 >> v2:172.21.15.92:3300/0 conn(0x7f72f00c4210 0x7f72f00c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 >> v1:172.21.15.92:6789/0 conn(0x7f72f0151590 legacy=0x7f72f0154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.168+0000 7f7d4b59e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4400acf0 0x7f7d440cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.168+0000 7f7d4b59e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d440d5900 0x7f7d440d6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.168+0000 7f7d4b59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d440d8790 0x7f7d440db620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f7d4b59e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4402eaf0 con 0x7f7d4400acf0 2023-10-14T10:33:57.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f7d4b59e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4402e810 con 0x7f7d440d8790 2023-10-14T10:33:57.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f7d4b59e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44174410 con 0x7f7d440d5900 2023-10-14T10:33:57.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f01558b0 con 0x7f72f0155470 2023-10-14T10:33:57.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f72e0001670 con 0x7f72f0155470 2023-10-14T10:33:57.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 >> v1:172.21.15.8:6789/0 conn(0x7f72f0155470 legacy=0x7f72f0157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7fda78e1a640 1 -- 172.21.15.8:0/3391485524 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda58005250 con 0x7fda740c5550 2023-10-14T10:33:57.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 --2- 172.21.15.8:0/4013695535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72d8003970 0x7f72d8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 --2- 172.21.15.8:0/4013695535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72d80047c0 0x7f72d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 --2- 172.21.15.8:0/4013695535 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f72d80051f0 0x7f72d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d800c120 con 0x7f72d8003970 2023-10-14T10:33:57.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d800c290 con 0x7f72d80047c0 2023-10-14T10:33:57.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d800c450 con 0x7f72d80051f0 2023-10-14T10:33:57.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.170+0000 7f7d4ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d440d8790 0x7f7d440db620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.170+0000 7f7d4ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d440d8790 0x7f7d440db620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:45822/0 (socket says 172.21.15.8:45822) 2023-10-14T10:33:57.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.170+0000 7f7d4ad9d640 1 -- 172.21.15.8:0/3313384584 learned_addr learned my addr 172.21.15.8:0/3313384584 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:57.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.170+0000 7f7d49d9b640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d440d5900 0x7f7d440d6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.170+0000 7f7d4a59c640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4400acf0 0x7f7d440cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f869259c640 1 -- 172.21.15.8:0/2577591197 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f867c0047c0 msgr2=0x7f867c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f869259c640 1 --2- 172.21.15.8:0/2577591197 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f867c0047c0 0x7f867c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f869259c640 1 -- 172.21.15.8:0/2577591197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f867c0052a0 msgr2=0x7f867c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.169+0000 7f869259c640 1 --2- 172.21.15.8:0/2577591197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f867c0052a0 0x7f867c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.170+0000 7f08d959a640 1 -- 172.21.15.8:0/49408204 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc031520 con 0x7f08dc151590 2023-10-14T10:33:57.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.170+0000 7f08d959a640 1 -- 172.21.15.8:0/49408204 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc031680 con 0x7f08dc151590 2023-10-14T10:33:57.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.170+0000 7f08d959a640 1 -- 172.21.15.8:0/49408204 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc031a50 con 0x7f08dc151590 2023-10-14T10:33:57.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.170+0000 7f869259c640 1 -- 172.21.15.8:0/2577591197 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869406c8f0 con 0x7f867c003970 2023-10-14T10:33:57.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.170+0000 7f72ee59c640 1 --2- 172.21.15.8:0/4013695535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72d8003970 0x7f72d8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.170+0000 7f72edd9b640 1 --2- 172.21.15.8:0/4013695535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72d80047c0 0x7f72d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f7113fff640 1 -- 172.21.15.8:0/3614497551 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7104003970 con 0x7f711c1515c0 2023-10-14T10:33:57.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f8692d9d640 1 -- 172.21.15.8:0/2577591197 reap_dead start 2023-10-14T10:33:57.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f72eed9d640 1 --2- 172.21.15.8:0/4013695535 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f72d80051f0 0x7f72d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f08e0fb6640 1 -- 172.21.15.8:0/49408204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08dc151590 msgr2=0x7f08dc155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f08e0fb6640 1 --2- 172.21.15.8:0/49408204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08dc151590 0x7f08dc155470 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0097a0 tx=0x7f08cc02b7c0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f7d4a59c640 1 -- 172.21.15.8:0/3313384584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d440d5900 msgr2=0x7f7d440d6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f7d4a59c640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d440d5900 0x7f7d440d6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f7d4a59c640 1 -- 172.21.15.8:0/3313384584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d440d8790 msgr2=0x7f7d440db620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f7d4a59c640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d440d8790 0x7f7d440db620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f7d4a59c640 1 -- 172.21.15.8:0/3313384584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d40009400 con 0x7f7d4400acf0 2023-10-14T10:33:57.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f08e0fb6640 1 -- 172.21.15.8:0/49408204 shutdown_connections 2023-10-14T10:33:57.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f7d4a59c640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4400acf0 0x7f7d440cdf40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c061980 tx=0x7f7d4c067230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.171+0000 7f08e0fb6640 1 --2- 172.21.15.8:0/49408204 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08dc154a00 0x7f08dc157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f08e0fb6640 1 --2- 172.21.15.8:0/49408204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08dc151590 0x7f08dc155470 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f72edd9b640 1 -- 172.21.15.8:0/4013695535 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f72d80051f0 msgr2=0x7f72d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f72edd9b640 1 --2- 172.21.15.8:0/4013695535 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f72d80051f0 0x7f72d800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f72edd9b640 1 -- 172.21.15.8:0/4013695535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72d8003970 msgr2=0x7f72d8003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f08e0fb6640 1 -- 172.21.15.8:0/49408204 >> 172.21.15.8:0/49408204 conn(0x7f08dc065ed0 msgr2=0x7f08dc0662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f72edd9b640 1 --2- 172.21.15.8:0/4013695535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72d8003970 0x7f72d8003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f72edd9b640 1 -- 172.21.15.8:0/4013695535 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f01558b0 con 0x7f72d80047c0 2023-10-14T10:33:57.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f72eed9d640 1 -- 172.21.15.8:0/4013695535 reap_dead start 2023-10-14T10:33:57.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f72ee59c640 1 --2- 172.21.15.8:0/4013695535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72d8003970 0x7f72d8003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:33:57.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f7d3affd640 1 -- 172.21.15.8:0/3313384584 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0723d0 con 0x7f7d4400acf0 2023-10-14T10:33:57.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f7d3affd640 1 -- 172.21.15.8:0/3313384584 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0737f0 con 0x7f7d4400acf0 2023-10-14T10:33:57.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f7d3affd640 1 -- 172.21.15.8:0/3313384584 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c073a20 con 0x7f7d4400acf0 2023-10-14T10:33:57.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f7113fff640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f70fc06aec0 0x7f70fc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f869259c640 1 --2- 172.21.15.8:0/2577591197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f867c003970 0x7f867c003d70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8684006fd0 tx=0x7f867c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6727f6e8c4e80ac3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f08e0fb6640 1 -- 172.21.15.8:0/49408204 shutdown_connections 2023-10-14T10:33:57.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f08e0fb6640 1 -- 172.21.15.8:0/49408204 wait complete. 2023-10-14T10:33:57.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.172+0000 7f7113fff640 1 -- 172.21.15.8:0/3614497551 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7104088d40 con 0x7f711c1515c0 2023-10-14T10:33:57.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.173+0000 7f711affd640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f70fc06aec0 0x7f70fc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.173+0000 7f7d4b59e640 1 -- 172.21.15.8:0/3313384584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d441746f0 con 0x7f7d4400acf0 2023-10-14T10:33:57.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.173+0000 7f7d4b59e640 1 -- 172.21.15.8:0/3313384584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d440d8240 con 0x7f7d4400acf0 2023-10-14T10:33:57.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.173+0000 7f3844a1f640 1 Processor -- start 2023-10-14T10:33:57.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.174+0000 7f72edd9b640 1 --2- 172.21.15.8:0/4013695535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72d80047c0 0x7f72d8004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c290 tx=0x7f72d80057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5340a6d426101146 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.174+0000 7f3844a1f640 1 -- start start 2023-10-14T10:33:57.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.174+0000 7f711affd640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f70fc06aec0 0x7f70fc06d380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7114036000 tx=0x7f711403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.174+0000 7f7d4b59e640 1 -- 172.21.15.8:0/3313384584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4400a660 con 0x7f7d4400acf0 2023-10-14T10:33:57.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.175+0000 7f08e0fb6640 1 Processor -- start 2023-10-14T10:33:57.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.175+0000 7f7d3affd640 1 -- 172.21.15.8:0/3313384584 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7d4c0923c0 con 0x7f7d4400acf0 2023-10-14T10:33:57.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.175+0000 7f08e0fb6640 1 -- start start 2023-10-14T10:33:57.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.176+0000 7f7d3affd640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7d2c06aec0 0x7f7d2c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.176+0000 7f3844a1f640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f384006f9e0 0x7f38400ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.176+0000 7f3844a1f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f38400acd10 0x7f384006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.176+0000 7f3844a1f640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38400c2090 con 0x7f38400c3e60 2023-10-14T10:33:57.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.176+0000 7f3844a1f640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38400c25c0 con 0x7f38400acd10 2023-10-14T10:33:57.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.176+0000 7f3844a1f640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38400c4950 con 0x7f384006f9e0 2023-10-14T10:33:57.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.176+0000 7f383e59c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f38400c3e60 0x7f38400c4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:60814/0 (socket says 172.21.15.8:60814) 2023-10-14T10:33:57.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.176+0000 7f383e59c640 1 -- 172.21.15.8:0/2696298805 learned_addr learned my addr 172.21.15.8:0/2696298805 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:57.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.176+0000 7f383ed9d640 1 --2- 172.21.15.8:0/2696298805 >> v2:172.21.15.8:3300/0 conn(0x7f38400acd10 0x7f384006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.176+0000 7f7d3affd640 1 -- 172.21.15.8:0/3313384584 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d4c102b10 con 0x7f7d4400acf0 2023-10-14T10:33:57.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.177+0000 7f08e0fb6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08dc0c4210 0x7f08dc0ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.177+0000 7f08e0fb6640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08dc151590 0x7f08dc0be9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.177+0000 7f383dd9b640 1 --2- 172.21.15.8:0/2696298805 >> v2:172.21.15.92:3300/0 conn(0x7f384006f9e0 0x7f38400ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.177+0000 7f08e0fb6640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08dc154a00 0x7f08dc0beee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.177+0000 7f08e0fb6640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0a9280 con 0x7f08dc154a00 2023-10-14T10:33:57.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.177+0000 7f08e0fb6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0bf420 con 0x7f08dc0c4210 2023-10-14T10:33:57.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.177+0000 7f08e0fb6640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0abf70 con 0x7f08dc151590 2023-10-14T10:33:57.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.177+0000 7f7d49d9b640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7d2c06aec0 0x7f7d2c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.177+0000 7f08dad9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08dc154a00 0x7f08dc0beee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.177+0000 7f383dd9b640 1 -- 172.21.15.8:0/2696298805 >> v2:172.21.15.8:3300/0 conn(0x7f38400acd10 msgr2=0x7f384006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f383dd9b640 1 --2- 172.21.15.8:0/2696298805 >> v2:172.21.15.8:3300/0 conn(0x7f38400acd10 0x7f384006e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f383dd9b640 1 -- 172.21.15.8:0/2696298805 >> v1:172.21.15.92:6789/0 conn(0x7f38400c3e60 legacy=0x7f38400c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f383dd9b640 1 -- 172.21.15.8:0/2696298805 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3840152a90 con 0x7f384006f9e0 2023-10-14T10:33:57.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f383ed9d640 1 --2- 172.21.15.8:0/2696298805 >> v2:172.21.15.8:3300/0 conn(0x7f38400acd10 0x7f384006e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:33:57.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f7d49d9b640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7d2c06aec0 0x7f7d2c06d380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7d40036000 tx=0x7f7d40008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.177+0000 7f08da59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08dc0c4210 0x7f08dc0ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f08da59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08dc0c4210 0x7f08dc0ab6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:45834/0 (socket says 172.21.15.8:45834) 2023-10-14T10:33:57.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f08da59c640 1 -- 172.21.15.8:0/2987766696 learned_addr learned my addr 172.21.15.8:0/2987766696 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:57.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.177+0000 7f08dad9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08dc154a00 0x7f08dc0beee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40642/0 (socket says 172.21.15.8:40642) 2023-10-14T10:33:57.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f08d9d9b640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08dc151590 0x7f08dc0be9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f08dad9d640 1 -- 172.21.15.8:0/2987766696 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08dc151590 msgr2=0x7f08dc0be9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f08dad9d640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08dc151590 0x7f08dc0be9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f08dad9d640 1 -- 172.21.15.8:0/2987766696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08dc0c4210 msgr2=0x7f08dc0ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f08dad9d640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08dc0c4210 0x7f08dc0ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.178+0000 7f08dad9d640 1 -- 172.21.15.8:0/2987766696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc009400 con 0x7f08dc154a00 2023-10-14T10:33:57.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.179+0000 7f08dad9d640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08dc154a00 0x7f08dc0beee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c410 tx=0x7f08d000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.180+0000 7f383dd9b640 1 --2- 172.21.15.8:0/2696298805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f384006f9e0 0x7f38400ac7d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38400700f0 tx=0x7f383402b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=236216f36c19a2d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.181+0000 7f08caffd640 1 -- 172.21.15.8:0/2987766696 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d00074e0 con 0x7f08dc154a00 2023-10-14T10:33:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.181+0000 7f08caffd640 1 -- 172.21.15.8:0/2987766696 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d0007640 con 0x7f08dc154a00 2023-10-14T10:33:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.181+0000 7f08caffd640 1 -- 172.21.15.8:0/2987766696 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0004a20 con 0x7f08dc154a00 2023-10-14T10:33:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.181+0000 7f08e0fb6640 1 -- 172.21.15.8:0/2987766696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08dc0ac250 con 0x7f08dc154a00 2023-10-14T10:33:57.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.181+0000 7f08e0fb6640 1 -- 172.21.15.8:0/2987766696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08dc1e9d50 con 0x7f08dc154a00 2023-10-14T10:33:57.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.181+0000 7f7d3affd640 1 -- 172.21.15.8:0/3313384584 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7d4c0cdc50 con 0x7f7d4400acf0 2023-10-14T10:33:57.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.183+0000 7f08e0fb6640 1 -- 172.21.15.8:0/2987766696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08dc0a9430 con 0x7f08dc154a00 2023-10-14T10:33:57.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.184+0000 7f08caffd640 1 -- 172.21.15.8:0/2987766696 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f08d0004b80 con 0x7f08dc154a00 2023-10-14T10:33:57.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.185+0000 7f08caffd640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f08bc06af40 0x7f08bc06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.185+0000 7f08caffd640 1 -- 172.21.15.8:0/2987766696 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08d0089210 con 0x7f08dc154a00 2023-10-14T10:33:57.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.185+0000 7f08da59c640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f08bc06af40 0x7f08bc06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.186+0000 7f08da59c640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f08bc06af40 0x7f08bc06d400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f08cc000c00 tx=0x7f08cc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.188+0000 7f7113fff640 1 -- 172.21.15.8:0/3614497551 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7104053e80 con 0x7f711c1515c0 2023-10-14T10:33:57.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.188+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684034d20 con 0x7f867c003970 2023-10-14T10:33:57.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.188+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0005ad0 con 0x7f72d80047c0 2023-10-14T10:33:57.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.188+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8684034e80 con 0x7f867c003970 2023-10-14T10:33:57.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.188+0000 7f869159a640 1 -- 172.21.15.8:0/2577591197 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684004230 con 0x7f867c003970 2023-10-14T10:33:57.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.189+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e0005c30 con 0x7f72d80047c0 2023-10-14T10:33:57.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.189+0000 7f72ed59a640 1 -- 172.21.15.8:0/4013695535 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e002c8b0 con 0x7f72d80047c0 2023-10-14T10:33:57.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.189+0000 7f86988fc640 1 -- 172.21.15.8:0/2577591197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f867c003970 msgr2=0x7f867c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.189+0000 7f86988fc640 1 --2- 172.21.15.8:0/2577591197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f867c003970 0x7f867c003d70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8684006fd0 tx=0x7f867c0057f0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.189+0000 7f72f4ac2640 1 -- 172.21.15.8:0/4013695535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72d80047c0 msgr2=0x7f72d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.189+0000 7f72f4ac2640 1 --2- 172.21.15.8:0/4013695535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72d80047c0 0x7f72d8004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c290 tx=0x7f72d80057f0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.189+0000 7f86988fc640 1 -- 172.21.15.8:0/2577591197 shutdown_connections 2023-10-14T10:33:57.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.189+0000 7f86988fc640 1 --2- 172.21.15.8:0/2577591197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f867c003970 0x7f867c003d70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.189+0000 7f86988fc640 1 -- 172.21.15.8:0/2577591197 >> 172.21.15.8:0/2577591197 conn(0x7f8694065ed0 msgr2=0x7f86940662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.190+0000 7f86988fc640 1 -- 172.21.15.8:0/2577591197 shutdown_connections 2023-10-14T10:33:57.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7f86988fc640 1 -- 172.21.15.8:0/2577591197 wait complete. 2023-10-14T10:33:57.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7fda6affd640 1 -- 172.21.15.8:0/3391485524 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fda6403f6f0 con 0x7fda740c5550 2023-10-14T10:33:57.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.190+0000 7f383d59a640 1 -- 172.21.15.8:0/2696298805 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834031740 con 0x7f384006f9e0 2023-10-14T10:33:57.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.190+0000 7f383d59a640 1 -- 172.21.15.8:0/2696298805 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38340318a0 con 0x7f384006f9e0 2023-10-14T10:33:57.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.190+0000 7f383d59a640 1 -- 172.21.15.8:0/2696298805 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834031c70 con 0x7f384006f9e0 2023-10-14T10:33:57.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7f3844a1f640 1 -- 172.21.15.8:0/2696298805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f384006f9e0 msgr2=0x7f38400ac7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7f3844a1f640 1 --2- 172.21.15.8:0/2696298805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f384006f9e0 0x7f38400ac7d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38400700f0 tx=0x7f383402b7e0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7f3844a1f640 1 -- 172.21.15.8:0/2696298805 shutdown_connections 2023-10-14T10:33:57.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7f3844a1f640 1 --2- 172.21.15.8:0/2696298805 >> v2:172.21.15.8:3300/0 conn(0x7f38400acd10 0x7f384006e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7f3844a1f640 1 --2- 172.21.15.8:0/2696298805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f384006f9e0 0x7f38400ac7d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7f3844a1f640 1 -- 172.21.15.8:0/2696298805 >> 172.21.15.8:0/2696298805 conn(0x7f38400a9280 msgr2=0x7f38400a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7f3844a1f640 1 -- 172.21.15.8:0/2696298805 shutdown_connections 2023-10-14T10:33:57.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7f3844a1f640 1 -- 172.21.15.8:0/2696298805 wait complete. 2023-10-14T10:33:57.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7f72f4ac2640 1 -- 172.21.15.8:0/4013695535 shutdown_connections 2023-10-14T10:33:57.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.192+0000 7fda6affd640 1 --2- 172.21.15.8:0/3391485524 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fda5406aed0 0x7fda5406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.192+0000 7fda6affd640 1 -- 172.21.15.8:0/3391485524 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda640abf80 con 0x7fda740c5550 2023-10-14T10:33:57.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7f72f4ac2640 1 --2- 172.21.15.8:0/4013695535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72d80047c0 0x7f72d8004c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.191+0000 7f72f4ac2640 1 -- 172.21.15.8:0/4013695535 >> 172.21.15.8:0/4013695535 conn(0x7f72f0065ed0 msgr2=0x7f72f00662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.192+0000 7f72f4ac2640 1 -- 172.21.15.8:0/4013695535 shutdown_connections 2023-10-14T10:33:57.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.192+0000 7f72f4ac2640 1 -- 172.21.15.8:0/4013695535 wait complete. 2023-10-14T10:33:57.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.193+0000 7f86988fc640 1 Processor -- start 2023-10-14T10:33:57.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.194+0000 7fda71d9b640 1 --2- 172.21.15.8:0/3391485524 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fda5406aed0 0x7fda5406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.194+0000 7f3844a1f640 1 Processor -- start 2023-10-14T10:33:57.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.194+0000 7f3844a1f640 1 -- start start 2023-10-14T10:33:57.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.194+0000 7f72f4ac2640 1 Processor -- start 2023-10-14T10:33:57.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.194+0000 7f72f4ac2640 1 -- start start 2023-10-14T10:33:57.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.194+0000 7f08caffd640 1 -- 172.21.15.8:0/2987766696 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08dc0a9430 con 0x7f08dc154a00 2023-10-14T10:33:57.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.194+0000 7f86988fc640 1 -- start start 2023-10-14T10:33:57.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.195+0000 7fda71d9b640 1 --2- 172.21.15.8:0/3391485524 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fda5406aed0 0x7fda5406d390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda6c007fd0 tx=0x7fda6c007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.195+0000 7f3844a1f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384006f9e0 0x7f38400a7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.195+0000 7f3844a1f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38400acd10 0x7f384014ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.195+0000 7f3844a1f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38400c3e60 0x7f384014d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.195+0000 7f3844a1f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38400bfee0 con 0x7f384006f9e0 2023-10-14T10:33:57.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.195+0000 7f3844a1f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38400be9f0 con 0x7f38400c3e60 2023-10-14T10:33:57.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.195+0000 7f3844a1f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38400becd0 con 0x7f38400acd10 2023-10-14T10:33:57.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f72f4ac2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f72d80047c0 0x7f72f00bca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f72f4ac2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72f00c04f0 0x7f72f01f9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f72f4ac2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72f00aeb90 0x7f72f00af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f72f4ac2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f01fa320 con 0x7f72f00aeb90 2023-10-14T10:33:57.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f72f4ac2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f00abef0 con 0x7f72f00c04f0 2023-10-14T10:33:57.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f72f4ac2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f00bc750 con 0x7f72d80047c0 2023-10-14T10:33:57.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f86988fc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f867c003970 0x7f8694147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f86988fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86941e8bc0 0x7f8694153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f86988fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8694153990 0x7f86941e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f86988fc640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86941e4c90 con 0x7f86941e8bc0 2023-10-14T10:33:57.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f86988fc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86940abaa0 con 0x7f8694153990 2023-10-14T10:33:57.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f86988fc640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86941e4f30 con 0x7f867c003970 2023-10-14T10:33:57.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f383e59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384006f9e0 0x7f38400a7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f8691d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86941e8bc0 0x7f8694153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f383e59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384006f9e0 0x7f38400a7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40656/0 (socket says 172.21.15.8:40656) 2023-10-14T10:33:57.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.196+0000 7f383e59c640 1 -- 172.21.15.8:0/4288247425 learned_addr learned my addr 172.21.15.8:0/4288247425 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:57.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.197+0000 7f8691d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86941e8bc0 0x7f8694153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40668/0 (socket says 172.21.15.8:40668) 2023-10-14T10:33:57.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.197+0000 7f8691d9b640 1 -- 172.21.15.8:0/1876568015 learned_addr learned my addr 172.21.15.8:0/1876568015 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:57.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.197+0000 7f869259c640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f867c003970 0x7f8694147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.197+0000 7f383dd9b640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38400acd10 0x7f384014ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.197+0000 7f72edd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72f00c04f0 0x7f72f01f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.197+0000 7f8692d9d640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8694153990 0x7f86941e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.197+0000 7f72edd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72f00c04f0 0x7f72f01f9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:45868/0 (socket says 172.21.15.8:45868) 2023-10-14T10:33:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.197+0000 7f72edd9b640 1 -- 172.21.15.8:0/1823594588 learned_addr learned my addr 172.21.15.8:0/1823594588 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.197+0000 7f383ed9d640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38400c3e60 0x7f384014d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.197+0000 7f72ee59c640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f72d80047c0 0x7f72f00bca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.197+0000 7f72eed9d640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72f00aeb90 0x7f72f00af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.198+0000 7f72edd9b640 1 -- 172.21.15.8:0/1823594588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f72d80047c0 msgr2=0x7f72f00bca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.198+0000 7f72edd9b640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f72d80047c0 0x7f72f00bca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.198+0000 7f72edd9b640 1 -- 172.21.15.8:0/1823594588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72f00aeb90 msgr2=0x7f72f00af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.198+0000 7f72edd9b640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72f00aeb90 0x7f72f00af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.198+0000 7f72edd9b640 1 -- 172.21.15.8:0/1823594588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f01fa040 con 0x7f72f00c04f0 2023-10-14T10:33:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.198+0000 7f8691d9b640 1 -- 172.21.15.8:0/1876568015 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f867c003970 msgr2=0x7f8694147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.198+0000 7f8691d9b640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f867c003970 0x7f8694147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.198+0000 7f8691d9b640 1 -- 172.21.15.8:0/1876568015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8694153990 msgr2=0x7f86941e53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.198+0000 7f8691d9b640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8694153990 0x7f86941e53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.198+0000 7f8691d9b640 1 -- 172.21.15.8:0/1876568015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86941e9110 con 0x7f86941e8bc0 2023-10-14T10:33:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.198+0000 7f8692d9d640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8694153990 0x7f86941e53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.198+0000 7f72edd9b640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72f00c04f0 0x7f72f01f9690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72e002c450 tx=0x7f72e002e070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.199+0000 7f383e59c640 1 -- 172.21.15.8:0/4288247425 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38400acd10 msgr2=0x7f384014ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.199+0000 7f8691d9b640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86941e8bc0 0x7f8694153450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8688007290 tx=0x7f8688007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.199+0000 7f383e59c640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38400acd10 0x7f384014ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.199+0000 7f383e59c640 1 -- 172.21.15.8:0/4288247425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38400c3e60 msgr2=0x7f384014d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.199+0000 7f383e59c640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38400c3e60 0x7f384014d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.199+0000 7f383e59c640 1 -- 172.21.15.8:0/4288247425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3838009a70 con 0x7f384006f9e0 2023-10-14T10:33:57.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.200+0000 7f8682ffd640 1 -- 172.21.15.8:0/1876568015 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868800fa20 con 0x7f86941e8bc0 2023-10-14T10:33:57.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.200+0000 7f8682ffd640 1 -- 172.21.15.8:0/1876568015 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868800fb80 con 0x7f86941e8bc0 2023-10-14T10:33:57.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.200+0000 7f86988fc640 1 -- 172.21.15.8:0/1876568015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86941481c0 con 0x7f86941e8bc0 2023-10-14T10:33:57.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.200+0000 7f8682ffd640 1 -- 172.21.15.8:0/1876568015 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86880133f0 con 0x7f86941e8bc0 2023-10-14T10:33:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.200+0000 7f383dd9b640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38400acd10 0x7f384014ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:57.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.200+0000 7f383ed9d640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38400c3e60 0x7f384014d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.200+0000 7f383e59c640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384006f9e0 0x7f38400a7b00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f383000c400 tx=0x7f383000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.200+0000 7f382effd640 1 -- 172.21.15.8:0/4288247425 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830005ce0 con 0x7f384006f9e0 2023-10-14T10:33:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.200+0000 7f382effd640 1 -- 172.21.15.8:0/4288247425 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3830005e40 con 0x7f384006f9e0 2023-10-14T10:33:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.200+0000 7f382effd640 1 -- 172.21.15.8:0/4288247425 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38300072d0 con 0x7f384006f9e0 2023-10-14T10:33:57.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.201+0000 7f3844a1f640 1 -- 172.21.15.8:0/4288247425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3834009400 con 0x7f384006f9e0 2023-10-14T10:33:57.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.201+0000 7f86988fc640 1 -- 172.21.15.8:0/1876568015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86940ab7c0 con 0x7f86941e8bc0 2023-10-14T10:33:57.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.202+0000 7f86988fc640 1 -- 172.21.15.8:0/1876568015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f869404e9b0 con 0x7f86941e8bc0 2023-10-14T10:33:57.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.202+0000 7f3844a1f640 1 -- 172.21.15.8:0/4288247425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38400bf290 con 0x7f384006f9e0 2023-10-14T10:33:57.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.203+0000 7f3844a1f640 1 -- 172.21.15.8:0/4288247425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38400bfc40 con 0x7f384006f9e0 2023-10-14T10:33:57.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.204+0000 7fda6affd640 1 -- 172.21.15.8:0/3391485524 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda64077150 con 0x7fda740c5550 2023-10-14T10:33:57.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.204+0000 7f72deffd640 1 -- 172.21.15.8:0/1823594588 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e003c040 con 0x7f72f00c04f0 2023-10-14T10:33:57.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.204+0000 7f72deffd640 1 -- 172.21.15.8:0/1823594588 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e002ccc0 con 0x7f72f00c04f0 2023-10-14T10:33:57.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.204+0000 7f72deffd640 1 -- 172.21.15.8:0/1823594588 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0007290 con 0x7f72f00c04f0 2023-10-14T10:33:57.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.204+0000 7f72f4ac2640 1 -- 172.21.15.8:0/1823594588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f0156590 con 0x7f72f00c04f0 2023-10-14T10:33:57.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.204+0000 7f72f4ac2640 1 -- 172.21.15.8:0/1823594588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f01f9db0 con 0x7f72f00c04f0 2023-10-14T10:33:57.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.205+0000 7f8682ffd640 1 -- 172.21.15.8:0/1876568015 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8688013550 con 0x7f86941e8bc0 2023-10-14T10:33:57.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.207+0000 7f8682ffd640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f867406aec0 0x7f867406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.207+0000 7f8682ffd640 1 -- 172.21.15.8:0/1876568015 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86880112b0 con 0x7f86941e8bc0 2023-10-14T10:33:57.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.208+0000 7f869259c640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f867406aec0 0x7f867406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.206+0000 7f72f4ac2640 1 -- 172.21.15.8:0/1823594588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f00ac0b0 con 0x7f72f00c04f0 2023-10-14T10:33:57.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.206+0000 7f382effd640 1 -- 172.21.15.8:0/4288247425 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f38300074f0 con 0x7f384006f9e0 2023-10-14T10:33:57.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.208+0000 7f382effd640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f382006af40 0x7f382006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.208+0000 7f382effd640 1 -- 172.21.15.8:0/4288247425 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3830088ac0 con 0x7f384006f9e0 2023-10-14T10:33:57.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.208+0000 7f383dd9b640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f382006af40 0x7f382006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.209+0000 7f869259c640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f867406aec0 0x7f867406d380 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f868403d000 tx=0x7f8684038000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.209+0000 7f72deffd640 1 -- 172.21.15.8:0/1823594588 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f72e0032070 con 0x7f72f00c04f0 2023-10-14T10:33:57.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.211+0000 7f383dd9b640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f382006af40 0x7f382006d400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3834035000 tx=0x7f3834008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.211+0000 7f72deffd640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f72d006aec0 0x7f72d006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.211+0000 7f72deffd640 1 -- 172.21.15.8:0/1823594588 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72e00aade0 con 0x7f72f00c04f0 2023-10-14T10:33:57.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.211+0000 7f72ee59c640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f72d006aec0 0x7f72d006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.213+0000 7f72ee59c640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f72d006aec0 0x7f72d006d380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f72f004f3d0 tx=0x7f72e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.215+0000 7f8682ffd640 1 -- 172.21.15.8:0/1876568015 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f868808e060 con 0x7f86941e8bc0 2023-10-14T10:33:57.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.222+0000 7f72deffd640 1 -- 172.21.15.8:0/1823594588 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72e0075f00 con 0x7f72f00c04f0 2023-10-14T10:33:57.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.225+0000 7f382effd640 1 -- 172.21.15.8:0/4288247425 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38400bfc40 con 0x7f384006f9e0 2023-10-14T10:33:57.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.556+0000 7f286079e640 1 -- 172.21.15.8:0/2060742844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f28581e9e50 con 0x7f28580c5550 2023-10-14T10:33:57.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.557+0000 7f284effd640 1 -- 172.21.15.8:0/2060742844 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f28581e9e50 con 0x7f28580c5550 2023-10-14T10:33:57.560 INFO:teuthology.orchestra.run.smithi008.stdout:55834574855 2023-10-14T10:33:57.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.564+0000 7f286079e640 1 -- 172.21.15.8:0/2060742844 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f283c06aed0 msgr2=0x7f283c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.564+0000 7f286079e640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f283c06aed0 0x7f283c06d390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f28581467f0 tx=0x7f2854008040 comp rx=0 tx=0).stop 2023-10-14T10:33:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.564+0000 7f286079e640 1 -- 172.21.15.8:0/2060742844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28580c5550 msgr2=0x7f285814e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.564+0000 7f286079e640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28580c5550 0x7f285814e250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f284800e9b0 tx=0x7f284800ee70 comp rx=0 tx=0).stop 2023-10-14T10:33:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.564+0000 7f286079e640 1 -- 172.21.15.8:0/2060742844 shutdown_connections 2023-10-14T10:33:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.564+0000 7f286079e640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f283c06aed0 0x7f283c06d390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.564+0000 7f286079e640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28581515c0 0x7f285814c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.564+0000 7f286079e640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28580c7630 0x7f28581e9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.564+0000 7f286079e640 1 --2- 172.21.15.8:0/2060742844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28580c5550 0x7f285814e250 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.564+0000 7f286079e640 1 -- 172.21.15.8:0/2060742844 >> 172.21.15.8:0/2060742844 conn(0x7f28580c9730 msgr2=0x7f28581527e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.565+0000 7f286079e640 1 -- 172.21.15.8:0/2060742844 shutdown_connections 2023-10-14T10:33:57.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.565+0000 7f286079e640 1 -- 172.21.15.8:0/2060742844 wait complete. 2023-10-14T10:33:57.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-10-14T10:33:57.594 DEBUG:teuthology.parallel:result is None 2023-10-14T10:33:57.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.607+0000 7fda78e1a640 1 -- 172.21.15.8:0/3391485524 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fda580057d0 con 0x7fda740c5550 2023-10-14T10:33:57.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.608+0000 7f08e0fb6640 1 -- 172.21.15.8:0/2987766696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f08dc0a9430 con 0x7f08dc154a00 2023-10-14T10:33:57.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.608+0000 7fda6affd640 1 -- 172.21.15.8:0/3391485524 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda64039090 con 0x7fda740c5550 2023-10-14T10:33:57.611 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-10-14T10:33:57.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.609+0000 7f08caffd640 1 -- 172.21.15.8:0/2987766696 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08dc0a9430 con 0x7f08dc154a00 2023-10-14T10:33:57.612 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-10-14T10:33:57.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.610+0000 7f7121a4f640 1 -- 172.21.15.8:0/3614497551 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f71000050c0 con 0x7f711c1515c0 2023-10-14T10:33:57.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.610+0000 7f7d4b59e640 1 -- 172.21.15.8:0/3313384584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7d44174880 con 0x7f7d4400acf0 2023-10-14T10:33:57.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.611+0000 7f7113fff640 1 -- 172.21.15.8:0/3614497551 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71040574a0 con 0x7f711c1515c0 2023-10-14T10:33:57.613 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-10-14T10:33:57.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.612+0000 7fda78e1a640 1 -- 172.21.15.8:0/3391485524 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fda5406aed0 msgr2=0x7fda5406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.612+0000 7fda78e1a640 1 --2- 172.21.15.8:0/3391485524 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fda5406aed0 0x7fda5406d390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda6c007fd0 tx=0x7fda6c007940 comp rx=0 tx=0).stop 2023-10-14T10:33:57.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.612+0000 7fda78e1a640 1 -- 172.21.15.8:0/3391485524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda740c5550 msgr2=0x7fda741571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.612+0000 7fda78e1a640 1 --2- 172.21.15.8:0/3391485524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda740c5550 0x7fda741571d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fda64033000 tx=0x7fda64004a40 comp rx=0 tx=0).stop 2023-10-14T10:33:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.612+0000 7f7d3affd640 1 -- 172.21.15.8:0/3313384584 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d4c08d090 con 0x7f7d4400acf0 2023-10-14T10:33:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.612+0000 7fda78e1a640 1 -- 172.21.15.8:0/3391485524 shutdown_connections 2023-10-14T10:33:57.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.612+0000 7fda78e1a640 1 --2- 172.21.15.8:0/3391485524 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fda5406aed0 0x7fda5406d390 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.612+0000 7fda78e1a640 1 --2- 172.21.15.8:0/3391485524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda74154a80 0x7fda7414bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.612+0000 7fda78e1a640 1 --2- 172.21.15.8:0/3391485524 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda741515c0 0x7fda741f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.612+0000 7fda78e1a640 1 --2- 172.21.15.8:0/3391485524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda740c5550 0x7fda741571d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.612+0000 7fda78e1a640 1 -- 172.21.15.8:0/3391485524 >> 172.21.15.8:0/3391485524 conn(0x7fda740c9730 msgr2=0x7fda74148ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.616 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-10-14T10:33:57.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7fda78e1a640 1 -- 172.21.15.8:0/3391485524 shutdown_connections 2023-10-14T10:33:57.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7f08e0fb6640 1 -- 172.21.15.8:0/2987766696 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f08bc06af40 msgr2=0x7f08bc06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7f08e0fb6640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f08bc06af40 0x7f08bc06d400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f08cc000c00 tx=0x7f08cc030000 comp rx=0 tx=0).stop 2023-10-14T10:33:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7f08e0fb6640 1 -- 172.21.15.8:0/2987766696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08dc154a00 msgr2=0x7f08dc0beee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7f08e0fb6640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08dc154a00 0x7f08dc0beee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c410 tx=0x7f08d000c8d0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7f08e0fb6640 1 -- 172.21.15.8:0/2987766696 shutdown_connections 2023-10-14T10:33:57.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7f08e0fb6640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f08bc06af40 0x7f08bc06d400 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7f08e0fb6640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08dc154a00 0x7f08dc0beee0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7f08e0fb6640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08dc151590 0x7f08dc0be9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7f08e0fb6640 1 --2- 172.21.15.8:0/2987766696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08dc0c4210 0x7f08dc0ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7f08e0fb6640 1 -- 172.21.15.8:0/2987766696 >> 172.21.15.8:0/2987766696 conn(0x7f08dc065ed0 msgr2=0x7f08dc1541b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7f08e0fb6640 1 -- 172.21.15.8:0/2987766696 shutdown_connections 2023-10-14T10:33:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7f08e0fb6640 1 -- 172.21.15.8:0/2987766696 wait complete. 2023-10-14T10:33:57.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.613+0000 7fda78e1a640 1 -- 172.21.15.8:0/3391485524 wait complete. 2023-10-14T10:33:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.614+0000 7f7121a4f640 1 -- 172.21.15.8:0/3614497551 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f70fc06aec0 msgr2=0x7f70fc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.614+0000 7f7121a4f640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f70fc06aec0 0x7f70fc06d380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7114036000 tx=0x7f711403c040 comp rx=0 tx=0).stop 2023-10-14T10:33:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.614+0000 7f7121a4f640 1 -- 172.21.15.8:0/3614497551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c1515c0 msgr2=0x7f711c0bab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.614+0000 7f7121a4f640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c1515c0 0x7f711c0bab30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7104001eb0 tx=0x7f710400c890 comp rx=0 tx=0).stop 2023-10-14T10:33:57.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7121a4f640 1 -- 172.21.15.8:0/3614497551 shutdown_connections 2023-10-14T10:33:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7121a4f640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f70fc06aec0 0x7f70fc06d380 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7121a4f640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f711c1515c0 0x7f711c0bab30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7121a4f640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f711c0c7630 0x7f711c14c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7121a4f640 1 --2- 172.21.15.8:0/3614497551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f711c0c5550 0x7f711c155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7121a4f640 1 -- 172.21.15.8:0/3614497551 >> 172.21.15.8:0/3614497551 conn(0x7f711c0c9730 msgr2=0x7f711c153780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7d4b59e640 1 -- 172.21.15.8:0/3313384584 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7d2c06aec0 msgr2=0x7f7d2c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7d4b59e640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7d2c06aec0 0x7f7d2c06d380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7d40036000 tx=0x7f7d40008030 comp rx=0 tx=0).stop 2023-10-14T10:33:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7d4b59e640 1 -- 172.21.15.8:0/3313384584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4400acf0 msgr2=0x7f7d440cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7d4b59e640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4400acf0 0x7f7d440cdf40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c061980 tx=0x7f7d4c067230 comp rx=0 tx=0).stop 2023-10-14T10:33:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7d4b59e640 1 -- 172.21.15.8:0/3313384584 shutdown_connections 2023-10-14T10:33:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7d4b59e640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7d2c06aec0 0x7f7d2c06d380 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7d4b59e640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d440d8790 0x7f7d440db620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7d4b59e640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7d440d5900 0x7f7d440d6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7d4b59e640 1 --2- 172.21.15.8:0/3313384584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7d4400acf0 0x7f7d440cdf40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.615+0000 7f7d4b59e640 1 -- 172.21.15.8:0/3313384584 >> 172.21.15.8:0/3313384584 conn(0x7f7d44048340 msgr2=0x7f7d4404a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.616+0000 7f7121a4f640 1 -- 172.21.15.8:0/3614497551 shutdown_connections 2023-10-14T10:33:57.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.616+0000 7f7121a4f640 1 -- 172.21.15.8:0/3614497551 wait complete. 2023-10-14T10:33:57.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.617+0000 7f7d4b59e640 1 -- 172.21.15.8:0/3313384584 shutdown_connections 2023-10-14T10:33:57.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.617+0000 7f7d4b59e640 1 -- 172.21.15.8:0/3313384584 wait complete. 2023-10-14T10:33:57.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.635+0000 7f3844a1f640 1 -- 172.21.15.8:0/4288247425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f38400bfc40 con 0x7f384006f9e0 2023-10-14T10:33:57.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.636+0000 7f382effd640 1 -- 172.21.15.8:0/4288247425 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38400bfc40 con 0x7f384006f9e0 2023-10-14T10:33:57.638 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-10-14T10:33:57.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.639+0000 7f3844a1f640 1 -- 172.21.15.8:0/4288247425 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f382006af40 msgr2=0x7f382006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.639+0000 7f3844a1f640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f382006af40 0x7f382006d400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3834035000 tx=0x7f3834008030 comp rx=0 tx=0).stop 2023-10-14T10:33:57.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.639+0000 7f3844a1f640 1 -- 172.21.15.8:0/4288247425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384006f9e0 msgr2=0x7f38400a7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.639+0000 7f3844a1f640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384006f9e0 0x7f38400a7b00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f383000c400 tx=0x7f383000c8c0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.639+0000 7f3844a1f640 1 -- 172.21.15.8:0/4288247425 shutdown_connections 2023-10-14T10:33:57.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.639+0000 7f3844a1f640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f382006af40 0x7f382006d400 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.639+0000 7f3844a1f640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38400c3e60 0x7f384014d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.639+0000 7f3844a1f640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38400acd10 0x7f384014ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.639+0000 7f3844a1f640 1 --2- 172.21.15.8:0/4288247425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384006f9e0 0x7f38400a7b00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.639+0000 7f3844a1f640 1 -- 172.21.15.8:0/4288247425 >> 172.21.15.8:0/4288247425 conn(0x7f38400a9280 msgr2=0x7f38400c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.640+0000 7f3844a1f640 1 -- 172.21.15.8:0/4288247425 shutdown_connections 2023-10-14T10:33:57.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.640+0000 7f3844a1f640 1 -- 172.21.15.8:0/4288247425 wait complete. 2023-10-14T10:33:57.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.640+0000 7f86988fc640 1 -- 172.21.15.8:0/1876568015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f869406cb50 con 0x7f86941e8bc0 2023-10-14T10:33:57.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.641+0000 7f8682ffd640 1 -- 172.21.15.8:0/1876568015 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f868808e020 con 0x7f86941e8bc0 2023-10-14T10:33:57.646 INFO:teuthology.orchestra.run.smithi008.stdout:55834574853 2023-10-14T10:33:57.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-10-14T10:33:57.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.644+0000 7f86988fc640 1 -- 172.21.15.8:0/1876568015 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f867406aec0 msgr2=0x7f867406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.644+0000 7f86988fc640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f867406aec0 0x7f867406d380 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f868403d000 tx=0x7f8684038000 comp rx=0 tx=0).stop 2023-10-14T10:33:57.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.644+0000 7f86988fc640 1 -- 172.21.15.8:0/1876568015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86941e8bc0 msgr2=0x7f8694153450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.644+0000 7f86988fc640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86941e8bc0 0x7f8694153450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8688007290 tx=0x7f8688007750 comp rx=0 tx=0).stop 2023-10-14T10:33:57.650 DEBUG:teuthology.parallel:result is None 2023-10-14T10:33:57.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-10-14T10:33:57.652 DEBUG:teuthology.parallel:result is None 2023-10-14T10:33:57.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-10-14T10:33:57.654 DEBUG:teuthology.parallel:result is None 2023-10-14T10:33:57.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.646+0000 7f86988fc640 1 -- 172.21.15.8:0/1876568015 shutdown_connections 2023-10-14T10:33:57.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.646+0000 7f86988fc640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f867406aec0 0x7f867406d380 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.646+0000 7f86988fc640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8694153990 0x7f86941e53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.646+0000 7f86988fc640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86941e8bc0 0x7f8694153450 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.646+0000 7f86988fc640 1 --2- 172.21.15.8:0/1876568015 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f867c003970 0x7f8694147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.646+0000 7f86988fc640 1 -- 172.21.15.8:0/1876568015 >> 172.21.15.8:0/1876568015 conn(0x7f8694065ed0 msgr2=0x7f86940bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.646+0000 7f86988fc640 1 -- 172.21.15.8:0/1876568015 shutdown_connections 2023-10-14T10:33:57.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.646+0000 7f86988fc640 1 -- 172.21.15.8:0/1876568015 wait complete. 2023-10-14T10:33:57.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.646+0000 7f72f4ac2640 1 -- 172.21.15.8:0/1823594588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f72f00ca0d0 con 0x7f72f00c04f0 2023-10-14T10:33:57.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-10-14T10:33:57.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.647+0000 7f72deffd640 1 -- 172.21.15.8:0/1823594588 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72e0079520 con 0x7f72f00c04f0 2023-10-14T10:33:57.660 INFO:teuthology.orchestra.run.smithi008.stdout:55834574854 2023-10-14T10:33:57.660 DEBUG:teuthology.parallel:result is None 2023-10-14T10:33:57.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.650+0000 7f72f4ac2640 1 -- 172.21.15.8:0/1823594588 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f72d006aec0 msgr2=0x7f72d006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.650+0000 7f72f4ac2640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f72d006aec0 0x7f72d006d380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f72f004f3d0 tx=0x7f72e4009040 comp rx=0 tx=0).stop 2023-10-14T10:33:57.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.650+0000 7f72f4ac2640 1 -- 172.21.15.8:0/1823594588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72f00c04f0 msgr2=0x7f72f01f9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.650+0000 7f72f4ac2640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72f00c04f0 0x7f72f01f9690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72e002c450 tx=0x7f72e002e070 comp rx=0 tx=0).stop 2023-10-14T10:33:57.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.650+0000 7f72f4ac2640 1 -- 172.21.15.8:0/1823594588 shutdown_connections 2023-10-14T10:33:57.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.650+0000 7f72f4ac2640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f72d006aec0 0x7f72d006d380 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.650+0000 7f72f4ac2640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72f00aeb90 0x7f72f00af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.650+0000 7f72f4ac2640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72f00c04f0 0x7f72f01f9690 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.650+0000 7f72f4ac2640 1 --2- 172.21.15.8:0/1823594588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f72d80047c0 0x7f72f00bca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.650+0000 7f72f4ac2640 1 -- 172.21.15.8:0/1823594588 >> 172.21.15.8:0/1823594588 conn(0x7f72f0065ed0 msgr2=0x7f72f014d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.650+0000 7f72f4ac2640 1 -- 172.21.15.8:0/1823594588 shutdown_connections 2023-10-14T10:33:57.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.650+0000 7f72f4ac2640 1 -- 172.21.15.8:0/1823594588 wait complete. 2023-10-14T10:33:57.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-14T10:33:57.664 DEBUG:teuthology.parallel:result is None 2023-10-14T10:33:57.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-10-14T10:33:57.666 DEBUG:teuthology.parallel:result is None 2023-10-14T10:33:57.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-14T10:33:57.669 DEBUG:teuthology.parallel:result is None 2023-10-14T10:33:57.670 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T10:33:57.670 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T10:33:57.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.925+0000 7f76a2a47640 1 Processor -- start 2023-10-14T10:33:57.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.925+0000 7f76a2a47640 1 -- start start 2023-10-14T10:33:57.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.927+0000 7f76a2a47640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c1514c0 0x7f769c06b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.927+0000 7f76a2a47640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f769c154840 0x7f769c0c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.927+0000 7f76a2a47640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c1543b0 con 0x7f769c0c50f0 2023-10-14T10:33:57.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.927+0000 7f76a2a47640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769c06c3c0 con 0x7f769c154840 2023-10-14T10:33:57.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.927+0000 7f76a2a47640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c153e30 con 0x7f769c1514c0 2023-10-14T10:33:57.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.927+0000 7f76a1244640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f769c0c50f0 0x7f769c0c7530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46774/0 (socket says 172.21.15.8:46774) 2023-10-14T10:33:57.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.927+0000 7f76a1244640 1 -- 172.21.15.8:0/3971246276 learned_addr learned my addr 172.21.15.8:0/3971246276 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:57.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a2246640 1 --2- 172.21.15.8:0/3971246276 >> v2:172.21.15.92:3300/0 conn(0x7f769c154840 0x7f769c0c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a1a45640 1 --2- 172.21.15.8:0/3971246276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c1514c0 0x7f769c06b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641027459 0 0) 0x7f769c1543b0 con 0x7f769c0c50f0 2023-10-14T10:33:57.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7688003520 con 0x7f769c0c50f0 2023-10-14T10:33:57.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 785944688 0 0) 0x7f7688003520 con 0x7f769c0c50f0 2023-10-14T10:33:57.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c1514c0 msgr2=0x7f769c06b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a0a43640 1 --2- 172.21.15.8:0/3971246276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c1514c0 0x7f769c06b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 >> v2:172.21.15.92:3300/0 conn(0x7f769c154840 msgr2=0x7f769c0c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a0a43640 1 --2- 172.21.15.8:0/3971246276 >> v2:172.21.15.92:3300/0 conn(0x7f769c154840 0x7f769c0c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c1518a0 con 0x7f769c0c50f0 2023-10-14T10:33:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f768c001670 con 0x7f769c0c50f0 2023-10-14T10:33:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 >> v1:172.21.15.8:6789/0 conn(0x7f769c0c50f0 legacy=0x7f769c0c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a0a43640 1 --2- 172.21.15.8:0/3971246276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688003970 0x7f7688003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.928+0000 7f76a0a43640 1 --2- 172.21.15.8:0/3971246276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76880047c0 0x7f7688004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.929+0000 7f76a0a43640 1 --2- 172.21.15.8:0/3971246276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c1514c0 0x7f7688005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.929+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c153e30 con 0x7f7688003970 2023-10-14T10:33:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.929+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768800b980 con 0x7f76880047c0 2023-10-14T10:33:57.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.929+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768800bb10 con 0x7f769c1514c0 2023-10-14T10:33:57.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.929+0000 7f76a2246640 1 --2- 172.21.15.8:0/3971246276 >> v2:172.21.15.92:3300/0 conn(0x7f769c154840 0x7f769c0c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:33:57.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.929+0000 7f76a1a45640 1 --2- 172.21.15.8:0/3971246276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688003970 0x7f7688003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.929+0000 7f76a2246640 1 --2- 172.21.15.8:0/3971246276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c1514c0 0x7f7688005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.929+0000 7f76a1a45640 1 -- 172.21.15.8:0/3971246276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c1514c0 msgr2=0x7f7688005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.929+0000 7f76a1a45640 1 --2- 172.21.15.8:0/3971246276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c1514c0 0x7f7688005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.929+0000 7f76a1a45640 1 -- 172.21.15.8:0/3971246276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76880047c0 msgr2=0x7f7688004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:57.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.929+0000 7f76a1a45640 1 --2- 172.21.15.8:0/3971246276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76880047c0 0x7f7688004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.929+0000 7f76a1a45640 1 -- 172.21.15.8:0/3971246276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7688003520 con 0x7f7688003970 2023-10-14T10:33:57.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.930+0000 7f76a1a45640 1 --2- 172.21.15.8:0/3971246276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688003970 0x7f7688003d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7698009af0 tx=0x7f76880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa99b61c18a30cee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.930+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769802c6b0 con 0x7f7688003970 2023-10-14T10:33:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.930+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769802c810 con 0x7f7688003970 2023-10-14T10:33:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.930+0000 7f76a0a43640 1 -- 172.21.15.8:0/3971246276 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769802cba0 con 0x7f7688003970 2023-10-14T10:33:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.931+0000 7f76a2a47640 1 -- 172.21.15.8:0/3971246276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688003970 msgr2=0x7f7688003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.931+0000 7f76a2a47640 1 --2- 172.21.15.8:0/3971246276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688003970 0x7f7688003d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7698009af0 tx=0x7f76880057f0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.931+0000 7f76a2246640 1 -- 172.21.15.8:0/3971246276 reap_dead start 2023-10-14T10:33:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.931+0000 7f76a2a47640 1 -- 172.21.15.8:0/3971246276 shutdown_connections 2023-10-14T10:33:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.931+0000 7f76a2a47640 1 -- 172.21.15.8:0/3971246276 >> 172.21.15.8:0/3971246276 conn(0x7f769c0c60b0 msgr2=0x7f769c0c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.931+0000 7f76a2a47640 1 -- 172.21.15.8:0/3971246276 shutdown_connections 2023-10-14T10:33:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.931+0000 7f76a2a47640 1 -- 172.21.15.8:0/3971246276 wait complete. 2023-10-14T10:33:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.933+0000 7f76a2a47640 1 Processor -- start 2023-10-14T10:33:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.933+0000 7f76a2a47640 1 -- start start 2023-10-14T10:33:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a2a47640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688003970 0x7f769c157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a2a47640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c156c00 0x7f769c1557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a2a47640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f769c155ce0 0x7f769c1e9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a2a47640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c156410 con 0x7f7688003970 2023-10-14T10:33:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a2a47640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0aa5e0 con 0x7f769c155ce0 2023-10-14T10:33:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a2a47640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c1e9300 con 0x7f769c156c00 2023-10-14T10:33:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a1a45640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688003970 0x7f769c157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a1a45640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688003970 0x7f769c157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40704/0 (socket says 172.21.15.8:40704) 2023-10-14T10:33:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a1a45640 1 -- 172.21.15.8:0/1344303042 learned_addr learned my addr 172.21.15.8:0/1344303042 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a1244640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c156c00 0x7f769c1557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a2246640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f769c155ce0 0x7f769c1e9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a1a45640 1 -- 172.21.15.8:0/1344303042 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c156c00 msgr2=0x7f769c1557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a1a45640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c156c00 0x7f769c1557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a1a45640 1 -- 172.21.15.8:0/1344303042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f769c155ce0 msgr2=0x7f769c1e9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a1a45640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f769c155ce0 0x7f769c1e9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.934+0000 7f76a1a45640 1 -- 172.21.15.8:0/1344303042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c1568d0 con 0x7f7688003970 2023-10-14T10:33:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.935+0000 7f76a1a45640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688003970 0x7f769c157840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7698037040 tx=0x7f7698004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.935+0000 7f76927fc640 1 -- 172.21.15.8:0/1344303042 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698003810 con 0x7f7688003970 2023-10-14T10:33:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.935+0000 7f76927fc640 1 -- 172.21.15.8:0/1344303042 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7698003970 con 0x7f7688003970 2023-10-14T10:33:57.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.935+0000 7f76927fc640 1 -- 172.21.15.8:0/1344303042 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698003ce0 con 0x7f7688003970 2023-10-14T10:33:57.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.935+0000 7f76a2a47640 1 -- 172.21.15.8:0/1344303042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c0a9080 con 0x7f7688003970 2023-10-14T10:33:57.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.935+0000 7f76a2a47640 1 -- 172.21.15.8:0/1344303042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c157d80 con 0x7f7688003970 2023-10-14T10:33:57.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.936+0000 7f76a2a47640 1 -- 172.21.15.8:0/1344303042 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c156a60 con 0x7f7688003970 2023-10-14T10:33:57.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.937+0000 7f76927fc640 1 -- 172.21.15.8:0/1344303042 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7698040450 con 0x7f7688003970 2023-10-14T10:33:57.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.938+0000 7f76927fc640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f768006aea0 0x7f768006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:57.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.938+0000 7f76927fc640 1 -- 172.21.15.8:0/1344303042 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76980ab550 con 0x7f7688003970 2023-10-14T10:33:57.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.938+0000 7f76a1244640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f768006aea0 0x7f768006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.939+0000 7f76a1244640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f768006aea0 0x7f768006d360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f769c0c8040 tx=0x7f768c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:57.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:57.943+0000 7f76927fc640 1 -- 172.21.15.8:0/1344303042 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f769c156a60 con 0x7f7688003970 2023-10-14T10:33:58.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.123+0000 7f76a2a47640 1 -- 172.21.15.8:0/1344303042 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f769c0c5890 con 0x7f768006aea0 2023-10-14T10:33:58.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.135+0000 7f76927fc640 1 -- 172.21.15.8:0/1344303042 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264350 (secure 0 0 0) 0x7f768c001bc0 con 0x7f768006aea0 2023-10-14T10:33:58.140 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:58.142 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T10:33:58.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.140+0000 7f76a2a47640 1 -- 172.21.15.8:0/1344303042 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f768006aea0 msgr2=0x7f768006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.140+0000 7f76a2a47640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f768006aea0 0x7f768006d360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f769c0c8040 tx=0x7f768c009040 comp rx=0 tx=0).stop 2023-10-14T10:33:58.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.140+0000 7f76a2a47640 1 -- 172.21.15.8:0/1344303042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688003970 msgr2=0x7f769c157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.140+0000 7f76a2a47640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688003970 0x7f769c157840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7698037040 tx=0x7f7698004730 comp rx=0 tx=0).stop 2023-10-14T10:33:58.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.140+0000 7f76a2a47640 1 -- 172.21.15.8:0/1344303042 shutdown_connections 2023-10-14T10:33:58.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.140+0000 7f76a2a47640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f768006aea0 0x7f768006d360 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.140+0000 7f76a2a47640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f769c155ce0 0x7f769c1e9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.140+0000 7f76a2a47640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f769c156c00 0x7f769c1557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.140+0000 7f76a2a47640 1 --2- 172.21.15.8:0/1344303042 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7688003970 0x7f769c157840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.140+0000 7f76a2a47640 1 -- 172.21.15.8:0/1344303042 >> 172.21.15.8:0/1344303042 conn(0x7f769c0c60b0 msgr2=0x7f769c0c8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:58.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.140+0000 7f76a2a47640 1 -- 172.21.15.8:0/1344303042 shutdown_connections 2023-10-14T10:33:58.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.140+0000 7f76a2a47640 1 -- 172.21.15.8:0/1344303042 wait complete. 2023-10-14T10:33:58.160 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-14T10:33:56.638511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235752,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738968,"statfs":{"total":773094113280,"available":772852703232,"internally_reserved":0,"allocated":2990080,"data_stored":1790108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.188638"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654359+0000","last_change":"2023-10-14T10:33:47.504191+0000","last_active":"2023-10-14T10:33:49.654359+0000","last_peered":"2023-10-14T10:33:49.654359+0000","last_clean":"2023-10-14T10:33:49.654359+0000","last_became_active":"2023-10-14T10:33:47.503838+0000","last_became_peered":"2023-10-14T10:33:47.503838+0000","last_unstale":"2023-10-14T10:33:49.654359+0000","last_undegraded":"2023-10-14T10:33:49.654359+0000","last_fullsized":"2023-10-14T10:33:49.654359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:37.834157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456736+0000","last_change":"2023-10-14T10:33:47.486126+0000","last_active":"2023-10-14T10:33:48.456736+0000","last_peered":"2023-10-14T10:33:48.456736+0000","last_clean":"2023-10-14T10:33:48.456736+0000","last_became_active":"2023-10-14T10:33:47.484535+0000","last_became_peered":"2023-10-14T10:33:47.484535+0000","last_unstale":"2023-10-14T10:33:48.456736+0000","last_undegraded":"2023-10-14T10:33:48.456736+0000","last_fullsized":"2023-10-14T10:33:48.456736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653537+0000","last_change":"2023-10-14T10:33:47.481217+0000","last_active":"2023-10-14T10:33:49.653537+0000","last_peered":"2023-10-14T10:33:49.653537+0000","last_clean":"2023-10-14T10:33:49.653537+0000","last_became_active":"2023-10-14T10:33:47.480170+0000","last_became_peered":"2023-10-14T10:33:47.480170+0000","last_unstale":"2023-10-14T10:33:49.653537+0000","last_undegraded":"2023-10-14T10:33:49.653537+0000","last_fullsized":"2023-10-14T10:33:49.653537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462757+0000","last_change":"2023-10-14T10:33:47.481641+0000","last_active":"2023-10-14T10:33:48.462757+0000","last_peered":"2023-10-14T10:33:48.462757+0000","last_clean":"2023-10-14T10:33:48.462757+0000","last_became_active":"2023-10-14T10:33:47.481143+0000","last_became_peered":"2023-10-14T10:33:47.481143+0000","last_unstale":"2023-10-14T10:33:48.462757+0000","last_undegraded":"2023-10-14T10:33:48.462757+0000","last_fullsized":"2023-10-14T10:33:48.462757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:13:18.695800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653106+0000","last_change":"2023-10-14T10:33:47.495716+0000","last_active":"2023-10-14T10:33:49.653106+0000","last_peered":"2023-10-14T10:33:49.653106+0000","last_clean":"2023-10-14T10:33:49.653106+0000","last_became_active":"2023-10-14T10:33:47.495391+0000","last_became_peered":"2023-10-14T10:33:47.495391+0000","last_unstale":"2023-10-14T10:33:49.653106+0000","last_undegraded":"2023-10-14T10:33:49.653106+0000","last_fullsized":"2023-10-14T10:33:49.653106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:00.621252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462279+0000","last_change":"2023-10-14T10:33:47.485901+0000","last_active":"2023-10-14T10:33:48.462279+0000","last_peered":"2023-10-14T10:33:48.462279+0000","last_clean":"2023-10-14T10:33:48.462279+0000","last_became_active":"2023-10-14T10:33:47.485410+0000","last_became_peered":"2023-10-14T10:33:47.485410+0000","last_unstale":"2023-10-14T10:33:48.462279+0000","last_undegraded":"2023-10-14T10:33:48.462279+0000","last_fullsized":"2023-10-14T10:33:48.462279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:13.355108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651994+0000","last_change":"2023-10-14T10:33:47.494929+0000","last_active":"2023-10-14T10:33:49.651994+0000","last_peered":"2023-10-14T10:33:49.651994+0000","last_clean":"2023-10-14T10:33:49.651994+0000","last_became_active":"2023-10-14T10:33:47.494645+0000","last_became_peered":"2023-10-14T10:33:47.494645+0000","last_unstale":"2023-10-14T10:33:49.651994+0000","last_undegraded":"2023-10-14T10:33:49.651994+0000","last_fullsized":"2023-10-14T10:33:49.651994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:47.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.211860+0000","last_change":"2023-10-14T10:33:47.480684+0000","last_active":"2023-10-14T10:33:49.211860+0000","last_peered":"2023-10-14T10:33:49.211860+0000","last_clean":"2023-10-14T10:33:49.211860+0000","last_became_active":"2023-10-14T10:33:47.480247+0000","last_became_peered":"2023-10-14T10:33:47.480247+0000","last_unstale":"2023-10-14T10:33:49.211860+0000","last_undegraded":"2023-10-14T10:33:49.211860+0000","last_fullsized":"2023-10-14T10:33:49.211860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654569+0000","last_change":"2023-10-14T10:33:47.500899+0000","last_active":"2023-10-14T10:33:49.654569+0000","last_peered":"2023-10-14T10:33:49.654569+0000","last_clean":"2023-10-14T10:33:49.654569+0000","last_became_active":"2023-10-14T10:33:47.500541+0000","last_became_peered":"2023-10-14T10:33:47.500541+0000","last_unstale":"2023-10-14T10:33:49.654569+0000","last_undegraded":"2023-10-14T10:33:49.654569+0000","last_fullsized":"2023-10-14T10:33:49.654569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:03.978194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653275+0000","last_change":"2023-10-14T10:33:47.484954+0000","last_active":"2023-10-14T10:33:49.653275+0000","last_peered":"2023-10-14T10:33:49.653275+0000","last_clean":"2023-10-14T10:33:49.653275+0000","last_became_active":"2023-10-14T10:33:47.484596+0000","last_became_peered":"2023-10-14T10:33:47.484596+0000","last_unstale":"2023-10-14T10:33:49.653275+0000","last_undegraded":"2023-10-14T10:33:49.653275+0000","last_fullsized":"2023-10-14T10:33:49.653275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652603+0000","last_change":"2023-10-14T10:33:47.503231+0000","last_active":"2023-10-14T10:33:49.652603+0000","last_peered":"2023-10-14T10:33:49.652603+0000","last_clean":"2023-10-14T10:33:49.652603+0000","last_became_active":"2023-10-14T10:33:47.496705+0000","last_became_peered":"2023-10-14T10:33:47.496705+0000","last_unstale":"2023-10-14T10:33:49.652603+0000","last_undegraded":"2023-10-14T10:33:49.652603+0000","last_fullsized":"2023-10-14T10:33:49.652603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.459938+0000","last_change":"2023-10-14T10:33:47.502726+0000","last_active":"2023-10-14T10:33:48.459938+0000","last_peered":"2023-10-14T10:33:48.459938+0000","last_clean":"2023-10-14T10:33:48.459938+0000","last_became_active":"2023-10-14T10:33:47.501799+0000","last_became_peered":"2023-10-14T10:33:47.501799+0000","last_unstale":"2023-10-14T10:33:48.459938+0000","last_undegraded":"2023-10-14T10:33:48.459938+0000","last_fullsized":"2023-10-14T10:33:48.459938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:10:51.321625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212506+0000","last_change":"2023-10-14T10:33:47.488816+0000","last_active":"2023-10-14T10:33:49.212506+0000","last_peered":"2023-10-14T10:33:49.212506+0000","last_clean":"2023-10-14T10:33:49.212506+0000","last_became_active":"2023-10-14T10:33:47.488505+0000","last_became_peered":"2023-10-14T10:33:47.488505+0000","last_unstale":"2023-10-14T10:33:49.212506+0000","last_undegraded":"2023-10-14T10:33:49.212506+0000","last_fullsized":"2023-10-14T10:33:49.212506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.305043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652714+0000","last_change":"2023-10-14T10:33:47.482197+0000","last_active":"2023-10-14T10:33:49.652714+0000","last_peered":"2023-10-14T10:33:49.652714+0000","last_clean":"2023-10-14T10:33:49.652714+0000","last_became_active":"2023-10-14T10:33:47.481209+0000","last_became_peered":"2023-10-14T10:33:47.481209+0000","last_unstale":"2023-10-14T10:33:49.652714+0000","last_undegraded":"2023-10-14T10:33:49.652714+0000","last_fullsized":"2023-10-14T10:33:49.652714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:02.548595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456348+0000","last_change":"2023-10-14T10:33:47.469873+0000","last_active":"2023-10-14T10:33:48.456348+0000","last_peered":"2023-10-14T10:33:48.456348+0000","last_clean":"2023-10-14T10:33:48.456348+0000","last_became_active":"2023-10-14T10:33:47.469462+0000","last_became_peered":"2023-10-14T10:33:47.469462+0000","last_unstale":"2023-10-14T10:33:48.456348+0000","last_undegraded":"2023-10-14T10:33:48.456348+0000","last_fullsized":"2023-10-14T10:33:48.456348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.461731+0000","last_change":"2023-10-14T10:33:47.484628+0000","last_active":"2023-10-14T10:33:48.461731+0000","last_peered":"2023-10-14T10:33:48.461731+0000","last_clean":"2023-10-14T10:33:48.461731+0000","last_became_active":"2023-10-14T10:33:47.484319+0000","last_became_peered":"2023-10-14T10:33:47.484319+0000","last_unstale":"2023-10-14T10:33:48.461731+0000","last_undegraded":"2023-10-14T10:33:48.461731+0000","last_fullsized":"2023-10-14T10:33:48.461731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463105+0000","last_change":"2023-10-14T10:33:47.494508+0000","last_active":"2023-10-14T10:33:48.463105+0000","last_peered":"2023-10-14T10:33:48.463105+0000","last_clean":"2023-10-14T10:33:48.463105+0000","last_became_active":"2023-10-14T10:33:47.494119+0000","last_became_peered":"2023-10-14T10:33:47.494119+0000","last_unstale":"2023-10-14T10:33:48.463105+0000","last_undegraded":"2023-10-14T10:33:48.463105+0000","last_fullsized":"2023-10-14T10:33:48.463105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:37.834157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651364+0000","last_change":"2023-10-14T10:33:47.482878+0000","last_active":"2023-10-14T10:33:49.651364+0000","last_peered":"2023-10-14T10:33:49.651364+0000","last_clean":"2023-10-14T10:33:49.651364+0000","last_became_active":"2023-10-14T10:33:47.482566+0000","last_became_peered":"2023-10-14T10:33:47.482566+0000","last_unstale":"2023-10-14T10:33:49.651364+0000","last_undegraded":"2023-10-14T10:33:49.651364+0000","last_fullsized":"2023-10-14T10:33:49.651364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:08.668848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654211+0000","last_change":"2023-10-14T10:33:47.497038+0000","last_active":"2023-10-14T10:33:49.654211+0000","last_peered":"2023-10-14T10:33:49.654211+0000","last_clean":"2023-10-14T10:33:49.654211+0000","last_became_active":"2023-10-14T10:33:47.496705+0000","last_became_peered":"2023-10-14T10:33:47.496705+0000","last_unstale":"2023-10-14T10:33:49.654211+0000","last_undegraded":"2023-10-14T10:33:49.654211+0000","last_fullsized":"2023-10-14T10:33:49.654211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:20.511159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652680+0000","last_change":"2023-10-14T10:33:47.497999+0000","last_active":"2023-10-14T10:33:49.652680+0000","last_peered":"2023-10-14T10:33:49.652680+0000","last_clean":"2023-10-14T10:33:49.652680+0000","last_became_active":"2023-10-14T10:33:47.494872+0000","last_became_peered":"2023-10-14T10:33:47.494872+0000","last_unstale":"2023-10-14T10:33:49.652680+0000","last_undegraded":"2023-10-14T10:33:49.652680+0000","last_fullsized":"2023-10-14T10:33:49.652680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653148+0000","last_change":"2023-10-14T10:33:47.490809+0000","last_active":"2023-10-14T10:33:49.653148+0000","last_peered":"2023-10-14T10:33:49.653148+0000","last_clean":"2023-10-14T10:33:49.653148+0000","last_became_active":"2023-10-14T10:33:47.490523+0000","last_became_peered":"2023-10-14T10:33:47.490523+0000","last_unstale":"2023-10-14T10:33:49.653148+0000","last_undegraded":"2023-10-14T10:33:49.653148+0000","last_fullsized":"2023-10-14T10:33:49.653148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:28.374613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462234+0000","last_change":"2023-10-14T10:33:47.491586+0000","last_active":"2023-10-14T10:33:48.462234+0000","last_peered":"2023-10-14T10:33:48.462234+0000","last_clean":"2023-10-14T10:33:48.462234+0000","last_became_active":"2023-10-14T10:33:47.491262+0000","last_became_peered":"2023-10-14T10:33:47.491262+0000","last_unstale":"2023-10-14T10:33:48.462234+0000","last_undegraded":"2023-10-14T10:33:48.462234+0000","last_fullsized":"2023-10-14T10:33:48.462234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:47.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.211866+0000","last_change":"2023-10-14T10:33:47.479860+0000","last_active":"2023-10-14T10:33:49.211866+0000","last_peered":"2023-10-14T10:33:49.211866+0000","last_clean":"2023-10-14T10:33:49.211866+0000","last_became_active":"2023-10-14T10:33:47.479536+0000","last_became_peered":"2023-10-14T10:33:47.479536+0000","last_unstale":"2023-10-14T10:33:49.211866+0000","last_undegraded":"2023-10-14T10:33:49.211866+0000","last_fullsized":"2023-10-14T10:33:49.211866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.461909+0000","last_change":"2023-10-14T10:33:47.480950+0000","last_active":"2023-10-14T10:33:48.461909+0000","last_peered":"2023-10-14T10:33:48.461909+0000","last_clean":"2023-10-14T10:33:48.461909+0000","last_became_active":"2023-10-14T10:33:47.480623+0000","last_became_peered":"2023-10-14T10:33:47.480623+0000","last_unstale":"2023-10-14T10:33:48.461909+0000","last_undegraded":"2023-10-14T10:33:48.461909+0000","last_fullsized":"2023-10-14T10:33:48.461909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.305043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212838+0000","last_change":"2023-10-14T10:33:47.476116+0000","last_active":"2023-10-14T10:33:49.212838+0000","last_peered":"2023-10-14T10:33:49.212838+0000","last_clean":"2023-10-14T10:33:49.212838+0000","last_became_active":"2023-10-14T10:33:47.475806+0000","last_became_peered":"2023-10-14T10:33:47.475806+0000","last_unstale":"2023-10-14T10:33:49.212838+0000","last_undegraded":"2023-10-14T10:33:49.212838+0000","last_fullsized":"2023-10-14T10:33:49.212838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:13.355108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653449+0000","last_change":"2023-10-14T10:33:47.503282+0000","last_active":"2023-10-14T10:33:49.653449+0000","last_peered":"2023-10-14T10:33:49.653449+0000","last_clean":"2023-10-14T10:33:49.653449+0000","last_became_active":"2023-10-14T10:33:47.498347+0000","last_became_peered":"2023-10-14T10:33:47.498347+0000","last_unstale":"2023-10-14T10:33:49.653449+0000","last_undegraded":"2023-10-14T10:33:49.653449+0000","last_fullsized":"2023-10-14T10:33:49.653449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.305043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456488+0000","last_change":"2023-10-14T10:33:47.477397+0000","last_active":"2023-10-14T10:33:48.456488+0000","last_peered":"2023-10-14T10:33:48.456488+0000","last_clean":"2023-10-14T10:33:48.456488+0000","last_became_active":"2023-10-14T10:33:47.477023+0000","last_became_peered":"2023-10-14T10:33:47.477023+0000","last_unstale":"2023-10-14T10:33:48.456488+0000","last_undegraded":"2023-10-14T10:33:48.456488+0000","last_fullsized":"2023-10-14T10:33:48.456488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212867+0000","last_change":"2023-10-14T10:33:47.483158+0000","last_active":"2023-10-14T10:33:49.212867+0000","last_peered":"2023-10-14T10:33:49.212867+0000","last_clean":"2023-10-14T10:33:49.212867+0000","last_became_active":"2023-10-14T10:33:47.481098+0000","last_became_peered":"2023-10-14T10:33:47.481098+0000","last_unstale":"2023-10-14T10:33:49.212867+0000","last_undegraded":"2023-10-14T10:33:49.212867+0000","last_fullsized":"2023-10-14T10:33:49.212867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:58.057067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653230+0000","last_change":"2023-10-14T10:33:47.481204+0000","last_active":"2023-10-14T10:33:49.653230+0000","last_peered":"2023-10-14T10:33:49.653230+0000","last_clean":"2023-10-14T10:33:49.653230+0000","last_became_active":"2023-10-14T10:33:47.480212+0000","last_became_peered":"2023-10-14T10:33:47.480212+0000","last_unstale":"2023-10-14T10:33:49.653230+0000","last_undegraded":"2023-10-14T10:33:49.653230+0000","last_fullsized":"2023-10-14T10:33:49.653230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462667+0000","last_change":"2023-10-14T10:33:47.480818+0000","last_active":"2023-10-14T10:33:48.462667+0000","last_peered":"2023-10-14T10:33:48.462667+0000","last_clean":"2023-10-14T10:33:48.462667+0000","last_became_active":"2023-10-14T10:33:47.480593+0000","last_became_peered":"2023-10-14T10:33:47.480593+0000","last_unstale":"2023-10-14T10:33:48.462667+0000","last_undegraded":"2023-10-14T10:33:48.462667+0000","last_fullsized":"2023-10-14T10:33:48.462667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:11.483101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.650911+0000","last_change":"2023-10-14T10:33:47.477330+0000","last_active":"2023-10-14T10:33:49.650911+0000","last_peered":"2023-10-14T10:33:49.650911+0000","last_clean":"2023-10-14T10:33:49.650911+0000","last_became_active":"2023-10-14T10:33:47.476922+0000","last_became_peered":"2023-10-14T10:33:47.476922+0000","last_unstale":"2023-10-14T10:33:49.650911+0000","last_undegraded":"2023-10-14T10:33:49.650911+0000","last_fullsized":"2023-10-14T10:33:49.650911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:34:46.239394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651600+0000","last_change":"2023-10-14T10:33:47.496369+0000","last_active":"2023-10-14T10:33:49.651600+0000","last_peered":"2023-10-14T10:33:49.651600+0000","last_clean":"2023-10-14T10:33:49.651600+0000","last_became_active":"2023-10-14T10:33:47.494458+0000","last_became_peered":"2023-10-14T10:33:47.494458+0000","last_unstale":"2023-10-14T10:33:49.651600+0000","last_undegraded":"2023-10-14T10:33:49.651600+0000","last_fullsized":"2023-10-14T10:33:49.651600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.459427+0000","last_change":"2023-10-14T10:33:47.469801+0000","last_active":"2023-10-14T10:33:48.459427+0000","last_peered":"2023-10-14T10:33:48.459427+0000","last_clean":"2023-10-14T10:33:48.459427+0000","last_became_active":"2023-10-14T10:33:47.468284+0000","last_became_peered":"2023-10-14T10:33:47.468284+0000","last_unstale":"2023-10-14T10:33:48.459427+0000","last_undegraded":"2023-10-14T10:33:48.459427+0000","last_fullsized":"2023-10-14T10:33:48.459427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:35.323602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212468+0000","last_change":"2023-10-14T10:33:46.944464+0000","last_active":"2023-10-14T10:33:49.212468+0000","last_peered":"2023-10-14T10:33:49.212468+0000","last_clean":"2023-10-14T10:33:49.212468+0000","last_became_active":"2023-10-14T10:33:46.943975+0000","last_became_peered":"2023-10-14T10:33:46.943975+0000","last_unstale":"2023-10-14T10:33:49.212468+0000","last_undegraded":"2023-10-14T10:33:49.212468+0000","last_fullsized":"2023-10-14T10:33:49.212468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653470+0000","last_change":"2023-10-14T10:33:47.487990+0000","last_active":"2023-10-14T10:33:49.653470+0000","last_peered":"2023-10-14T10:33:49.653470+0000","last_clean":"2023-10-14T10:33:49.653470+0000","last_became_active":"2023-10-14T10:33:47.487504+0000","last_became_peered":"2023-10-14T10:33:47.487504+0000","last_unstale":"2023-10-14T10:33:49.653470+0000","last_undegraded":"2023-10-14T10:33:49.653470+0000","last_fullsized":"2023-10-14T10:33:49.653470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652732+0000","last_change":"2023-10-14T10:33:46.944422+0000","last_active":"2023-10-14T10:33:49.652732+0000","last_peered":"2023-10-14T10:33:49.652732+0000","last_clean":"2023-10-14T10:33:49.652732+0000","last_became_active":"2023-10-14T10:33:46.944045+0000","last_became_peered":"2023-10-14T10:33:46.944045+0000","last_unstale":"2023-10-14T10:33:49.652732+0000","last_undegraded":"2023-10-14T10:33:49.652732+0000","last_fullsized":"2023-10-14T10:33:49.652732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212102+0000","last_change":"2023-10-14T10:33:46.946032+0000","last_active":"2023-10-14T10:33:49.212102+0000","last_peered":"2023-10-14T10:33:49.212102+0000","last_clean":"2023-10-14T10:33:49.212102+0000","last_became_active":"2023-10-14T10:33:46.945694+0000","last_became_peered":"2023-10-14T10:33:46.945694+0000","last_unstale":"2023-10-14T10:33:49.212102+0000","last_undegraded":"2023-10-14T10:33:49.212102+0000","last_fullsized":"2023-10-14T10:33:49.212102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:35.235012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212057+0000","last_change":"2023-10-14T10:33:47.486768+0000","last_active":"2023-10-14T10:33:49.212057+0000","last_peered":"2023-10-14T10:33:49.212057+0000","last_clean":"2023-10-14T10:33:49.212057+0000","last_became_active":"2023-10-14T10:33:47.486477+0000","last_became_peered":"2023-10-14T10:33:47.486477+0000","last_unstale":"2023-10-14T10:33:49.212057+0000","last_undegraded":"2023-10-14T10:33:49.212057+0000","last_fullsized":"2023-10-14T10:33:49.212057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462041+0000","last_change":"2023-10-14T10:33:46.943179+0000","last_active":"2023-10-14T10:33:48.462041+0000","last_peered":"2023-10-14T10:33:48.462041+0000","last_clean":"2023-10-14T10:33:48.462041+0000","last_became_active":"2023-10-14T10:33:46.942887+0000","last_became_peered":"2023-10-14T10:33:46.942887+0000","last_unstale":"2023-10-14T10:33:48.462041+0000","last_undegraded":"2023-10-14T10:33:48.462041+0000","last_fullsized":"2023-10-14T10:33:48.462041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:01.285291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456237+0000","last_change":"2023-10-14T10:33:47.477341+0000","last_active":"2023-10-14T10:33:48.456237+0000","last_peered":"2023-10-14T10:33:48.456237+0000","last_clean":"2023-10-14T10:33:48.456237+0000","last_became_active":"2023-10-14T10:33:47.476425+0000","last_became_peered":"2023-10-14T10:33:47.476425+0000","last_unstale":"2023-10-14T10:33:48.456237+0000","last_undegraded":"2023-10-14T10:33:48.456237+0000","last_fullsized":"2023-10-14T10:33:48.456237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652803+0000","last_change":"2023-10-14T10:33:46.946573+0000","last_active":"2023-10-14T10:33:49.652803+0000","last_peered":"2023-10-14T10:33:49.652803+0000","last_clean":"2023-10-14T10:33:49.652803+0000","last_became_active":"2023-10-14T10:33:46.945846+0000","last_became_peered":"2023-10-14T10:33:46.945846+0000","last_unstale":"2023-10-14T10:33:49.652803+0000","last_undegraded":"2023-10-14T10:33:49.652803+0000","last_fullsized":"2023-10-14T10:33:49.652803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:28.392606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462337+0000","last_change":"2023-10-14T10:33:47.494832+0000","last_active":"2023-10-14T10:33:48.462337+0000","last_peered":"2023-10-14T10:33:48.462337+0000","last_clean":"2023-10-14T10:33:48.462337+0000","last_became_active":"2023-10-14T10:33:47.494306+0000","last_became_peered":"2023-10-14T10:33:47.494306+0000","last_unstale":"2023-10-14T10:33:48.462337+0000","last_undegraded":"2023-10-14T10:33:48.462337+0000","last_fullsized":"2023-10-14T10:33:48.462337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:58.057067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462569+0000","last_change":"2023-10-14T10:33:46.946908+0000","last_active":"2023-10-14T10:33:48.462569+0000","last_peered":"2023-10-14T10:33:48.462569+0000","last_clean":"2023-10-14T10:33:48.462569+0000","last_became_active":"2023-10-14T10:33:46.946623+0000","last_became_peered":"2023-10-14T10:33:46.946623+0000","last_unstale":"2023-10-14T10:33:48.462569+0000","last_undegraded":"2023-10-14T10:33:48.462569+0000","last_fullsized":"2023-10-14T10:33:48.462569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653979+0000","last_change":"2023-10-14T10:33:47.485672+0000","last_active":"2023-10-14T10:33:49.653979+0000","last_peered":"2023-10-14T10:33:49.653979+0000","last_clean":"2023-10-14T10:33:49.653979+0000","last_became_active":"2023-10-14T10:33:47.485336+0000","last_became_peered":"2023-10-14T10:33:47.485336+0000","last_unstale":"2023-10-14T10:33:49.653979+0000","last_undegraded":"2023-10-14T10:33:49.653979+0000","last_fullsized":"2023-10-14T10:33:49.653979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456519+0000","last_change":"2023-10-14T10:33:46.942861+0000","last_active":"2023-10-14T10:33:48.456519+0000","last_peered":"2023-10-14T10:33:48.456519+0000","last_clean":"2023-10-14T10:33:48.456519+0000","last_became_active":"2023-10-14T10:33:46.942559+0000","last_became_peered":"2023-10-14T10:33:46.942559+0000","last_unstale":"2023-10-14T10:33:48.456519+0000","last_undegraded":"2023-10-14T10:33:48.456519+0000","last_fullsized":"2023-10-14T10:33:48.456519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:01.285291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460271+0000","last_change":"2023-10-14T10:33:47.496746+0000","last_active":"2023-10-14T10:33:48.460271+0000","last_peered":"2023-10-14T10:33:48.460271+0000","last_clean":"2023-10-14T10:33:48.460271+0000","last_became_active":"2023-10-14T10:33:47.495439+0000","last_became_peered":"2023-10-14T10:33:47.495439+0000","last_unstale":"2023-10-14T10:33:48.460271+0000","last_undegraded":"2023-10-14T10:33:48.460271+0000","last_fullsized":"2023-10-14T10:33:48.460271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:36.498316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652736+0000","last_change":"2023-10-14T10:33:46.948656+0000","last_active":"2023-10-14T10:33:49.652736+0000","last_peered":"2023-10-14T10:33:49.652736+0000","last_clean":"2023-10-14T10:33:49.652736+0000","last_became_active":"2023-10-14T10:33:46.945172+0000","last_became_peered":"2023-10-14T10:33:46.945172+0000","last_unstale":"2023-10-14T10:33:49.652736+0000","last_undegraded":"2023-10-14T10:33:49.652736+0000","last_fullsized":"2023-10-14T10:33:49.652736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:27.111309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653869+0000","last_change":"2023-10-14T10:33:47.494774+0000","last_active":"2023-10-14T10:33:49.653869+0000","last_peered":"2023-10-14T10:33:49.653869+0000","last_clean":"2023-10-14T10:33:49.653869+0000","last_became_active":"2023-10-14T10:33:47.494464+0000","last_became_peered":"2023-10-14T10:33:47.494464+0000","last_unstale":"2023-10-14T10:33:49.653869+0000","last_undegraded":"2023-10-14T10:33:49.653869+0000","last_fullsized":"2023-10-14T10:33:49.653869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:11.483101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653515+0000","last_change":"2023-10-14T10:33:46.949538+0000","last_active":"2023-10-14T10:33:49.653515+0000","last_peered":"2023-10-14T10:33:49.653515+0000","last_clean":"2023-10-14T10:33:49.653515+0000","last_became_active":"2023-10-14T10:33:46.949221+0000","last_became_peered":"2023-10-14T10:33:46.949221+0000","last_unstale":"2023-10-14T10:33:49.653515+0000","last_undegraded":"2023-10-14T10:33:49.653515+0000","last_fullsized":"2023-10-14T10:33:49.653515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:24.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652794+0000","last_change":"2023-10-14T10:33:47.495094+0000","last_active":"2023-10-14T10:33:49.652794+0000","last_peered":"2023-10-14T10:33:49.652794+0000","last_clean":"2023-10-14T10:33:49.652794+0000","last_became_active":"2023-10-14T10:33:47.494462+0000","last_became_peered":"2023-10-14T10:33:47.494462+0000","last_unstale":"2023-10-14T10:33:49.652794+0000","last_undegraded":"2023-10-14T10:33:49.652794+0000","last_fullsized":"2023-10-14T10:33:49.652794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:21.485819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463293+0000","last_change":"2023-10-14T10:33:46.949862+0000","last_active":"2023-10-14T10:33:48.463293+0000","last_peered":"2023-10-14T10:33:48.463293+0000","last_clean":"2023-10-14T10:33:48.463293+0000","last_became_active":"2023-10-14T10:33:46.949575+0000","last_became_peered":"2023-10-14T10:33:46.949575+0000","last_unstale":"2023-10-14T10:33:48.463293+0000","last_undegraded":"2023-10-14T10:33:48.463293+0000","last_fullsized":"2023-10-14T10:33:48.463293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:51.370720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653325+0000","last_change":"2023-10-14T10:33:47.499315+0000","last_active":"2023-10-14T10:33:49.653325+0000","last_peered":"2023-10-14T10:33:49.653325+0000","last_clean":"2023-10-14T10:33:49.653325+0000","last_became_active":"2023-10-14T10:33:47.498922+0000","last_became_peered":"2023-10-14T10:33:47.498922+0000","last_unstale":"2023-10-14T10:33:49.653325+0000","last_undegraded":"2023-10-14T10:33:49.653325+0000","last_fullsized":"2023-10-14T10:33:49.653325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:10.602705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651606+0000","last_change":"2023-10-14T10:33:46.947577+0000","last_active":"2023-10-14T10:33:49.651606+0000","last_peered":"2023-10-14T10:33:49.651606+0000","last_clean":"2023-10-14T10:33:49.651606+0000","last_became_active":"2023-10-14T10:33:46.947158+0000","last_became_peered":"2023-10-14T10:33:46.947158+0000","last_unstale":"2023-10-14T10:33:49.651606+0000","last_undegraded":"2023-10-14T10:33:49.651606+0000","last_fullsized":"2023-10-14T10:33:49.651606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651703+0000","last_change":"2023-10-14T10:33:47.482689+0000","last_active":"2023-10-14T10:33:49.651703+0000","last_peered":"2023-10-14T10:33:49.651703+0000","last_clean":"2023-10-14T10:33:49.651703+0000","last_became_active":"2023-10-14T10:33:47.482301+0000","last_became_peered":"2023-10-14T10:33:47.482301+0000","last_unstale":"2023-10-14T10:33:49.651703+0000","last_undegraded":"2023-10-14T10:33:49.651703+0000","last_fullsized":"2023-10-14T10:33:49.651703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.650670+0000","last_change":"2023-10-14T10:33:46.933875+0000","last_active":"2023-10-14T10:33:49.650670+0000","last_peered":"2023-10-14T10:33:49.650670+0000","last_clean":"2023-10-14T10:33:49.650670+0000","last_became_active":"2023-10-14T10:33:46.932445+0000","last_became_peered":"2023-10-14T10:33:46.932445+0000","last_unstale":"2023-10-14T10:33:49.650670+0000","last_undegraded":"2023-10-14T10:33:49.650670+0000","last_fullsized":"2023-10-14T10:33:49.650670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:23.669098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652199+0000","last_change":"2023-10-14T10:33:47.500004+0000","last_active":"2023-10-14T10:33:49.652199+0000","last_peered":"2023-10-14T10:33:49.652199+0000","last_clean":"2023-10-14T10:33:49.652199+0000","last_became_active":"2023-10-14T10:33:47.499661+0000","last_became_peered":"2023-10-14T10:33:47.499661+0000","last_unstale":"2023-10-14T10:33:49.652199+0000","last_undegraded":"2023-10-14T10:33:49.652199+0000","last_fullsized":"2023-10-14T10:33:49.652199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:13.355108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460519+0000","last_change":"2023-10-14T10:33:46.941041+0000","last_active":"2023-10-14T10:33:48.460519+0000","last_peered":"2023-10-14T10:33:48.460519+0000","last_clean":"2023-10-14T10:33:48.460519+0000","last_became_active":"2023-10-14T10:33:46.940755+0000","last_became_peered":"2023-10-14T10:33:46.940755+0000","last_unstale":"2023-10-14T10:33:48.460519+0000","last_undegraded":"2023-10-14T10:33:48.460519+0000","last_fullsized":"2023-10-14T10:33:48.460519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:58.183303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652938+0000","last_change":"2023-10-14T10:33:47.501109+0000","last_active":"2023-10-14T10:33:49.652938+0000","last_peered":"2023-10-14T10:33:49.652938+0000","last_clean":"2023-10-14T10:33:49.652938+0000","last_became_active":"2023-10-14T10:33:47.500841+0000","last_became_peered":"2023-10-14T10:33:47.500841+0000","last_unstale":"2023-10-14T10:33:49.652938+0000","last_undegraded":"2023-10-14T10:33:49.652938+0000","last_fullsized":"2023-10-14T10:33:49.652938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:58.057067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651355+0000","last_change":"2023-10-14T10:33:46.934433+0000","last_active":"2023-10-14T10:33:49.651355+0000","last_peered":"2023-10-14T10:33:49.651355+0000","last_clean":"2023-10-14T10:33:49.651355+0000","last_became_active":"2023-10-14T10:33:46.934173+0000","last_became_peered":"2023-10-14T10:33:46.934173+0000","last_unstale":"2023-10-14T10:33:49.651355+0000","last_undegraded":"2023-10-14T10:33:49.651355+0000","last_fullsized":"2023-10-14T10:33:49.651355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:34.060298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654571+0000","last_change":"2023-10-14T10:33:47.500414+0000","last_active":"2023-10-14T10:33:49.654571+0000","last_peered":"2023-10-14T10:33:49.654571+0000","last_clean":"2023-10-14T10:33:49.654571+0000","last_became_active":"2023-10-14T10:33:47.500103+0000","last_became_peered":"2023-10-14T10:33:47.500103+0000","last_unstale":"2023-10-14T10:33:49.654571+0000","last_undegraded":"2023-10-14T10:33:49.654571+0000","last_fullsized":"2023-10-14T10:33:49.654571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:55.928753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456627+0000","last_change":"2023-10-14T10:33:46.929461+0000","last_active":"2023-10-14T10:33:48.456627+0000","last_peered":"2023-10-14T10:33:48.456627+0000","last_clean":"2023-10-14T10:33:48.456627+0000","last_became_active":"2023-10-14T10:33:46.928486+0000","last_became_peered":"2023-10-14T10:33:46.928486+0000","last_unstale":"2023-10-14T10:33:48.456627+0000","last_undegraded":"2023-10-14T10:33:48.456627+0000","last_fullsized":"2023-10-14T10:33:48.456627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:27.111309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463161+0000","last_change":"2023-10-14T10:33:47.483087+0000","last_active":"2023-10-14T10:33:48.463161+0000","last_peered":"2023-10-14T10:33:48.463161+0000","last_clean":"2023-10-14T10:33:48.463161+0000","last_became_active":"2023-10-14T10:33:47.481501+0000","last_became_peered":"2023-10-14T10:33:47.481501+0000","last_unstale":"2023-10-14T10:33:48.463161+0000","last_undegraded":"2023-10-14T10:33:48.463161+0000","last_fullsized":"2023-10-14T10:33:48.463161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:03.978194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651260+0000","last_change":"2023-10-14T10:33:46.943701+0000","last_active":"2023-10-14T10:33:49.651260+0000","last_peered":"2023-10-14T10:33:49.651260+0000","last_clean":"2023-10-14T10:33:49.651260+0000","last_became_active":"2023-10-14T10:33:46.942265+0000","last_became_peered":"2023-10-14T10:33:46.942265+0000","last_unstale":"2023-10-14T10:33:49.651260+0000","last_undegraded":"2023-10-14T10:33:49.651260+0000","last_fullsized":"2023-10-14T10:33:49.651260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:10:50.058321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653885+0000","last_change":"2023-10-14T10:33:47.502823+0000","last_active":"2023-10-14T10:33:49.653885+0000","last_peered":"2023-10-14T10:33:49.653885+0000","last_clean":"2023-10-14T10:33:49.653885+0000","last_became_active":"2023-10-14T10:33:47.502237+0000","last_became_peered":"2023-10-14T10:33:47.502237+0000","last_unstale":"2023-10-14T10:33:49.653885+0000","last_undegraded":"2023-10-14T10:33:49.653885+0000","last_fullsized":"2023-10-14T10:33:49.653885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:13:18.695800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T10:33:47.489150+0000","last_change":"2023-10-14T10:33:42.821659+0000","last_active":"2023-10-14T10:33:47.489150+0000","last_peered":"2023-10-14T10:33:47.489150+0000","last_clean":"2023-10-14T10:33:47.489150+0000","last_became_active":"2023-10-14T10:33:42.819441+0000","last_became_peered":"2023-10-14T10:33:42.819441+0000","last_unstale":"2023-10-14T10:33:47.489150+0000","last_undegraded":"2023-10-14T10:33:47.489150+0000","last_fullsized":"2023-10-14T10:33:47.489150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_clean_scrub_stamp":"2023-10-14T10:33:41.468382+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:59.542930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.461818+0000","last_change":"2023-10-14T10:33:46.932732+0000","last_active":"2023-10-14T10:33:48.461818+0000","last_peered":"2023-10-14T10:33:48.461818+0000","last_clean":"2023-10-14T10:33:48.461818+0000","last_became_active":"2023-10-14T10:33:46.929319+0000","last_became_peered":"2023-10-14T10:33:46.929319+0000","last_unstale":"2023-10-14T10:33:48.461818+0000","last_undegraded":"2023-10-14T10:33:48.461818+0000","last_fullsized":"2023-10-14T10:33:48.461818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:24.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.211843+0000","last_change":"2023-10-14T10:33:47.480133+0000","last_active":"2023-10-14T10:33:49.211843+0000","last_peered":"2023-10-14T10:33:49.211843+0000","last_clean":"2023-10-14T10:33:49.211843+0000","last_became_active":"2023-10-14T10:33:47.479802+0000","last_became_peered":"2023-10-14T10:33:47.479802+0000","last_unstale":"2023-10-14T10:33:49.211843+0000","last_undegraded":"2023-10-14T10:33:49.211843+0000","last_fullsized":"2023-10-14T10:33:49.211843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651892+0000","last_change":"2023-10-14T10:33:46.951335+0000","last_active":"2023-10-14T10:33:49.651892+0000","last_peered":"2023-10-14T10:33:49.651892+0000","last_clean":"2023-10-14T10:33:49.651892+0000","last_became_active":"2023-10-14T10:33:46.950717+0000","last_became_peered":"2023-10-14T10:33:46.950717+0000","last_unstale":"2023-10-14T10:33:49.651892+0000","last_undegraded":"2023-10-14T10:33:49.651892+0000","last_fullsized":"2023-10-14T10:33:49.651892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:35.235012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652648+0000","last_change":"2023-10-14T10:33:47.486246+0000","last_active":"2023-10-14T10:33:49.652648+0000","last_peered":"2023-10-14T10:33:49.652648+0000","last_clean":"2023-10-14T10:33:49.652648+0000","last_became_active":"2023-10-14T10:33:47.485935+0000","last_became_peered":"2023-10-14T10:33:47.485935+0000","last_unstale":"2023-10-14T10:33:49.652648+0000","last_undegraded":"2023-10-14T10:33:49.652648+0000","last_fullsized":"2023-10-14T10:33:49.652648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:29.655910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651005+0000","last_change":"2023-10-14T10:33:46.932409+0000","last_active":"2023-10-14T10:33:49.651005+0000","last_peered":"2023-10-14T10:33:49.651005+0000","last_clean":"2023-10-14T10:33:49.651005+0000","last_became_active":"2023-10-14T10:33:46.932081+0000","last_became_peered":"2023-10-14T10:33:46.932081+0000","last_unstale":"2023-10-14T10:33:49.651005+0000","last_undegraded":"2023-10-14T10:33:49.651005+0000","last_fullsized":"2023-10-14T10:33:49.651005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:35.235012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456692+0000","last_change":"2023-10-14T10:33:47.472076+0000","last_active":"2023-10-14T10:33:48.456692+0000","last_peered":"2023-10-14T10:33:48.456692+0000","last_clean":"2023-10-14T10:33:48.456692+0000","last_became_active":"2023-10-14T10:33:47.471729+0000","last_became_peered":"2023-10-14T10:33:47.471729+0000","last_unstale":"2023-10-14T10:33:48.456692+0000","last_undegraded":"2023-10-14T10:33:48.456692+0000","last_fullsized":"2023-10-14T10:33:48.456692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463351+0000","last_change":"2023-10-14T10:33:46.940624+0000","last_active":"2023-10-14T10:33:48.463351+0000","last_peered":"2023-10-14T10:33:48.463351+0000","last_clean":"2023-10-14T10:33:48.463351+0000","last_became_active":"2023-10-14T10:33:46.939832+0000","last_became_peered":"2023-10-14T10:33:46.939832+0000","last_unstale":"2023-10-14T10:33:48.463351+0000","last_undegraded":"2023-10-14T10:33:48.463351+0000","last_fullsized":"2023-10-14T10:33:48.463351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:14.846393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460408+0000","last_change":"2023-10-14T10:33:47.482352+0000","last_active":"2023-10-14T10:33:48.460408+0000","last_peered":"2023-10-14T10:33:48.460408+0000","last_clean":"2023-10-14T10:33:48.460408+0000","last_became_active":"2023-10-14T10:33:47.482107+0000","last_became_peered":"2023-10-14T10:33:47.482107+0000","last_unstale":"2023-10-14T10:33:48.460408+0000","last_undegraded":"2023-10-14T10:33:48.460408+0000","last_fullsized":"2023-10-14T10:33:48.460408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:34:46.239394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456396+0000","last_change":"2023-10-14T10:33:46.938082+0000","last_active":"2023-10-14T10:33:48.456396+0000","last_peered":"2023-10-14T10:33:48.456396+0000","last_clean":"2023-10-14T10:33:48.456396+0000","last_became_active":"2023-10-14T10:33:46.937753+0000","last_became_peered":"2023-10-14T10:33:46.937753+0000","last_unstale":"2023-10-14T10:33:48.456396+0000","last_undegraded":"2023-10-14T10:33:48.456396+0000","last_fullsized":"2023-10-14T10:33:48.456396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:24.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462602+0000","last_change":"2023-10-14T10:33:47.476592+0000","last_active":"2023-10-14T10:33:48.462602+0000","last_peered":"2023-10-14T10:33:48.462602+0000","last_clean":"2023-10-14T10:33:48.462602+0000","last_became_active":"2023-10-14T10:33:47.476154+0000","last_became_peered":"2023-10-14T10:33:47.476154+0000","last_unstale":"2023-10-14T10:33:48.462602+0000","last_undegraded":"2023-10-14T10:33:48.462602+0000","last_fullsized":"2023-10-14T10:33:48.462602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:10.602705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654137+0000","last_change":"2023-10-14T10:33:46.953499+0000","last_active":"2023-10-14T10:33:49.654137+0000","last_peered":"2023-10-14T10:33:49.654137+0000","last_clean":"2023-10-14T10:33:49.654137+0000","last_became_active":"2023-10-14T10:33:46.953253+0000","last_became_peered":"2023-10-14T10:33:46.953253+0000","last_unstale":"2023-10-14T10:33:49.654137+0000","last_undegraded":"2023-10-14T10:33:49.654137+0000","last_fullsized":"2023-10-14T10:33:49.654137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:05.299234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456292+0000","last_change":"2023-10-14T10:33:47.474355+0000","last_active":"2023-10-14T10:33:48.456292+0000","last_peered":"2023-10-14T10:33:48.456292+0000","last_clean":"2023-10-14T10:33:48.456292+0000","last_became_active":"2023-10-14T10:33:47.473947+0000","last_became_peered":"2023-10-14T10:33:47.473947+0000","last_unstale":"2023-10-14T10:33:48.456292+0000","last_undegraded":"2023-10-14T10:33:48.456292+0000","last_fullsized":"2023-10-14T10:33:48.456292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.668975+0000","last_change":"2023-10-14T10:33:46.946715+0000","last_active":"2023-10-14T10:33:49.668975+0000","last_peered":"2023-10-14T10:33:49.668975+0000","last_clean":"2023-10-14T10:33:49.668975+0000","last_became_active":"2023-10-14T10:33:46.946368+0000","last_became_peered":"2023-10-14T10:33:46.946368+0000","last_unstale":"2023-10-14T10:33:49.668975+0000","last_undegraded":"2023-10-14T10:33:49.668975+0000","last_fullsized":"2023-10-14T10:33:49.668975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.213127+0000","last_change":"2023-10-14T10:33:47.494870+0000","last_active":"2023-10-14T10:33:49.213127+0000","last_peered":"2023-10-14T10:33:49.213127+0000","last_clean":"2023-10-14T10:33:49.213127+0000","last_became_active":"2023-10-14T10:33:47.494561+0000","last_became_peered":"2023-10-14T10:33:47.494561+0000","last_unstale":"2023-10-14T10:33:49.213127+0000","last_undegraded":"2023-10-14T10:33:49.213127+0000","last_fullsized":"2023-10-14T10:33:49.213127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:00.621252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652945+0000","last_change":"2023-10-14T10:33:46.952942+0000","last_active":"2023-10-14T10:33:49.652945+0000","last_peered":"2023-10-14T10:33:49.652945+0000","last_clean":"2023-10-14T10:33:49.652945+0000","last_became_active":"2023-10-14T10:33:46.952649+0000","last_became_peered":"2023-10-14T10:33:46.952649+0000","last_unstale":"2023-10-14T10:33:49.652945+0000","last_undegraded":"2023-10-14T10:33:49.652945+0000","last_fullsized":"2023-10-14T10:33:49.652945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:01.285291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653758+0000","last_change":"2023-10-14T10:33:47.481610+0000","last_active":"2023-10-14T10:33:49.653758+0000","last_peered":"2023-10-14T10:33:49.653758+0000","last_clean":"2023-10-14T10:33:49.653758+0000","last_became_active":"2023-10-14T10:33:47.481134+0000","last_became_peered":"2023-10-14T10:33:47.481134+0000","last_unstale":"2023-10-14T10:33:49.653758+0000","last_undegraded":"2023-10-14T10:33:49.653758+0000","last_fullsized":"2023-10-14T10:33:49.653758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651537+0000","last_change":"2023-10-14T10:33:46.951887+0000","last_active":"2023-10-14T10:33:49.651537+0000","last_peered":"2023-10-14T10:33:49.651537+0000","last_clean":"2023-10-14T10:33:49.651537+0000","last_became_active":"2023-10-14T10:33:46.951005+0000","last_became_peered":"2023-10-14T10:33:46.951005+0000","last_unstale":"2023-10-14T10:33:49.651537+0000","last_undegraded":"2023-10-14T10:33:49.651537+0000","last_fullsized":"2023-10-14T10:33:49.651537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:44.489158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460796+0000","last_change":"2023-10-14T10:33:47.472416+0000","last_active":"2023-10-14T10:33:48.460796+0000","last_peered":"2023-10-14T10:33:48.460796+0000","last_clean":"2023-10-14T10:33:48.460796+0000","last_became_active":"2023-10-14T10:33:47.472042+0000","last_became_peered":"2023-10-14T10:33:47.472042+0000","last_unstale":"2023-10-14T10:33:48.460796+0000","last_undegraded":"2023-10-14T10:33:48.460796+0000","last_fullsized":"2023-10-14T10:33:48.460796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:08.668848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456421+0000","last_change":"2023-10-14T10:33:46.943709+0000","last_active":"2023-10-14T10:33:48.456421+0000","last_peered":"2023-10-14T10:33:48.456421+0000","last_clean":"2023-10-14T10:33:48.456421+0000","last_became_active":"2023-10-14T10:33:46.943331+0000","last_became_peered":"2023-10-14T10:33:46.943331+0000","last_unstale":"2023-10-14T10:33:48.456421+0000","last_undegraded":"2023-10-14T10:33:48.456421+0000","last_fullsized":"2023-10-14T10:33:48.456421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212270+0000","last_change":"2023-10-14T10:33:47.485638+0000","last_active":"2023-10-14T10:33:49.212270+0000","last_peered":"2023-10-14T10:33:49.212270+0000","last_clean":"2023-10-14T10:33:49.212270+0000","last_became_active":"2023-10-14T10:33:47.485152+0000","last_became_peered":"2023-10-14T10:33:47.485152+0000","last_unstale":"2023-10-14T10:33:49.212270+0000","last_undegraded":"2023-10-14T10:33:49.212270+0000","last_fullsized":"2023-10-14T10:33:49.212270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456868+0000","last_change":"2023-10-14T10:33:46.940511+0000","last_active":"2023-10-14T10:33:48.456868+0000","last_peered":"2023-10-14T10:33:48.456868+0000","last_clean":"2023-10-14T10:33:48.456868+0000","last_became_active":"2023-10-14T10:33:46.940203+0000","last_became_peered":"2023-10-14T10:33:46.940203+0000","last_unstale":"2023-10-14T10:33:48.456868+0000","last_undegraded":"2023-10-14T10:33:48.456868+0000","last_fullsized":"2023-10-14T10:33:48.456868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:34.060298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212360+0000","last_change":"2023-10-14T10:33:47.484334+0000","last_active":"2023-10-14T10:33:49.212360+0000","last_peered":"2023-10-14T10:33:49.212360+0000","last_clean":"2023-10-14T10:33:49.212360+0000","last_became_active":"2023-10-14T10:33:47.484053+0000","last_became_peered":"2023-10-14T10:33:47.484053+0000","last_unstale":"2023-10-14T10:33:49.212360+0000","last_undegraded":"2023-10-14T10:33:49.212360+0000","last_fullsized":"2023-10-14T10:33:49.212360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653506+0000","last_change":"2023-10-14T10:33:46.952342+0000","last_active":"2023-10-14T10:33:49.653506+0000","last_peered":"2023-10-14T10:33:49.653506+0000","last_clean":"2023-10-14T10:33:49.653506+0000","last_became_active":"2023-10-14T10:33:46.952054+0000","last_became_peered":"2023-10-14T10:33:46.952054+0000","last_unstale":"2023-10-14T10:33:49.653506+0000","last_undegraded":"2023-10-14T10:33:49.653506+0000","last_fullsized":"2023-10-14T10:33:49.653506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:07.405544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652415+0000","last_change":"2023-10-14T10:33:47.483290+0000","last_active":"2023-10-14T10:33:49.652415+0000","last_peered":"2023-10-14T10:33:49.652415+0000","last_clean":"2023-10-14T10:33:49.652415+0000","last_became_active":"2023-10-14T10:33:47.482376+0000","last_became_peered":"2023-10-14T10:33:47.482376+0000","last_unstale":"2023-10-14T10:33:49.652415+0000","last_undegraded":"2023-10-14T10:33:49.652415+0000","last_fullsized":"2023-10-14T10:33:49.652415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462475+0000","last_change":"2023-10-14T10:33:47.474830+0000","last_active":"2023-10-14T10:33:48.462475+0000","last_peered":"2023-10-14T10:33:48.462475+0000","last_clean":"2023-10-14T10:33:48.462475+0000","last_became_active":"2023-10-14T10:33:47.474496+0000","last_became_peered":"2023-10-14T10:33:47.474496+0000","last_unstale":"2023-10-14T10:33:48.462475+0000","last_undegraded":"2023-10-14T10:33:48.462475+0000","last_fullsized":"2023-10-14T10:33:48.462475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:00.621252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653758+0000","last_change":"2023-10-14T10:33:46.952550+0000","last_active":"2023-10-14T10:33:49.653758+0000","last_peered":"2023-10-14T10:33:49.653758+0000","last_clean":"2023-10-14T10:33:49.653758+0000","last_became_active":"2023-10-14T10:33:46.952221+0000","last_became_peered":"2023-10-14T10:33:46.952221+0000","last_unstale":"2023-10-14T10:33:49.653758+0000","last_undegraded":"2023-10-14T10:33:49.653758+0000","last_fullsized":"2023-10-14T10:33:49.653758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462966+0000","last_change":"2023-10-14T10:33:47.480595+0000","last_active":"2023-10-14T10:33:48.462966+0000","last_peered":"2023-10-14T10:33:48.462966+0000","last_clean":"2023-10-14T10:33:48.462966+0000","last_became_active":"2023-10-14T10:33:47.479987+0000","last_became_peered":"2023-10-14T10:33:47.479987+0000","last_unstale":"2023-10-14T10:33:48.462966+0000","last_undegraded":"2023-10-14T10:33:48.462966+0000","last_fullsized":"2023-10-14T10:33:48.462966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:20.511159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654009+0000","last_change":"2023-10-14T10:33:46.956415+0000","last_active":"2023-10-14T10:33:49.654009+0000","last_peered":"2023-10-14T10:33:49.654009+0000","last_clean":"2023-10-14T10:33:49.654009+0000","last_became_active":"2023-10-14T10:33:46.956031+0000","last_became_peered":"2023-10-14T10:33:46.956031+0000","last_unstale":"2023-10-14T10:33:49.654009+0000","last_undegraded":"2023-10-14T10:33:49.654009+0000","last_fullsized":"2023-10-14T10:33:49.654009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:51.370720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654052+0000","last_change":"2023-10-14T10:33:47.487837+0000","last_active":"2023-10-14T10:33:49.654052+0000","last_peered":"2023-10-14T10:33:49.654052+0000","last_clean":"2023-10-14T10:33:49.654052+0000","last_became_active":"2023-10-14T10:33:47.487230+0000","last_became_peered":"2023-10-14T10:33:47.487230+0000","last_unstale":"2023-10-14T10:33:49.654052+0000","last_undegraded":"2023-10-14T10:33:49.654052+0000","last_fullsized":"2023-10-14T10:33:49.654052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.213080+0000","last_change":"2023-10-14T10:33:46.941475+0000","last_active":"2023-10-14T10:33:49.213080+0000","last_peered":"2023-10-14T10:33:49.213080+0000","last_clean":"2023-10-14T10:33:49.213080+0000","last_became_active":"2023-10-14T10:33:46.941184+0000","last_became_peered":"2023-10-14T10:33:46.941184+0000","last_unstale":"2023-10-14T10:33:49.213080+0000","last_undegraded":"2023-10-14T10:33:49.213080+0000","last_fullsized":"2023-10-14T10:33:49.213080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212744+0000","last_change":"2023-10-14T10:33:47.488896+0000","last_active":"2023-10-14T10:33:49.212744+0000","last_peered":"2023-10-14T10:33:49.212744+0000","last_clean":"2023-10-14T10:33:49.212744+0000","last_became_active":"2023-10-14T10:33:47.488561+0000","last_became_peered":"2023-10-14T10:33:47.488561+0000","last_unstale":"2023-10-14T10:33:49.212744+0000","last_undegraded":"2023-10-14T10:33:49.212744+0000","last_fullsized":"2023-10-14T10:33:49.212744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:47.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654339+0000","last_change":"2023-10-14T10:33:46.951000+0000","last_active":"2023-10-14T10:33:49.654339+0000","last_peered":"2023-10-14T10:33:49.654339+0000","last_clean":"2023-10-14T10:33:49.654339+0000","last_became_active":"2023-10-14T10:33:46.950678+0000","last_became_peered":"2023-10-14T10:33:46.950678+0000","last_unstale":"2023-10-14T10:33:49.654339+0000","last_undegraded":"2023-10-14T10:33:49.654339+0000","last_fullsized":"2023-10-14T10:33:49.654339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.74}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.698}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9730000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4159999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.101}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.788}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5960000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0070000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T10:33:58.166 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T10:33:58.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.423+0000 7fd8a56c3640 1 Processor -- start 2023-10-14T10:33:58.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.423+0000 7fd8a56c3640 1 -- start start 2023-10-14T10:33:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.425+0000 7fd8a56c3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8a014abb0 0x7fd8a0151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.425+0000 7fd8a56c3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8a00a9610 0x7fd8a00c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.425+0000 7fd8a56c3640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a0071650 con 0x7fd8a00c2650 2023-10-14T10:33:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.425+0000 7fd8a56c3640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a00a9280 con 0x7fd8a014abb0 2023-10-14T10:33:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.425+0000 7fd8a56c3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a00aa6f0 con 0x7fd8a00a9610 2023-10-14T10:33:58.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.425+0000 7fd89ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8a014abb0 0x7fd8a0151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:58.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.425+0000 7fd89ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8a014abb0 0x7fd8a0151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40716/0 (socket says 172.21.15.8:40716) 2023-10-14T10:33:58.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.425+0000 7fd89ffff640 1 -- 172.21.15.8:0/147193629 learned_addr learned my addr 172.21.15.8:0/147193629 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:58.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.425+0000 7fd8977fe640 1 --2- 172.21.15.8:0/147193629 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8a00a9610 0x7fd8a00c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:58.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.426+0000 7fd89ffff640 1 -- 172.21.15.8:0/147193629 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8a00a9610 msgr2=0x7fd8a00c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:58.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.426+0000 7fd89ffff640 1 --2- 172.21.15.8:0/147193629 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8a00a9610 0x7fd8a00c2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.426+0000 7fd89ffff640 1 -- 172.21.15.8:0/147193629 >> v1:172.21.15.92:6789/0 conn(0x7fd8a00c2650 legacy=0x7fd8a006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.426+0000 7fd89ffff640 1 -- 172.21.15.8:0/147193629 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00a81e0 con 0x7fd8a014abb0 2023-10-14T10:33:58.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.427+0000 7fd89ffff640 1 --2- 172.21.15.8:0/147193629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8a014abb0 0x7fd8a0151470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd89000bb10 tx=0x7fd89002e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2c7499828504f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:58.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.427+0000 7fd89f7fe640 1 -- 172.21.15.8:0/147193629 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890036440 con 0x7fd8a014abb0 2023-10-14T10:33:58.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.427+0000 7fd89f7fe640 1 -- 172.21.15.8:0/147193629 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8900365a0 con 0x7fd8a014abb0 2023-10-14T10:33:58.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.427+0000 7fd89f7fe640 1 -- 172.21.15.8:0/147193629 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890036930 con 0x7fd8a014abb0 2023-10-14T10:33:58.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.428+0000 7fd8a56c3640 1 -- 172.21.15.8:0/147193629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8a014abb0 msgr2=0x7fd8a0151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.428+0000 7fd8a56c3640 1 --2- 172.21.15.8:0/147193629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8a014abb0 0x7fd8a0151470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd89000bb10 tx=0x7fd89002e150 comp rx=0 tx=0).stop 2023-10-14T10:33:58.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.428+0000 7fd8a56c3640 1 -- 172.21.15.8:0/147193629 shutdown_connections 2023-10-14T10:33:58.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.428+0000 7fd8a56c3640 1 --2- 172.21.15.8:0/147193629 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8a00a9610 0x7fd8a00c2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.428+0000 7fd8a56c3640 1 --2- 172.21.15.8:0/147193629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8a014abb0 0x7fd8a0151470 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.428+0000 7fd8a56c3640 1 -- 172.21.15.8:0/147193629 >> 172.21.15.8:0/147193629 conn(0x7fd8a006a200 msgr2=0x7fd8a006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:58.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.428+0000 7fd8a56c3640 1 -- 172.21.15.8:0/147193629 shutdown_connections 2023-10-14T10:33:58.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.428+0000 7fd8a56c3640 1 -- 172.21.15.8:0/147193629 wait complete. 2023-10-14T10:33:58.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.430+0000 7fd8a56c3640 1 Processor -- start 2023-10-14T10:33:58.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.430+0000 7fd8a56c3640 1 -- start start 2023-10-14T10:33:58.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd8a56c3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8a00a9610 0x7fd8a00bece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd8a56c3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8a00c2650 0x7fd8a01ecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd8a56c3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8a014abb0 0x7fd8a01ed110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd8a56c3640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0150e90 con 0x7fd8a00a9610 2023-10-14T10:33:58.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd8a56c3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a01df820 con 0x7fd8a014abb0 2023-10-14T10:33:58.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd8a56c3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a01dfb00 con 0x7fd8a00c2650 2023-10-14T10:33:58.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd89ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8a00a9610 0x7fd8a00bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:58.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd89ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8a00a9610 0x7fd8a00bece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40718/0 (socket says 172.21.15.8:40718) 2023-10-14T10:33:58.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd89ffff640 1 -- 172.21.15.8:0/2493287945 learned_addr learned my addr 172.21.15.8:0/2493287945 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:58.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd89ffff640 1 -- 172.21.15.8:0/2493287945 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8a00c2650 msgr2=0x7fd8a01ecbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd89ffff640 1 --2- 172.21.15.8:0/2493287945 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8a00c2650 0x7fd8a01ecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd89ffff640 1 -- 172.21.15.8:0/2493287945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8a014abb0 msgr2=0x7fd8a01ed110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd89ffff640 1 --2- 172.21.15.8:0/2493287945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8a014abb0 0x7fd8a01ed110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.431+0000 7fd89ffff640 1 -- 172.21.15.8:0/2493287945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89000b770 con 0x7fd8a00a9610 2023-10-14T10:33:58.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.432+0000 7fd89ffff640 1 --2- 172.21.15.8:0/2493287945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8a00a9610 0x7fd8a00bece0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd89002e190 tx=0x7fd8900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:58.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.432+0000 7fd89d7fa640 1 -- 172.21.15.8:0/2493287945 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890036440 con 0x7fd8a00a9610 2023-10-14T10:33:58.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.432+0000 7fd89d7fa640 1 -- 172.21.15.8:0/2493287945 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd890034ba0 con 0x7fd8a00a9610 2023-10-14T10:33:58.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.432+0000 7fd8a56c3640 1 -- 172.21.15.8:0/2493287945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a01dfde0 con 0x7fd8a00a9610 2023-10-14T10:33:58.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.432+0000 7fd89d7fa640 1 -- 172.21.15.8:0/2493287945 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890041460 con 0x7fd8a00a9610 2023-10-14T10:33:58.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.432+0000 7fd8a56c3640 1 -- 172.21.15.8:0/2493287945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a00bf220 con 0x7fd8a00a9610 2023-10-14T10:33:58.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.433+0000 7fd8a56c3640 1 -- 172.21.15.8:0/2493287945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a01ec8f0 con 0x7fd8a00a9610 2023-10-14T10:33:58.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.434+0000 7fd89d7fa640 1 -- 172.21.15.8:0/2493287945 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd890049360 con 0x7fd8a00a9610 2023-10-14T10:33:58.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.435+0000 7fd89d7fa640 1 --2- 172.21.15.8:0/2493287945 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd88006ae70 0x7fd88006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.435+0000 7fd89d7fa640 1 -- 172.21.15.8:0/2493287945 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8900aba50 con 0x7fd8a00a9610 2023-10-14T10:33:58.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.435+0000 7fd8977fe640 1 --2- 172.21.15.8:0/2493287945 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd88006ae70 0x7fd88006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:58.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.436+0000 7fd8977fe640 1 --2- 172.21.15.8:0/2493287945 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd88006ae70 0x7fd88006d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd888006a90 tx=0x7fd888006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:58.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.439+0000 7fd89d7fa640 1 -- 172.21.15.8:0/2493287945 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8a01ec8f0 con 0x7fd8a00a9610 2023-10-14T10:33:58.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.624+0000 7fd8a56c3640 1 -- 172.21.15.8:0/2493287945 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8a00a87a0 con 0x7fd88006ae70 2023-10-14T10:33:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.637+0000 7fd89d7fa640 1 -- 172.21.15.8:0/2493287945 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264350 (secure 0 0 0) 0x7fd88800e860 con 0x7fd88006ae70 2023-10-14T10:33:58.643 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T10:33:58.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.643+0000 7fd8a56c3640 1 -- 172.21.15.8:0/2493287945 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd88006ae70 msgr2=0x7fd88006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.643+0000 7fd8a56c3640 1 --2- 172.21.15.8:0/2493287945 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd88006ae70 0x7fd88006d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd888006a90 tx=0x7fd888006a20 comp rx=0 tx=0).stop 2023-10-14T10:33:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.643+0000 7fd8a56c3640 1 -- 172.21.15.8:0/2493287945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8a00a9610 msgr2=0x7fd8a00bece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.643+0000 7fd8a56c3640 1 --2- 172.21.15.8:0/2493287945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8a00a9610 0x7fd8a00bece0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd89002e190 tx=0x7fd8900046c0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.643+0000 7fd8a56c3640 1 -- 172.21.15.8:0/2493287945 shutdown_connections 2023-10-14T10:33:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.643+0000 7fd8a56c3640 1 --2- 172.21.15.8:0/2493287945 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd88006ae70 0x7fd88006d330 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.643+0000 7fd8a56c3640 1 --2- 172.21.15.8:0/2493287945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8a014abb0 0x7fd8a01ed110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.643+0000 7fd8a56c3640 1 --2- 172.21.15.8:0/2493287945 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8a00c2650 0x7fd8a01ecbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.643+0000 7fd8a56c3640 1 --2- 172.21.15.8:0/2493287945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8a00a9610 0x7fd8a00bece0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.643+0000 7fd8a56c3640 1 -- 172.21.15.8:0/2493287945 >> 172.21.15.8:0/2493287945 conn(0x7fd8a006a200 msgr2=0x7fd8a006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.643+0000 7fd8a56c3640 1 -- 172.21.15.8:0/2493287945 shutdown_connections 2023-10-14T10:33:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.643+0000 7fd8a56c3640 1 -- 172.21.15.8:0/2493287945 wait complete. 2023-10-14T10:33:58.663 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-14T10:33:56.638511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235752,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738968,"statfs":{"total":773094113280,"available":772852703232,"internally_reserved":0,"allocated":2990080,"data_stored":1790108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.188638"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654359+0000","last_change":"2023-10-14T10:33:47.504191+0000","last_active":"2023-10-14T10:33:49.654359+0000","last_peered":"2023-10-14T10:33:49.654359+0000","last_clean":"2023-10-14T10:33:49.654359+0000","last_became_active":"2023-10-14T10:33:47.503838+0000","last_became_peered":"2023-10-14T10:33:47.503838+0000","last_unstale":"2023-10-14T10:33:49.654359+0000","last_undegraded":"2023-10-14T10:33:49.654359+0000","last_fullsized":"2023-10-14T10:33:49.654359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:37.834157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456736+0000","last_change":"2023-10-14T10:33:47.486126+0000","last_active":"2023-10-14T10:33:48.456736+0000","last_peered":"2023-10-14T10:33:48.456736+0000","last_clean":"2023-10-14T10:33:48.456736+0000","last_became_active":"2023-10-14T10:33:47.484535+0000","last_became_peered":"2023-10-14T10:33:47.484535+0000","last_unstale":"2023-10-14T10:33:48.456736+0000","last_undegraded":"2023-10-14T10:33:48.456736+0000","last_fullsized":"2023-10-14T10:33:48.456736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653537+0000","last_change":"2023-10-14T10:33:47.481217+0000","last_active":"2023-10-14T10:33:49.653537+0000","last_peered":"2023-10-14T10:33:49.653537+0000","last_clean":"2023-10-14T10:33:49.653537+0000","last_became_active":"2023-10-14T10:33:47.480170+0000","last_became_peered":"2023-10-14T10:33:47.480170+0000","last_unstale":"2023-10-14T10:33:49.653537+0000","last_undegraded":"2023-10-14T10:33:49.653537+0000","last_fullsized":"2023-10-14T10:33:49.653537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462757+0000","last_change":"2023-10-14T10:33:47.481641+0000","last_active":"2023-10-14T10:33:48.462757+0000","last_peered":"2023-10-14T10:33:48.462757+0000","last_clean":"2023-10-14T10:33:48.462757+0000","last_became_active":"2023-10-14T10:33:47.481143+0000","last_became_peered":"2023-10-14T10:33:47.481143+0000","last_unstale":"2023-10-14T10:33:48.462757+0000","last_undegraded":"2023-10-14T10:33:48.462757+0000","last_fullsized":"2023-10-14T10:33:48.462757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:13:18.695800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653106+0000","last_change":"2023-10-14T10:33:47.495716+0000","last_active":"2023-10-14T10:33:49.653106+0000","last_peered":"2023-10-14T10:33:49.653106+0000","last_clean":"2023-10-14T10:33:49.653106+0000","last_became_active":"2023-10-14T10:33:47.495391+0000","last_became_peered":"2023-10-14T10:33:47.495391+0000","last_unstale":"2023-10-14T10:33:49.653106+0000","last_undegraded":"2023-10-14T10:33:49.653106+0000","last_fullsized":"2023-10-14T10:33:49.653106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:00.621252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462279+0000","last_change":"2023-10-14T10:33:47.485901+0000","last_active":"2023-10-14T10:33:48.462279+0000","last_peered":"2023-10-14T10:33:48.462279+0000","last_clean":"2023-10-14T10:33:48.462279+0000","last_became_active":"2023-10-14T10:33:47.485410+0000","last_became_peered":"2023-10-14T10:33:47.485410+0000","last_unstale":"2023-10-14T10:33:48.462279+0000","last_undegraded":"2023-10-14T10:33:48.462279+0000","last_fullsized":"2023-10-14T10:33:48.462279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:13.355108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651994+0000","last_change":"2023-10-14T10:33:47.494929+0000","last_active":"2023-10-14T10:33:49.651994+0000","last_peered":"2023-10-14T10:33:49.651994+0000","last_clean":"2023-10-14T10:33:49.651994+0000","last_became_active":"2023-10-14T10:33:47.494645+0000","last_became_peered":"2023-10-14T10:33:47.494645+0000","last_unstale":"2023-10-14T10:33:49.651994+0000","last_undegraded":"2023-10-14T10:33:49.651994+0000","last_fullsized":"2023-10-14T10:33:49.651994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:47.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.211860+0000","last_change":"2023-10-14T10:33:47.480684+0000","last_active":"2023-10-14T10:33:49.211860+0000","last_peered":"2023-10-14T10:33:49.211860+0000","last_clean":"2023-10-14T10:33:49.211860+0000","last_became_active":"2023-10-14T10:33:47.480247+0000","last_became_peered":"2023-10-14T10:33:47.480247+0000","last_unstale":"2023-10-14T10:33:49.211860+0000","last_undegraded":"2023-10-14T10:33:49.211860+0000","last_fullsized":"2023-10-14T10:33:49.211860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654569+0000","last_change":"2023-10-14T10:33:47.500899+0000","last_active":"2023-10-14T10:33:49.654569+0000","last_peered":"2023-10-14T10:33:49.654569+0000","last_clean":"2023-10-14T10:33:49.654569+0000","last_became_active":"2023-10-14T10:33:47.500541+0000","last_became_peered":"2023-10-14T10:33:47.500541+0000","last_unstale":"2023-10-14T10:33:49.654569+0000","last_undegraded":"2023-10-14T10:33:49.654569+0000","last_fullsized":"2023-10-14T10:33:49.654569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:03.978194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653275+0000","last_change":"2023-10-14T10:33:47.484954+0000","last_active":"2023-10-14T10:33:49.653275+0000","last_peered":"2023-10-14T10:33:49.653275+0000","last_clean":"2023-10-14T10:33:49.653275+0000","last_became_active":"2023-10-14T10:33:47.484596+0000","last_became_peered":"2023-10-14T10:33:47.484596+0000","last_unstale":"2023-10-14T10:33:49.653275+0000","last_undegraded":"2023-10-14T10:33:49.653275+0000","last_fullsized":"2023-10-14T10:33:49.653275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652603+0000","last_change":"2023-10-14T10:33:47.503231+0000","last_active":"2023-10-14T10:33:49.652603+0000","last_peered":"2023-10-14T10:33:49.652603+0000","last_clean":"2023-10-14T10:33:49.652603+0000","last_became_active":"2023-10-14T10:33:47.496705+0000","last_became_peered":"2023-10-14T10:33:47.496705+0000","last_unstale":"2023-10-14T10:33:49.652603+0000","last_undegraded":"2023-10-14T10:33:49.652603+0000","last_fullsized":"2023-10-14T10:33:49.652603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.459938+0000","last_change":"2023-10-14T10:33:47.502726+0000","last_active":"2023-10-14T10:33:48.459938+0000","last_peered":"2023-10-14T10:33:48.459938+0000","last_clean":"2023-10-14T10:33:48.459938+0000","last_became_active":"2023-10-14T10:33:47.501799+0000","last_became_peered":"2023-10-14T10:33:47.501799+0000","last_unstale":"2023-10-14T10:33:48.459938+0000","last_undegraded":"2023-10-14T10:33:48.459938+0000","last_fullsized":"2023-10-14T10:33:48.459938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:10:51.321625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212506+0000","last_change":"2023-10-14T10:33:47.488816+0000","last_active":"2023-10-14T10:33:49.212506+0000","last_peered":"2023-10-14T10:33:49.212506+0000","last_clean":"2023-10-14T10:33:49.212506+0000","last_became_active":"2023-10-14T10:33:47.488505+0000","last_became_peered":"2023-10-14T10:33:47.488505+0000","last_unstale":"2023-10-14T10:33:49.212506+0000","last_undegraded":"2023-10-14T10:33:49.212506+0000","last_fullsized":"2023-10-14T10:33:49.212506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.305043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652714+0000","last_change":"2023-10-14T10:33:47.482197+0000","last_active":"2023-10-14T10:33:49.652714+0000","last_peered":"2023-10-14T10:33:49.652714+0000","last_clean":"2023-10-14T10:33:49.652714+0000","last_became_active":"2023-10-14T10:33:47.481209+0000","last_became_peered":"2023-10-14T10:33:47.481209+0000","last_unstale":"2023-10-14T10:33:49.652714+0000","last_undegraded":"2023-10-14T10:33:49.652714+0000","last_fullsized":"2023-10-14T10:33:49.652714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:02.548595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456348+0000","last_change":"2023-10-14T10:33:47.469873+0000","last_active":"2023-10-14T10:33:48.456348+0000","last_peered":"2023-10-14T10:33:48.456348+0000","last_clean":"2023-10-14T10:33:48.456348+0000","last_became_active":"2023-10-14T10:33:47.469462+0000","last_became_peered":"2023-10-14T10:33:47.469462+0000","last_unstale":"2023-10-14T10:33:48.456348+0000","last_undegraded":"2023-10-14T10:33:48.456348+0000","last_fullsized":"2023-10-14T10:33:48.456348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.461731+0000","last_change":"2023-10-14T10:33:47.484628+0000","last_active":"2023-10-14T10:33:48.461731+0000","last_peered":"2023-10-14T10:33:48.461731+0000","last_clean":"2023-10-14T10:33:48.461731+0000","last_became_active":"2023-10-14T10:33:47.484319+0000","last_became_peered":"2023-10-14T10:33:47.484319+0000","last_unstale":"2023-10-14T10:33:48.461731+0000","last_undegraded":"2023-10-14T10:33:48.461731+0000","last_fullsized":"2023-10-14T10:33:48.461731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463105+0000","last_change":"2023-10-14T10:33:47.494508+0000","last_active":"2023-10-14T10:33:48.463105+0000","last_peered":"2023-10-14T10:33:48.463105+0000","last_clean":"2023-10-14T10:33:48.463105+0000","last_became_active":"2023-10-14T10:33:47.494119+0000","last_became_peered":"2023-10-14T10:33:47.494119+0000","last_unstale":"2023-10-14T10:33:48.463105+0000","last_undegraded":"2023-10-14T10:33:48.463105+0000","last_fullsized":"2023-10-14T10:33:48.463105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:37.834157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651364+0000","last_change":"2023-10-14T10:33:47.482878+0000","last_active":"2023-10-14T10:33:49.651364+0000","last_peered":"2023-10-14T10:33:49.651364+0000","last_clean":"2023-10-14T10:33:49.651364+0000","last_became_active":"2023-10-14T10:33:47.482566+0000","last_became_peered":"2023-10-14T10:33:47.482566+0000","last_unstale":"2023-10-14T10:33:49.651364+0000","last_undegraded":"2023-10-14T10:33:49.651364+0000","last_fullsized":"2023-10-14T10:33:49.651364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:08.668848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654211+0000","last_change":"2023-10-14T10:33:47.497038+0000","last_active":"2023-10-14T10:33:49.654211+0000","last_peered":"2023-10-14T10:33:49.654211+0000","last_clean":"2023-10-14T10:33:49.654211+0000","last_became_active":"2023-10-14T10:33:47.496705+0000","last_became_peered":"2023-10-14T10:33:47.496705+0000","last_unstale":"2023-10-14T10:33:49.654211+0000","last_undegraded":"2023-10-14T10:33:49.654211+0000","last_fullsized":"2023-10-14T10:33:49.654211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:20.511159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652680+0000","last_change":"2023-10-14T10:33:47.497999+0000","last_active":"2023-10-14T10:33:49.652680+0000","last_peered":"2023-10-14T10:33:49.652680+0000","last_clean":"2023-10-14T10:33:49.652680+0000","last_became_active":"2023-10-14T10:33:47.494872+0000","last_became_peered":"2023-10-14T10:33:47.494872+0000","last_unstale":"2023-10-14T10:33:49.652680+0000","last_undegraded":"2023-10-14T10:33:49.652680+0000","last_fullsized":"2023-10-14T10:33:49.652680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653148+0000","last_change":"2023-10-14T10:33:47.490809+0000","last_active":"2023-10-14T10:33:49.653148+0000","last_peered":"2023-10-14T10:33:49.653148+0000","last_clean":"2023-10-14T10:33:49.653148+0000","last_became_active":"2023-10-14T10:33:47.490523+0000","last_became_peered":"2023-10-14T10:33:47.490523+0000","last_unstale":"2023-10-14T10:33:49.653148+0000","last_undegraded":"2023-10-14T10:33:49.653148+0000","last_fullsized":"2023-10-14T10:33:49.653148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:28.374613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462234+0000","last_change":"2023-10-14T10:33:47.491586+0000","last_active":"2023-10-14T10:33:48.462234+0000","last_peered":"2023-10-14T10:33:48.462234+0000","last_clean":"2023-10-14T10:33:48.462234+0000","last_became_active":"2023-10-14T10:33:47.491262+0000","last_became_peered":"2023-10-14T10:33:47.491262+0000","last_unstale":"2023-10-14T10:33:48.462234+0000","last_undegraded":"2023-10-14T10:33:48.462234+0000","last_fullsized":"2023-10-14T10:33:48.462234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:47.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.211866+0000","last_change":"2023-10-14T10:33:47.479860+0000","last_active":"2023-10-14T10:33:49.211866+0000","last_peered":"2023-10-14T10:33:49.211866+0000","last_clean":"2023-10-14T10:33:49.211866+0000","last_became_active":"2023-10-14T10:33:47.479536+0000","last_became_peered":"2023-10-14T10:33:47.479536+0000","last_unstale":"2023-10-14T10:33:49.211866+0000","last_undegraded":"2023-10-14T10:33:49.211866+0000","last_fullsized":"2023-10-14T10:33:49.211866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.461909+0000","last_change":"2023-10-14T10:33:47.480950+0000","last_active":"2023-10-14T10:33:48.461909+0000","last_peered":"2023-10-14T10:33:48.461909+0000","last_clean":"2023-10-14T10:33:48.461909+0000","last_became_active":"2023-10-14T10:33:47.480623+0000","last_became_peered":"2023-10-14T10:33:47.480623+0000","last_unstale":"2023-10-14T10:33:48.461909+0000","last_undegraded":"2023-10-14T10:33:48.461909+0000","last_fullsized":"2023-10-14T10:33:48.461909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.305043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212838+0000","last_change":"2023-10-14T10:33:47.476116+0000","last_active":"2023-10-14T10:33:49.212838+0000","last_peered":"2023-10-14T10:33:49.212838+0000","last_clean":"2023-10-14T10:33:49.212838+0000","last_became_active":"2023-10-14T10:33:47.475806+0000","last_became_peered":"2023-10-14T10:33:47.475806+0000","last_unstale":"2023-10-14T10:33:49.212838+0000","last_undegraded":"2023-10-14T10:33:49.212838+0000","last_fullsized":"2023-10-14T10:33:49.212838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:13.355108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653449+0000","last_change":"2023-10-14T10:33:47.503282+0000","last_active":"2023-10-14T10:33:49.653449+0000","last_peered":"2023-10-14T10:33:49.653449+0000","last_clean":"2023-10-14T10:33:49.653449+0000","last_became_active":"2023-10-14T10:33:47.498347+0000","last_became_peered":"2023-10-14T10:33:47.498347+0000","last_unstale":"2023-10-14T10:33:49.653449+0000","last_undegraded":"2023-10-14T10:33:49.653449+0000","last_fullsized":"2023-10-14T10:33:49.653449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.305043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456488+0000","last_change":"2023-10-14T10:33:47.477397+0000","last_active":"2023-10-14T10:33:48.456488+0000","last_peered":"2023-10-14T10:33:48.456488+0000","last_clean":"2023-10-14T10:33:48.456488+0000","last_became_active":"2023-10-14T10:33:47.477023+0000","last_became_peered":"2023-10-14T10:33:47.477023+0000","last_unstale":"2023-10-14T10:33:48.456488+0000","last_undegraded":"2023-10-14T10:33:48.456488+0000","last_fullsized":"2023-10-14T10:33:48.456488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212867+0000","last_change":"2023-10-14T10:33:47.483158+0000","last_active":"2023-10-14T10:33:49.212867+0000","last_peered":"2023-10-14T10:33:49.212867+0000","last_clean":"2023-10-14T10:33:49.212867+0000","last_became_active":"2023-10-14T10:33:47.481098+0000","last_became_peered":"2023-10-14T10:33:47.481098+0000","last_unstale":"2023-10-14T10:33:49.212867+0000","last_undegraded":"2023-10-14T10:33:49.212867+0000","last_fullsized":"2023-10-14T10:33:49.212867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:58.057067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653230+0000","last_change":"2023-10-14T10:33:47.481204+0000","last_active":"2023-10-14T10:33:49.653230+0000","last_peered":"2023-10-14T10:33:49.653230+0000","last_clean":"2023-10-14T10:33:49.653230+0000","last_became_active":"2023-10-14T10:33:47.480212+0000","last_became_peered":"2023-10-14T10:33:47.480212+0000","last_unstale":"2023-10-14T10:33:49.653230+0000","last_undegraded":"2023-10-14T10:33:49.653230+0000","last_fullsized":"2023-10-14T10:33:49.653230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462667+0000","last_change":"2023-10-14T10:33:47.480818+0000","last_active":"2023-10-14T10:33:48.462667+0000","last_peered":"2023-10-14T10:33:48.462667+0000","last_clean":"2023-10-14T10:33:48.462667+0000","last_became_active":"2023-10-14T10:33:47.480593+0000","last_became_peered":"2023-10-14T10:33:47.480593+0000","last_unstale":"2023-10-14T10:33:48.462667+0000","last_undegraded":"2023-10-14T10:33:48.462667+0000","last_fullsized":"2023-10-14T10:33:48.462667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:11.483101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.650911+0000","last_change":"2023-10-14T10:33:47.477330+0000","last_active":"2023-10-14T10:33:49.650911+0000","last_peered":"2023-10-14T10:33:49.650911+0000","last_clean":"2023-10-14T10:33:49.650911+0000","last_became_active":"2023-10-14T10:33:47.476922+0000","last_became_peered":"2023-10-14T10:33:47.476922+0000","last_unstale":"2023-10-14T10:33:49.650911+0000","last_undegraded":"2023-10-14T10:33:49.650911+0000","last_fullsized":"2023-10-14T10:33:49.650911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:34:46.239394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651600+0000","last_change":"2023-10-14T10:33:47.496369+0000","last_active":"2023-10-14T10:33:49.651600+0000","last_peered":"2023-10-14T10:33:49.651600+0000","last_clean":"2023-10-14T10:33:49.651600+0000","last_became_active":"2023-10-14T10:33:47.494458+0000","last_became_peered":"2023-10-14T10:33:47.494458+0000","last_unstale":"2023-10-14T10:33:49.651600+0000","last_undegraded":"2023-10-14T10:33:49.651600+0000","last_fullsized":"2023-10-14T10:33:49.651600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.459427+0000","last_change":"2023-10-14T10:33:47.469801+0000","last_active":"2023-10-14T10:33:48.459427+0000","last_peered":"2023-10-14T10:33:48.459427+0000","last_clean":"2023-10-14T10:33:48.459427+0000","last_became_active":"2023-10-14T10:33:47.468284+0000","last_became_peered":"2023-10-14T10:33:47.468284+0000","last_unstale":"2023-10-14T10:33:48.459427+0000","last_undegraded":"2023-10-14T10:33:48.459427+0000","last_fullsized":"2023-10-14T10:33:48.459427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:35.323602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212468+0000","last_change":"2023-10-14T10:33:46.944464+0000","last_active":"2023-10-14T10:33:49.212468+0000","last_peered":"2023-10-14T10:33:49.212468+0000","last_clean":"2023-10-14T10:33:49.212468+0000","last_became_active":"2023-10-14T10:33:46.943975+0000","last_became_peered":"2023-10-14T10:33:46.943975+0000","last_unstale":"2023-10-14T10:33:49.212468+0000","last_undegraded":"2023-10-14T10:33:49.212468+0000","last_fullsized":"2023-10-14T10:33:49.212468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653470+0000","last_change":"2023-10-14T10:33:47.487990+0000","last_active":"2023-10-14T10:33:49.653470+0000","last_peered":"2023-10-14T10:33:49.653470+0000","last_clean":"2023-10-14T10:33:49.653470+0000","last_became_active":"2023-10-14T10:33:47.487504+0000","last_became_peered":"2023-10-14T10:33:47.487504+0000","last_unstale":"2023-10-14T10:33:49.653470+0000","last_undegraded":"2023-10-14T10:33:49.653470+0000","last_fullsized":"2023-10-14T10:33:49.653470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652732+0000","last_change":"2023-10-14T10:33:46.944422+0000","last_active":"2023-10-14T10:33:49.652732+0000","last_peered":"2023-10-14T10:33:49.652732+0000","last_clean":"2023-10-14T10:33:49.652732+0000","last_became_active":"2023-10-14T10:33:46.944045+0000","last_became_peered":"2023-10-14T10:33:46.944045+0000","last_unstale":"2023-10-14T10:33:49.652732+0000","last_undegraded":"2023-10-14T10:33:49.652732+0000","last_fullsized":"2023-10-14T10:33:49.652732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212102+0000","last_change":"2023-10-14T10:33:46.946032+0000","last_active":"2023-10-14T10:33:49.212102+0000","last_peered":"2023-10-14T10:33:49.212102+0000","last_clean":"2023-10-14T10:33:49.212102+0000","last_became_active":"2023-10-14T10:33:46.945694+0000","last_became_peered":"2023-10-14T10:33:46.945694+0000","last_unstale":"2023-10-14T10:33:49.212102+0000","last_undegraded":"2023-10-14T10:33:49.212102+0000","last_fullsized":"2023-10-14T10:33:49.212102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:35.235012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212057+0000","last_change":"2023-10-14T10:33:47.486768+0000","last_active":"2023-10-14T10:33:49.212057+0000","last_peered":"2023-10-14T10:33:49.212057+0000","last_clean":"2023-10-14T10:33:49.212057+0000","last_became_active":"2023-10-14T10:33:47.486477+0000","last_became_peered":"2023-10-14T10:33:47.486477+0000","last_unstale":"2023-10-14T10:33:49.212057+0000","last_undegraded":"2023-10-14T10:33:49.212057+0000","last_fullsized":"2023-10-14T10:33:49.212057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462041+0000","last_change":"2023-10-14T10:33:46.943179+0000","last_active":"2023-10-14T10:33:48.462041+0000","last_peered":"2023-10-14T10:33:48.462041+0000","last_clean":"2023-10-14T10:33:48.462041+0000","last_became_active":"2023-10-14T10:33:46.942887+0000","last_became_peered":"2023-10-14T10:33:46.942887+0000","last_unstale":"2023-10-14T10:33:48.462041+0000","last_undegraded":"2023-10-14T10:33:48.462041+0000","last_fullsized":"2023-10-14T10:33:48.462041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:01.285291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456237+0000","last_change":"2023-10-14T10:33:47.477341+0000","last_active":"2023-10-14T10:33:48.456237+0000","last_peered":"2023-10-14T10:33:48.456237+0000","last_clean":"2023-10-14T10:33:48.456237+0000","last_became_active":"2023-10-14T10:33:47.476425+0000","last_became_peered":"2023-10-14T10:33:47.476425+0000","last_unstale":"2023-10-14T10:33:48.456237+0000","last_undegraded":"2023-10-14T10:33:48.456237+0000","last_fullsized":"2023-10-14T10:33:48.456237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652803+0000","last_change":"2023-10-14T10:33:46.946573+0000","last_active":"2023-10-14T10:33:49.652803+0000","last_peered":"2023-10-14T10:33:49.652803+0000","last_clean":"2023-10-14T10:33:49.652803+0000","last_became_active":"2023-10-14T10:33:46.945846+0000","last_became_peered":"2023-10-14T10:33:46.945846+0000","last_unstale":"2023-10-14T10:33:49.652803+0000","last_undegraded":"2023-10-14T10:33:49.652803+0000","last_fullsized":"2023-10-14T10:33:49.652803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:28.392606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462337+0000","last_change":"2023-10-14T10:33:47.494832+0000","last_active":"2023-10-14T10:33:48.462337+0000","last_peered":"2023-10-14T10:33:48.462337+0000","last_clean":"2023-10-14T10:33:48.462337+0000","last_became_active":"2023-10-14T10:33:47.494306+0000","last_became_peered":"2023-10-14T10:33:47.494306+0000","last_unstale":"2023-10-14T10:33:48.462337+0000","last_undegraded":"2023-10-14T10:33:48.462337+0000","last_fullsized":"2023-10-14T10:33:48.462337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:58.057067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462569+0000","last_change":"2023-10-14T10:33:46.946908+0000","last_active":"2023-10-14T10:33:48.462569+0000","last_peered":"2023-10-14T10:33:48.462569+0000","last_clean":"2023-10-14T10:33:48.462569+0000","last_became_active":"2023-10-14T10:33:46.946623+0000","last_became_peered":"2023-10-14T10:33:46.946623+0000","last_unstale":"2023-10-14T10:33:48.462569+0000","last_undegraded":"2023-10-14T10:33:48.462569+0000","last_fullsized":"2023-10-14T10:33:48.462569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653979+0000","last_change":"2023-10-14T10:33:47.485672+0000","last_active":"2023-10-14T10:33:49.653979+0000","last_peered":"2023-10-14T10:33:49.653979+0000","last_clean":"2023-10-14T10:33:49.653979+0000","last_became_active":"2023-10-14T10:33:47.485336+0000","last_became_peered":"2023-10-14T10:33:47.485336+0000","last_unstale":"2023-10-14T10:33:49.653979+0000","last_undegraded":"2023-10-14T10:33:49.653979+0000","last_fullsized":"2023-10-14T10:33:49.653979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456519+0000","last_change":"2023-10-14T10:33:46.942861+0000","last_active":"2023-10-14T10:33:48.456519+0000","last_peered":"2023-10-14T10:33:48.456519+0000","last_clean":"2023-10-14T10:33:48.456519+0000","last_became_active":"2023-10-14T10:33:46.942559+0000","last_became_peered":"2023-10-14T10:33:46.942559+0000","last_unstale":"2023-10-14T10:33:48.456519+0000","last_undegraded":"2023-10-14T10:33:48.456519+0000","last_fullsized":"2023-10-14T10:33:48.456519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:01.285291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460271+0000","last_change":"2023-10-14T10:33:47.496746+0000","last_active":"2023-10-14T10:33:48.460271+0000","last_peered":"2023-10-14T10:33:48.460271+0000","last_clean":"2023-10-14T10:33:48.460271+0000","last_became_active":"2023-10-14T10:33:47.495439+0000","last_became_peered":"2023-10-14T10:33:47.495439+0000","last_unstale":"2023-10-14T10:33:48.460271+0000","last_undegraded":"2023-10-14T10:33:48.460271+0000","last_fullsized":"2023-10-14T10:33:48.460271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:36.498316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652736+0000","last_change":"2023-10-14T10:33:46.948656+0000","last_active":"2023-10-14T10:33:49.652736+0000","last_peered":"2023-10-14T10:33:49.652736+0000","last_clean":"2023-10-14T10:33:49.652736+0000","last_became_active":"2023-10-14T10:33:46.945172+0000","last_became_peered":"2023-10-14T10:33:46.945172+0000","last_unstale":"2023-10-14T10:33:49.652736+0000","last_undegraded":"2023-10-14T10:33:49.652736+0000","last_fullsized":"2023-10-14T10:33:49.652736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:27.111309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653869+0000","last_change":"2023-10-14T10:33:47.494774+0000","last_active":"2023-10-14T10:33:49.653869+0000","last_peered":"2023-10-14T10:33:49.653869+0000","last_clean":"2023-10-14T10:33:49.653869+0000","last_became_active":"2023-10-14T10:33:47.494464+0000","last_became_peered":"2023-10-14T10:33:47.494464+0000","last_unstale":"2023-10-14T10:33:49.653869+0000","last_undegraded":"2023-10-14T10:33:49.653869+0000","last_fullsized":"2023-10-14T10:33:49.653869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:11.483101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653515+0000","last_change":"2023-10-14T10:33:46.949538+0000","last_active":"2023-10-14T10:33:49.653515+0000","last_peered":"2023-10-14T10:33:49.653515+0000","last_clean":"2023-10-14T10:33:49.653515+0000","last_became_active":"2023-10-14T10:33:46.949221+0000","last_became_peered":"2023-10-14T10:33:46.949221+0000","last_unstale":"2023-10-14T10:33:49.653515+0000","last_undegraded":"2023-10-14T10:33:49.653515+0000","last_fullsized":"2023-10-14T10:33:49.653515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:24.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652794+0000","last_change":"2023-10-14T10:33:47.495094+0000","last_active":"2023-10-14T10:33:49.652794+0000","last_peered":"2023-10-14T10:33:49.652794+0000","last_clean":"2023-10-14T10:33:49.652794+0000","last_became_active":"2023-10-14T10:33:47.494462+0000","last_became_peered":"2023-10-14T10:33:47.494462+0000","last_unstale":"2023-10-14T10:33:49.652794+0000","last_undegraded":"2023-10-14T10:33:49.652794+0000","last_fullsized":"2023-10-14T10:33:49.652794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:21.485819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463293+0000","last_change":"2023-10-14T10:33:46.949862+0000","last_active":"2023-10-14T10:33:48.463293+0000","last_peered":"2023-10-14T10:33:48.463293+0000","last_clean":"2023-10-14T10:33:48.463293+0000","last_became_active":"2023-10-14T10:33:46.949575+0000","last_became_peered":"2023-10-14T10:33:46.949575+0000","last_unstale":"2023-10-14T10:33:48.463293+0000","last_undegraded":"2023-10-14T10:33:48.463293+0000","last_fullsized":"2023-10-14T10:33:48.463293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:51.370720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653325+0000","last_change":"2023-10-14T10:33:47.499315+0000","last_active":"2023-10-14T10:33:49.653325+0000","last_peered":"2023-10-14T10:33:49.653325+0000","last_clean":"2023-10-14T10:33:49.653325+0000","last_became_active":"2023-10-14T10:33:47.498922+0000","last_became_peered":"2023-10-14T10:33:47.498922+0000","last_unstale":"2023-10-14T10:33:49.653325+0000","last_undegraded":"2023-10-14T10:33:49.653325+0000","last_fullsized":"2023-10-14T10:33:49.653325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:10.602705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651606+0000","last_change":"2023-10-14T10:33:46.947577+0000","last_active":"2023-10-14T10:33:49.651606+0000","last_peered":"2023-10-14T10:33:49.651606+0000","last_clean":"2023-10-14T10:33:49.651606+0000","last_became_active":"2023-10-14T10:33:46.947158+0000","last_became_peered":"2023-10-14T10:33:46.947158+0000","last_unstale":"2023-10-14T10:33:49.651606+0000","last_undegraded":"2023-10-14T10:33:49.651606+0000","last_fullsized":"2023-10-14T10:33:49.651606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651703+0000","last_change":"2023-10-14T10:33:47.482689+0000","last_active":"2023-10-14T10:33:49.651703+0000","last_peered":"2023-10-14T10:33:49.651703+0000","last_clean":"2023-10-14T10:33:49.651703+0000","last_became_active":"2023-10-14T10:33:47.482301+0000","last_became_peered":"2023-10-14T10:33:47.482301+0000","last_unstale":"2023-10-14T10:33:49.651703+0000","last_undegraded":"2023-10-14T10:33:49.651703+0000","last_fullsized":"2023-10-14T10:33:49.651703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.650670+0000","last_change":"2023-10-14T10:33:46.933875+0000","last_active":"2023-10-14T10:33:49.650670+0000","last_peered":"2023-10-14T10:33:49.650670+0000","last_clean":"2023-10-14T10:33:49.650670+0000","last_became_active":"2023-10-14T10:33:46.932445+0000","last_became_peered":"2023-10-14T10:33:46.932445+0000","last_unstale":"2023-10-14T10:33:49.650670+0000","last_undegraded":"2023-10-14T10:33:49.650670+0000","last_fullsized":"2023-10-14T10:33:49.650670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:23.669098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652199+0000","last_change":"2023-10-14T10:33:47.500004+0000","last_active":"2023-10-14T10:33:49.652199+0000","last_peered":"2023-10-14T10:33:49.652199+0000","last_clean":"2023-10-14T10:33:49.652199+0000","last_became_active":"2023-10-14T10:33:47.499661+0000","last_became_peered":"2023-10-14T10:33:47.499661+0000","last_unstale":"2023-10-14T10:33:49.652199+0000","last_undegraded":"2023-10-14T10:33:49.652199+0000","last_fullsized":"2023-10-14T10:33:49.652199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:22:13.355108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460519+0000","last_change":"2023-10-14T10:33:46.941041+0000","last_active":"2023-10-14T10:33:48.460519+0000","last_peered":"2023-10-14T10:33:48.460519+0000","last_clean":"2023-10-14T10:33:48.460519+0000","last_became_active":"2023-10-14T10:33:46.940755+0000","last_became_peered":"2023-10-14T10:33:46.940755+0000","last_unstale":"2023-10-14T10:33:48.460519+0000","last_undegraded":"2023-10-14T10:33:48.460519+0000","last_fullsized":"2023-10-14T10:33:48.460519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:31:58.183303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652938+0000","last_change":"2023-10-14T10:33:47.501109+0000","last_active":"2023-10-14T10:33:49.652938+0000","last_peered":"2023-10-14T10:33:49.652938+0000","last_clean":"2023-10-14T10:33:49.652938+0000","last_became_active":"2023-10-14T10:33:47.500841+0000","last_became_peered":"2023-10-14T10:33:47.500841+0000","last_unstale":"2023-10-14T10:33:49.652938+0000","last_undegraded":"2023-10-14T10:33:49.652938+0000","last_fullsized":"2023-10-14T10:33:49.652938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:58.057067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651355+0000","last_change":"2023-10-14T10:33:46.934433+0000","last_active":"2023-10-14T10:33:49.651355+0000","last_peered":"2023-10-14T10:33:49.651355+0000","last_clean":"2023-10-14T10:33:49.651355+0000","last_became_active":"2023-10-14T10:33:46.934173+0000","last_became_peered":"2023-10-14T10:33:46.934173+0000","last_unstale":"2023-10-14T10:33:49.651355+0000","last_undegraded":"2023-10-14T10:33:49.651355+0000","last_fullsized":"2023-10-14T10:33:49.651355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:34.060298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654571+0000","last_change":"2023-10-14T10:33:47.500414+0000","last_active":"2023-10-14T10:33:49.654571+0000","last_peered":"2023-10-14T10:33:49.654571+0000","last_clean":"2023-10-14T10:33:49.654571+0000","last_became_active":"2023-10-14T10:33:47.500103+0000","last_became_peered":"2023-10-14T10:33:47.500103+0000","last_unstale":"2023-10-14T10:33:49.654571+0000","last_undegraded":"2023-10-14T10:33:49.654571+0000","last_fullsized":"2023-10-14T10:33:49.654571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:55.928753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456627+0000","last_change":"2023-10-14T10:33:46.929461+0000","last_active":"2023-10-14T10:33:48.456627+0000","last_peered":"2023-10-14T10:33:48.456627+0000","last_clean":"2023-10-14T10:33:48.456627+0000","last_became_active":"2023-10-14T10:33:46.928486+0000","last_became_peered":"2023-10-14T10:33:46.928486+0000","last_unstale":"2023-10-14T10:33:48.456627+0000","last_undegraded":"2023-10-14T10:33:48.456627+0000","last_fullsized":"2023-10-14T10:33:48.456627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:27.111309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463161+0000","last_change":"2023-10-14T10:33:47.483087+0000","last_active":"2023-10-14T10:33:48.463161+0000","last_peered":"2023-10-14T10:33:48.463161+0000","last_clean":"2023-10-14T10:33:48.463161+0000","last_became_active":"2023-10-14T10:33:47.481501+0000","last_became_peered":"2023-10-14T10:33:47.481501+0000","last_unstale":"2023-10-14T10:33:48.463161+0000","last_undegraded":"2023-10-14T10:33:48.463161+0000","last_fullsized":"2023-10-14T10:33:48.463161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:03.978194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651260+0000","last_change":"2023-10-14T10:33:46.943701+0000","last_active":"2023-10-14T10:33:49.651260+0000","last_peered":"2023-10-14T10:33:49.651260+0000","last_clean":"2023-10-14T10:33:49.651260+0000","last_became_active":"2023-10-14T10:33:46.942265+0000","last_became_peered":"2023-10-14T10:33:46.942265+0000","last_unstale":"2023-10-14T10:33:49.651260+0000","last_undegraded":"2023-10-14T10:33:49.651260+0000","last_fullsized":"2023-10-14T10:33:49.651260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:10:50.058321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653885+0000","last_change":"2023-10-14T10:33:47.502823+0000","last_active":"2023-10-14T10:33:49.653885+0000","last_peered":"2023-10-14T10:33:49.653885+0000","last_clean":"2023-10-14T10:33:49.653885+0000","last_became_active":"2023-10-14T10:33:47.502237+0000","last_became_peered":"2023-10-14T10:33:47.502237+0000","last_unstale":"2023-10-14T10:33:49.653885+0000","last_undegraded":"2023-10-14T10:33:49.653885+0000","last_fullsized":"2023-10-14T10:33:49.653885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:13:18.695800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T10:33:47.489150+0000","last_change":"2023-10-14T10:33:42.821659+0000","last_active":"2023-10-14T10:33:47.489150+0000","last_peered":"2023-10-14T10:33:47.489150+0000","last_clean":"2023-10-14T10:33:47.489150+0000","last_became_active":"2023-10-14T10:33:42.819441+0000","last_became_peered":"2023-10-14T10:33:42.819441+0000","last_unstale":"2023-10-14T10:33:47.489150+0000","last_undegraded":"2023-10-14T10:33:47.489150+0000","last_fullsized":"2023-10-14T10:33:47.489150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_clean_scrub_stamp":"2023-10-14T10:33:41.468382+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:59.542930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.461818+0000","last_change":"2023-10-14T10:33:46.932732+0000","last_active":"2023-10-14T10:33:48.461818+0000","last_peered":"2023-10-14T10:33:48.461818+0000","last_clean":"2023-10-14T10:33:48.461818+0000","last_became_active":"2023-10-14T10:33:46.929319+0000","last_became_peered":"2023-10-14T10:33:46.929319+0000","last_unstale":"2023-10-14T10:33:48.461818+0000","last_undegraded":"2023-10-14T10:33:48.461818+0000","last_fullsized":"2023-10-14T10:33:48.461818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:24.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.211843+0000","last_change":"2023-10-14T10:33:47.480133+0000","last_active":"2023-10-14T10:33:49.211843+0000","last_peered":"2023-10-14T10:33:49.211843+0000","last_clean":"2023-10-14T10:33:49.211843+0000","last_became_active":"2023-10-14T10:33:47.479802+0000","last_became_peered":"2023-10-14T10:33:47.479802+0000","last_unstale":"2023-10-14T10:33:49.211843+0000","last_undegraded":"2023-10-14T10:33:49.211843+0000","last_fullsized":"2023-10-14T10:33:49.211843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:01:12.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651892+0000","last_change":"2023-10-14T10:33:46.951335+0000","last_active":"2023-10-14T10:33:49.651892+0000","last_peered":"2023-10-14T10:33:49.651892+0000","last_clean":"2023-10-14T10:33:49.651892+0000","last_became_active":"2023-10-14T10:33:46.950717+0000","last_became_peered":"2023-10-14T10:33:46.950717+0000","last_unstale":"2023-10-14T10:33:49.651892+0000","last_undegraded":"2023-10-14T10:33:49.651892+0000","last_fullsized":"2023-10-14T10:33:49.651892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:35.235012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652648+0000","last_change":"2023-10-14T10:33:47.486246+0000","last_active":"2023-10-14T10:33:49.652648+0000","last_peered":"2023-10-14T10:33:49.652648+0000","last_clean":"2023-10-14T10:33:49.652648+0000","last_became_active":"2023-10-14T10:33:47.485935+0000","last_became_peered":"2023-10-14T10:33:47.485935+0000","last_unstale":"2023-10-14T10:33:49.652648+0000","last_undegraded":"2023-10-14T10:33:49.652648+0000","last_fullsized":"2023-10-14T10:33:49.652648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:28:29.655910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651005+0000","last_change":"2023-10-14T10:33:46.932409+0000","last_active":"2023-10-14T10:33:49.651005+0000","last_peered":"2023-10-14T10:33:49.651005+0000","last_clean":"2023-10-14T10:33:49.651005+0000","last_became_active":"2023-10-14T10:33:46.932081+0000","last_became_peered":"2023-10-14T10:33:46.932081+0000","last_unstale":"2023-10-14T10:33:49.651005+0000","last_undegraded":"2023-10-14T10:33:49.651005+0000","last_fullsized":"2023-10-14T10:33:49.651005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:00:35.235012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456692+0000","last_change":"2023-10-14T10:33:47.472076+0000","last_active":"2023-10-14T10:33:48.456692+0000","last_peered":"2023-10-14T10:33:48.456692+0000","last_clean":"2023-10-14T10:33:48.456692+0000","last_became_active":"2023-10-14T10:33:47.471729+0000","last_became_peered":"2023-10-14T10:33:47.471729+0000","last_unstale":"2023-10-14T10:33:48.456692+0000","last_undegraded":"2023-10-14T10:33:48.456692+0000","last_fullsized":"2023-10-14T10:33:48.456692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.463351+0000","last_change":"2023-10-14T10:33:46.940624+0000","last_active":"2023-10-14T10:33:48.463351+0000","last_peered":"2023-10-14T10:33:48.463351+0000","last_clean":"2023-10-14T10:33:48.463351+0000","last_became_active":"2023-10-14T10:33:46.939832+0000","last_became_peered":"2023-10-14T10:33:46.939832+0000","last_unstale":"2023-10-14T10:33:48.463351+0000","last_undegraded":"2023-10-14T10:33:48.463351+0000","last_fullsized":"2023-10-14T10:33:48.463351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:14.846393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460408+0000","last_change":"2023-10-14T10:33:47.482352+0000","last_active":"2023-10-14T10:33:48.460408+0000","last_peered":"2023-10-14T10:33:48.460408+0000","last_clean":"2023-10-14T10:33:48.460408+0000","last_became_active":"2023-10-14T10:33:47.482107+0000","last_became_peered":"2023-10-14T10:33:47.482107+0000","last_unstale":"2023-10-14T10:33:48.460408+0000","last_undegraded":"2023-10-14T10:33:48.460408+0000","last_fullsized":"2023-10-14T10:33:48.460408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:34:46.239394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456396+0000","last_change":"2023-10-14T10:33:46.938082+0000","last_active":"2023-10-14T10:33:48.456396+0000","last_peered":"2023-10-14T10:33:48.456396+0000","last_clean":"2023-10-14T10:33:48.456396+0000","last_became_active":"2023-10-14T10:33:46.937753+0000","last_became_peered":"2023-10-14T10:33:46.937753+0000","last_unstale":"2023-10-14T10:33:48.456396+0000","last_undegraded":"2023-10-14T10:33:48.456396+0000","last_fullsized":"2023-10-14T10:33:48.456396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:04:24.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462602+0000","last_change":"2023-10-14T10:33:47.476592+0000","last_active":"2023-10-14T10:33:48.462602+0000","last_peered":"2023-10-14T10:33:48.462602+0000","last_clean":"2023-10-14T10:33:48.462602+0000","last_became_active":"2023-10-14T10:33:47.476154+0000","last_became_peered":"2023-10-14T10:33:47.476154+0000","last_unstale":"2023-10-14T10:33:48.462602+0000","last_undegraded":"2023-10-14T10:33:48.462602+0000","last_fullsized":"2023-10-14T10:33:48.462602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:10.602705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654137+0000","last_change":"2023-10-14T10:33:46.953499+0000","last_active":"2023-10-14T10:33:49.654137+0000","last_peered":"2023-10-14T10:33:49.654137+0000","last_clean":"2023-10-14T10:33:49.654137+0000","last_became_active":"2023-10-14T10:33:46.953253+0000","last_became_peered":"2023-10-14T10:33:46.953253+0000","last_unstale":"2023-10-14T10:33:49.654137+0000","last_undegraded":"2023-10-14T10:33:49.654137+0000","last_fullsized":"2023-10-14T10:33:49.654137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:05.299234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456292+0000","last_change":"2023-10-14T10:33:47.474355+0000","last_active":"2023-10-14T10:33:48.456292+0000","last_peered":"2023-10-14T10:33:48.456292+0000","last_clean":"2023-10-14T10:33:48.456292+0000","last_became_active":"2023-10-14T10:33:47.473947+0000","last_became_peered":"2023-10-14T10:33:47.473947+0000","last_unstale":"2023-10-14T10:33:48.456292+0000","last_undegraded":"2023-10-14T10:33:48.456292+0000","last_fullsized":"2023-10-14T10:33:48.456292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:52.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.668975+0000","last_change":"2023-10-14T10:33:46.946715+0000","last_active":"2023-10-14T10:33:49.668975+0000","last_peered":"2023-10-14T10:33:49.668975+0000","last_clean":"2023-10-14T10:33:49.668975+0000","last_became_active":"2023-10-14T10:33:46.946368+0000","last_became_peered":"2023-10-14T10:33:46.946368+0000","last_unstale":"2023-10-14T10:33:49.668975+0000","last_undegraded":"2023-10-14T10:33:49.668975+0000","last_fullsized":"2023-10-14T10:33:49.668975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.213127+0000","last_change":"2023-10-14T10:33:47.494870+0000","last_active":"2023-10-14T10:33:49.213127+0000","last_peered":"2023-10-14T10:33:49.213127+0000","last_clean":"2023-10-14T10:33:49.213127+0000","last_became_active":"2023-10-14T10:33:47.494561+0000","last_became_peered":"2023-10-14T10:33:47.494561+0000","last_unstale":"2023-10-14T10:33:49.213127+0000","last_undegraded":"2023-10-14T10:33:49.213127+0000","last_fullsized":"2023-10-14T10:33:49.213127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:00.621252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652945+0000","last_change":"2023-10-14T10:33:46.952942+0000","last_active":"2023-10-14T10:33:49.652945+0000","last_peered":"2023-10-14T10:33:49.652945+0000","last_clean":"2023-10-14T10:33:49.652945+0000","last_became_active":"2023-10-14T10:33:46.952649+0000","last_became_peered":"2023-10-14T10:33:46.952649+0000","last_unstale":"2023-10-14T10:33:49.652945+0000","last_undegraded":"2023-10-14T10:33:49.652945+0000","last_fullsized":"2023-10-14T10:33:49.652945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:01.285291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653758+0000","last_change":"2023-10-14T10:33:47.481610+0000","last_active":"2023-10-14T10:33:49.653758+0000","last_peered":"2023-10-14T10:33:49.653758+0000","last_clean":"2023-10-14T10:33:49.653758+0000","last_became_active":"2023-10-14T10:33:47.481134+0000","last_became_peered":"2023-10-14T10:33:47.481134+0000","last_unstale":"2023-10-14T10:33:49.653758+0000","last_undegraded":"2023-10-14T10:33:49.653758+0000","last_fullsized":"2023-10-14T10:33:49.653758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:45.752462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.651537+0000","last_change":"2023-10-14T10:33:46.951887+0000","last_active":"2023-10-14T10:33:49.651537+0000","last_peered":"2023-10-14T10:33:49.651537+0000","last_clean":"2023-10-14T10:33:49.651537+0000","last_became_active":"2023-10-14T10:33:46.951005+0000","last_became_peered":"2023-10-14T10:33:46.951005+0000","last_unstale":"2023-10-14T10:33:49.651537+0000","last_undegraded":"2023-10-14T10:33:49.651537+0000","last_fullsized":"2023-10-14T10:33:49.651537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:44.489158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.460796+0000","last_change":"2023-10-14T10:33:47.472416+0000","last_active":"2023-10-14T10:33:48.460796+0000","last_peered":"2023-10-14T10:33:48.460796+0000","last_clean":"2023-10-14T10:33:48.460796+0000","last_became_active":"2023-10-14T10:33:47.472042+0000","last_became_peered":"2023-10-14T10:33:47.472042+0000","last_unstale":"2023-10-14T10:33:48.460796+0000","last_undegraded":"2023-10-14T10:33:48.460796+0000","last_fullsized":"2023-10-14T10:33:48.460796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:08.668848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456421+0000","last_change":"2023-10-14T10:33:46.943709+0000","last_active":"2023-10-14T10:33:48.456421+0000","last_peered":"2023-10-14T10:33:48.456421+0000","last_clean":"2023-10-14T10:33:48.456421+0000","last_became_active":"2023-10-14T10:33:46.943331+0000","last_became_peered":"2023-10-14T10:33:46.943331+0000","last_unstale":"2023-10-14T10:33:48.456421+0000","last_undegraded":"2023-10-14T10:33:48.456421+0000","last_fullsized":"2023-10-14T10:33:48.456421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:20.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212270+0000","last_change":"2023-10-14T10:33:47.485638+0000","last_active":"2023-10-14T10:33:49.212270+0000","last_peered":"2023-10-14T10:33:49.212270+0000","last_clean":"2023-10-14T10:33:49.212270+0000","last_became_active":"2023-10-14T10:33:47.485152+0000","last_became_peered":"2023-10-14T10:33:47.485152+0000","last_unstale":"2023-10-14T10:33:49.212270+0000","last_undegraded":"2023-10-14T10:33:49.212270+0000","last_fullsized":"2023-10-14T10:33:49.212270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:29:16.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.456868+0000","last_change":"2023-10-14T10:33:46.940511+0000","last_active":"2023-10-14T10:33:48.456868+0000","last_peered":"2023-10-14T10:33:48.456868+0000","last_clean":"2023-10-14T10:33:48.456868+0000","last_became_active":"2023-10-14T10:33:46.940203+0000","last_became_peered":"2023-10-14T10:33:46.940203+0000","last_unstale":"2023-10-14T10:33:48.456868+0000","last_undegraded":"2023-10-14T10:33:48.456868+0000","last_fullsized":"2023-10-14T10:33:48.456868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:48:34.060298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212360+0000","last_change":"2023-10-14T10:33:47.484334+0000","last_active":"2023-10-14T10:33:49.212360+0000","last_peered":"2023-10-14T10:33:49.212360+0000","last_clean":"2023-10-14T10:33:49.212360+0000","last_became_active":"2023-10-14T10:33:47.484053+0000","last_became_peered":"2023-10-14T10:33:47.484053+0000","last_unstale":"2023-10-14T10:33:49.212360+0000","last_undegraded":"2023-10-14T10:33:49.212360+0000","last_fullsized":"2023-10-14T10:33:49.212360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653506+0000","last_change":"2023-10-14T10:33:46.952342+0000","last_active":"2023-10-14T10:33:49.653506+0000","last_peered":"2023-10-14T10:33:49.653506+0000","last_clean":"2023-10-14T10:33:49.653506+0000","last_became_active":"2023-10-14T10:33:46.952054+0000","last_became_peered":"2023-10-14T10:33:46.952054+0000","last_unstale":"2023-10-14T10:33:49.653506+0000","last_undegraded":"2023-10-14T10:33:49.653506+0000","last_fullsized":"2023-10-14T10:33:49.653506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:07.405544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.652415+0000","last_change":"2023-10-14T10:33:47.483290+0000","last_active":"2023-10-14T10:33:49.652415+0000","last_peered":"2023-10-14T10:33:49.652415+0000","last_clean":"2023-10-14T10:33:49.652415+0000","last_became_active":"2023-10-14T10:33:47.482376+0000","last_became_peered":"2023-10-14T10:33:47.482376+0000","last_unstale":"2023-10-14T10:33:49.652415+0000","last_undegraded":"2023-10-14T10:33:49.652415+0000","last_fullsized":"2023-10-14T10:33:49.652415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:11:06.562538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462475+0000","last_change":"2023-10-14T10:33:47.474830+0000","last_active":"2023-10-14T10:33:48.462475+0000","last_peered":"2023-10-14T10:33:48.462475+0000","last_clean":"2023-10-14T10:33:48.462475+0000","last_became_active":"2023-10-14T10:33:47.474496+0000","last_became_peered":"2023-10-14T10:33:47.474496+0000","last_unstale":"2023-10-14T10:33:48.462475+0000","last_undegraded":"2023-10-14T10:33:48.462475+0000","last_fullsized":"2023-10-14T10:33:48.462475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:00.621252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.653758+0000","last_change":"2023-10-14T10:33:46.952550+0000","last_active":"2023-10-14T10:33:49.653758+0000","last_peered":"2023-10-14T10:33:49.653758+0000","last_clean":"2023-10-14T10:33:49.653758+0000","last_became_active":"2023-10-14T10:33:46.952221+0000","last_became_peered":"2023-10-14T10:33:46.952221+0000","last_unstale":"2023-10-14T10:33:49.653758+0000","last_undegraded":"2023-10-14T10:33:49.653758+0000","last_fullsized":"2023-10-14T10:33:49.653758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:48.462966+0000","last_change":"2023-10-14T10:33:47.480595+0000","last_active":"2023-10-14T10:33:48.462966+0000","last_peered":"2023-10-14T10:33:48.462966+0000","last_clean":"2023-10-14T10:33:48.462966+0000","last_became_active":"2023-10-14T10:33:47.479987+0000","last_became_peered":"2023-10-14T10:33:47.479987+0000","last_unstale":"2023-10-14T10:33:48.462966+0000","last_undegraded":"2023-10-14T10:33:48.462966+0000","last_fullsized":"2023-10-14T10:33:48.462966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:56:20.511159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654009+0000","last_change":"2023-10-14T10:33:46.956415+0000","last_active":"2023-10-14T10:33:49.654009+0000","last_peered":"2023-10-14T10:33:49.654009+0000","last_clean":"2023-10-14T10:33:49.654009+0000","last_became_active":"2023-10-14T10:33:46.956031+0000","last_became_peered":"2023-10-14T10:33:46.956031+0000","last_unstale":"2023-10-14T10:33:49.654009+0000","last_undegraded":"2023-10-14T10:33:49.654009+0000","last_fullsized":"2023-10-14T10:33:49.654009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:51.370720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654052+0000","last_change":"2023-10-14T10:33:47.487837+0000","last_active":"2023-10-14T10:33:49.654052+0000","last_peered":"2023-10-14T10:33:49.654052+0000","last_clean":"2023-10-14T10:33:49.654052+0000","last_became_active":"2023-10-14T10:33:47.487230+0000","last_became_peered":"2023-10-14T10:33:47.487230+0000","last_unstale":"2023-10-14T10:33:49.654052+0000","last_undegraded":"2023-10-14T10:33:49.654052+0000","last_fullsized":"2023-10-14T10:33:49.654052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:24.664362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.213080+0000","last_change":"2023-10-14T10:33:46.941475+0000","last_active":"2023-10-14T10:33:49.213080+0000","last_peered":"2023-10-14T10:33:49.213080+0000","last_clean":"2023-10-14T10:33:49.213080+0000","last_became_active":"2023-10-14T10:33:46.941184+0000","last_became_peered":"2023-10-14T10:33:46.941184+0000","last_unstale":"2023-10-14T10:33:49.213080+0000","last_undegraded":"2023-10-14T10:33:49.213080+0000","last_fullsized":"2023-10-14T10:33:49.213080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.212744+0000","last_change":"2023-10-14T10:33:47.488896+0000","last_active":"2023-10-14T10:33:49.212744+0000","last_peered":"2023-10-14T10:33:49.212744+0000","last_clean":"2023-10-14T10:33:49.212744+0000","last_became_active":"2023-10-14T10:33:47.488561+0000","last_became_peered":"2023-10-14T10:33:47.488561+0000","last_unstale":"2023-10-14T10:33:49.212744+0000","last_undegraded":"2023-10-14T10:33:49.212744+0000","last_fullsized":"2023-10-14T10:33:49.212744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:46.890175+0000","last_clean_scrub_stamp":"2023-10-14T10:33:46.890175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:01:47.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T10:33:49.654339+0000","last_change":"2023-10-14T10:33:46.951000+0000","last_active":"2023-10-14T10:33:49.654339+0000","last_peered":"2023-10-14T10:33:49.654339+0000","last_clean":"2023-10-14T10:33:49.654339+0000","last_became_active":"2023-10-14T10:33:46.950678+0000","last_became_peered":"2023-10-14T10:33:46.950678+0000","last_unstale":"2023-10-14T10:33:49.654339+0000","last_undegraded":"2023-10-14T10:33:49.654339+0000","last_fullsized":"2023-10-14T10:33:49.654339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:45.626871+0000","last_clean_scrub_stamp":"2023-10-14T10:33:45.626871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:50.051835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.74}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.698}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9730000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4159999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.101}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.788}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5960000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0070000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T10:33:58.669 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T10:33:58.669 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T10:33:58.670 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T10:33:58.670 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T10:33:58.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.926+0000 7f6d04b2e640 1 Processor -- start 2023-10-14T10:33:58.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.927+0000 7f6d04b2e640 1 -- start start 2023-10-14T10:33:58.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.928+0000 7f6d04b2e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6d0014f350 0x7f6d000a83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.928+0000 7f6d04b2e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d000a9040 con 0x7f6d0006bda0 2023-10-14T10:33:58.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.928+0000 7f6d04b2e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d000aa650 con 0x7f6d00152650 2023-10-14T10:33:58.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.928+0000 7f6d04b2e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d000a9440 con 0x7f6d0014f350 2023-10-14T10:33:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.929+0000 7f6cfffff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6d0006bda0 0x7f6d0006cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46776/0 (socket says 172.21.15.8:46776) 2023-10-14T10:33:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.929+0000 7f6cfffff640 1 -- 172.21.15.8:0/3577258505 learned_addr learned my addr 172.21.15.8:0/3577258505 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.929+0000 7f6cff7fe640 1 --2- 172.21.15.8:0/3577258505 >> v2:172.21.15.92:3300/0 conn(0x7f6d0014f350 0x7f6d000a83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.929+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632123052 0 0) 0x7f6d000a9040 con 0x7f6d0006bda0 2023-10-14T10:33:58.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.929+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cec003520 con 0x7f6d0006bda0 2023-10-14T10:33:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3825794197 0 0) 0x7f6cec003520 con 0x7f6d0006bda0 2023-10-14T10:33:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 >> v2:172.21.15.92:3300/0 conn(0x7f6d0014f350 msgr2=0x7f6d000a83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 --2- 172.21.15.8:0/3577258505 >> v2:172.21.15.92:3300/0 conn(0x7f6d0014f350 0x7f6d000a83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 >> v1:172.21.15.92:6789/0 conn(0x7f6d00152650 legacy=0x7f6d000a8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d000aa8f0 con 0x7f6d0006bda0 2023-10-14T10:33:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f6cf80019f0 con 0x7f6d0006bda0 2023-10-14T10:33:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 >> v1:172.21.15.8:6789/0 conn(0x7f6d0006bda0 legacy=0x7f6d0006cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 --2- 172.21.15.8:0/3577258505 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cec003970 0x7f6cec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 --2- 172.21.15.8:0/3577258505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cec0047c0 0x7f6cec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 --2- 172.21.15.8:0/3577258505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cec0052a0 0x7f6cec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d000a9440 con 0x7f6cec0047c0 2023-10-14T10:33:58.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec00c170 con 0x7f6cec0052a0 2023-10-14T10:33:58.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec00c330 con 0x7f6cec003970 2023-10-14T10:33:58.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cf7fff640 1 --2- 172.21.15.8:0/3577258505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cec0047c0 0x7f6cec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:58.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cff7fe640 1 --2- 172.21.15.8:0/3577258505 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cec003970 0x7f6cec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:58.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.930+0000 7f6cfffff640 1 --2- 172.21.15.8:0/3577258505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cec0052a0 0x7f6cec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:58.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.931+0000 7f6cf7fff640 1 -- 172.21.15.8:0/3577258505 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cec003970 msgr2=0x7f6cec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:58.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.931+0000 7f6cf7fff640 1 --2- 172.21.15.8:0/3577258505 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cec003970 0x7f6cec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.931+0000 7f6cf7fff640 1 -- 172.21.15.8:0/3577258505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cec0052a0 msgr2=0x7f6cec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:58.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.931+0000 7f6cf7fff640 1 --2- 172.21.15.8:0/3577258505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cec0052a0 0x7f6cec00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.931+0000 7f6cf7fff640 1 -- 172.21.15.8:0/3577258505 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec003520 con 0x7f6cec0047c0 2023-10-14T10:33:58.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.931+0000 7f6cfffff640 1 -- 172.21.15.8:0/3577258505 reap_dead start 2023-10-14T10:33:58.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.932+0000 7f6cf7fff640 1 --2- 172.21.15.8:0/3577258505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cec0047c0 0x7f6cec004c40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8001720 tx=0x7f6cec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c553a7cd06d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:58.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.932+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80052d0 con 0x7f6cec0047c0 2023-10-14T10:33:58.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.932+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce802e050 con 0x7f6cec0047c0 2023-10-14T10:33:58.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.932+0000 7f6cfeffd640 1 -- 172.21.15.8:0/3577258505 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8003830 con 0x7f6cec0047c0 2023-10-14T10:33:58.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.933+0000 7f6d04b2e640 1 -- 172.21.15.8:0/3577258505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cec0047c0 msgr2=0x7f6cec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.933+0000 7f6d04b2e640 1 --2- 172.21.15.8:0/3577258505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cec0047c0 0x7f6cec004c40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8001720 tx=0x7f6cec0057f0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.933+0000 7f6d04b2e640 1 -- 172.21.15.8:0/3577258505 shutdown_connections 2023-10-14T10:33:58.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.933+0000 7f6d04b2e640 1 --2- 172.21.15.8:0/3577258505 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cec0047c0 0x7f6cec004c40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.933+0000 7f6d04b2e640 1 -- 172.21.15.8:0/3577258505 >> 172.21.15.8:0/3577258505 conn(0x7f6d000c1dd0 msgr2=0x7f6d000c21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:58.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.933+0000 7f6d04b2e640 1 -- 172.21.15.8:0/3577258505 shutdown_connections 2023-10-14T10:33:58.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.933+0000 7f6d04b2e640 1 -- 172.21.15.8:0/3577258505 wait complete. 2023-10-14T10:33:58.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.935+0000 7f6d04b2e640 1 Processor -- start 2023-10-14T10:33:58.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.935+0000 7f6d04b2e640 1 -- start start 2023-10-14T10:33:58.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.936+0000 7f6d04b2e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cec0047c0 0x7f6d00141700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.936+0000 7f6d04b2e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d00071390 0x7f6d000c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.936+0000 7f6d04b2e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d000c4c20 0x7f6d001e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.936+0000 7f6d04b2e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d001ed150 con 0x7f6d00071390 2023-10-14T10:33:58.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.936+0000 7f6d04b2e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0014e4a0 con 0x7f6d000c4c20 2023-10-14T10:33:58.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.936+0000 7f6d04b2e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d001e8c80 con 0x7f6cec0047c0 2023-10-14T10:33:58.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.936+0000 7f6cf7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d00071390 0x7f6d000c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:58.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.936+0000 7f6cf7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d00071390 0x7f6d000c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40740/0 (socket says 172.21.15.8:40740) 2023-10-14T10:33:58.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.936+0000 7f6cf7fff640 1 -- 172.21.15.8:0/4104631638 learned_addr learned my addr 172.21.15.8:0/4104631638 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:58.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.936+0000 7f6cff7fe640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cec0047c0 0x7f6d00141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:58.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.936+0000 7f6cfffff640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d000c4c20 0x7f6d001e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:58.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.937+0000 7f6cf7fff640 1 -- 172.21.15.8:0/4104631638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cec0047c0 msgr2=0x7f6d00141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.937+0000 7f6cf7fff640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cec0047c0 0x7f6d00141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.937+0000 7f6cf7fff640 1 -- 172.21.15.8:0/4104631638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d000c4c20 msgr2=0x7f6d001e90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:58.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.937+0000 7f6cf7fff640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d000c4c20 0x7f6d001e90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:58.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.937+0000 7f6cf7fff640 1 -- 172.21.15.8:0/4104631638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0014c960 con 0x7f6d00071390 2023-10-14T10:33:58.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.937+0000 7f6cff7fe640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cec0047c0 0x7f6d00141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:33:58.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.937+0000 7f6cf7fff640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d00071390 0x7f6d000c46e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8005040 tx=0x7f6ce8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:58.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.937+0000 7f6cfcff9640 1 -- 172.21.15.8:0/4104631638 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80076c0 con 0x7f6d00071390 2023-10-14T10:33:58.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.937+0000 7f6cfcff9640 1 -- 172.21.15.8:0/4104631638 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce8007a30 con 0x7f6d00071390 2023-10-14T10:33:58.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.937+0000 7f6cfcff9640 1 -- 172.21.15.8:0/4104631638 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8006be0 con 0x7f6d00071390 2023-10-14T10:33:58.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.937+0000 7f6d04b2e640 1 -- 172.21.15.8:0/4104631638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d001ec5d0 con 0x7f6d00071390 2023-10-14T10:33:58.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.938+0000 7f6d04b2e640 1 -- 172.21.15.8:0/4104631638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d001ecb90 con 0x7f6d00071390 2023-10-14T10:33:58.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.939+0000 7f6d04b2e640 1 -- 172.21.15.8:0/4104631638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0004e9b0 con 0x7f6d00071390 2023-10-14T10:33:58.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.940+0000 7f6cfcff9640 1 -- 172.21.15.8:0/4104631638 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6ce8006d40 con 0x7f6d00071390 2023-10-14T10:33:58.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.940+0000 7f6cfcff9640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6ce006ae70 0x7f6ce006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:58.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.941+0000 7f6cfcff9640 1 -- 172.21.15.8:0/4104631638 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ce80ab3a0 con 0x7f6d00071390 2023-10-14T10:33:58.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.941+0000 7f6cff7fe640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6ce006ae70 0x7f6ce006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:58.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.941+0000 7f6cff7fe640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6ce006ae70 0x7f6ce006d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d00068960 tx=0x7f6cf0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:58.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:58.945+0000 7f6cfcff9640 1 -- 172.21.15.8:0/4104631638 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ce80763b0 con 0x7f6d00071390 2023-10-14T10:33:59.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.176+0000 7f6d04b2e640 1 -- 172.21.15.8:0/4104631638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6d000c1a00 con 0x7f6d00071390 2023-10-14T10:33:59.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.176+0000 7f6cfcff9640 1 -- 172.21.15.8:0/4104631638 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6ce80799d0 con 0x7f6d00071390 2023-10-14T10:33:59.178 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:59.179 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T10:33:59.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.179+0000 7f6d04b2e640 1 -- 172.21.15.8:0/4104631638 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6ce006ae70 msgr2=0x7f6ce006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.179+0000 7f6d04b2e640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6ce006ae70 0x7f6ce006d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d00068960 tx=0x7f6cf0008040 comp rx=0 tx=0).stop 2023-10-14T10:33:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.179+0000 7f6d04b2e640 1 -- 172.21.15.8:0/4104631638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d00071390 msgr2=0x7f6d000c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.179+0000 7f6d04b2e640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d00071390 0x7f6d000c46e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8005040 tx=0x7f6ce8001120 comp rx=0 tx=0).stop 2023-10-14T10:33:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.179+0000 7f6d04b2e640 1 -- 172.21.15.8:0/4104631638 shutdown_connections 2023-10-14T10:33:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.179+0000 7f6d04b2e640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6ce006ae70 0x7f6ce006d330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.179+0000 7f6d04b2e640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d000c4c20 0x7f6d001e90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.179+0000 7f6d04b2e640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d00071390 0x7f6d000c46e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.179+0000 7f6d04b2e640 1 --2- 172.21.15.8:0/4104631638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cec0047c0 0x7f6d00141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.179+0000 7f6d04b2e640 1 -- 172.21.15.8:0/4104631638 >> 172.21.15.8:0/4104631638 conn(0x7f6d000c1dd0 msgr2=0x7f6d0014bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:59.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.179+0000 7f6d04b2e640 1 -- 172.21.15.8:0/4104631638 shutdown_connections 2023-10-14T10:33:59.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.179+0000 7f6d04b2e640 1 -- 172.21.15.8:0/4104631638 wait complete. 2023-10-14T10:33:59.201 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T10:33:59.201 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:33:59.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.424+0000 7f41aeb90640 1 Processor -- start 2023-10-14T10:33:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.425+0000 7f41aeb90640 1 -- start start 2023-10-14T10:33:59.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.426+0000 7f41aeb90640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f41a814e640 0x7f41a8154d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.426+0000 7f41aeb90640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a80c1720 0x7f41a80c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.426+0000 7f41aeb90640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a81552d0 con 0x7f41a80c5ce0 2023-10-14T10:33:59.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.426+0000 7f41aeb90640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a80c1cc0 con 0x7f41a814e640 2023-10-14T10:33:59.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.426+0000 7f41aeb90640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a806cce0 con 0x7f41a80c1720 2023-10-14T10:33:59.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.427+0000 7f41ad12d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f41a80c5ce0 0x7f41a80a84d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46790/0 (socket says 172.21.15.8:46790) 2023-10-14T10:33:59.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.427+0000 7f41ad12d640 1 -- 172.21.15.8:0/4052971546 learned_addr learned my addr 172.21.15.8:0/4052971546 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:33:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.427+0000 7f41a7fff640 1 --2- 172.21.15.8:0/4052971546 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a80c1720 0x7f41a80c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.427+0000 7f41ac92c640 1 --2- 172.21.15.8:0/4052971546 >> v2:172.21.15.92:3300/0 conn(0x7f41a814e640 0x7f41a8154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.427+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767999581 0 0) 0x7f41a81552d0 con 0x7f41a80c5ce0 2023-10-14T10:33:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.427+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4194003520 con 0x7f41a80c5ce0 2023-10-14T10:33:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 694572043 0 0) 0x7f4194003520 con 0x7f41a80c5ce0 2023-10-14T10:33:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a80c1720 msgr2=0x7f41a80c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:59.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 --2- 172.21.15.8:0/4052971546 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a80c1720 0x7f41a80c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 >> v2:172.21.15.92:3300/0 conn(0x7f41a814e640 msgr2=0x7f41a8154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:59.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 --2- 172.21.15.8:0/4052971546 >> v2:172.21.15.92:3300/0 conn(0x7f41a814e640 0x7f41a8154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a806cfc0 con 0x7f41a80c5ce0 2023-10-14T10:33:59.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f41a0001670 con 0x7f41a80c5ce0 2023-10-14T10:33:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 >> v1:172.21.15.8:6789/0 conn(0x7f41a80c5ce0 legacy=0x7f41a80a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 --2- 172.21.15.8:0/4052971546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4194003970 0x7f4194003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 --2- 172.21.15.8:0/4052971546 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a80c1720 0x7f41940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 --2- 172.21.15.8:0/4052971546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4194004d00 0x7f4194005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80c1cc0 con 0x7f4194004d00 2023-10-14T10:33:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a806cce0 con 0x7f4194003970 2023-10-14T10:33:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419400fd90 con 0x7f41a80c1720 2023-10-14T10:33:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41ad12d640 1 --2- 172.21.15.8:0/4052971546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4194004d00 0x7f4194005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41ac92c640 1 --2- 172.21.15.8:0/4052971546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4194003970 0x7f4194003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41a7fff640 1 --2- 172.21.15.8:0/4052971546 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a80c1720 0x7f41940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41ad12d640 1 -- 172.21.15.8:0/4052971546 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a80c1720 msgr2=0x7f41940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41ad12d640 1 --2- 172.21.15.8:0/4052971546 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a80c1720 0x7f41940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41ad12d640 1 -- 172.21.15.8:0/4052971546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4194003970 msgr2=0x7f4194003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41ad12d640 1 --2- 172.21.15.8:0/4052971546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4194003970 0x7f4194003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.428+0000 7f41ad12d640 1 -- 172.21.15.8:0/4052971546 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4194003520 con 0x7f4194004d00 2023-10-14T10:33:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.430+0000 7f41ad12d640 1 --2- 172.21.15.8:0/4052971546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4194004d00 0x7f4194005180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f41a000c240 tx=0x7f41940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db62e0168343bb87 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.430+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a002cb00 con 0x7f4194004d00 2023-10-14T10:33:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.430+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a002cc60 con 0x7f4194004d00 2023-10-14T10:33:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.430+0000 7f41a77fe640 1 -- 172.21.15.8:0/4052971546 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a0005af0 con 0x7f4194004d00 2023-10-14T10:33:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.430+0000 7f41aeb90640 1 -- 172.21.15.8:0/4052971546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4194004d00 msgr2=0x7f4194005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.430+0000 7f41aeb90640 1 --2- 172.21.15.8:0/4052971546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4194004d00 0x7f4194005180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f41a000c240 tx=0x7f41940057f0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.430+0000 7f41ad12d640 1 -- 172.21.15.8:0/4052971546 reap_dead start 2023-10-14T10:33:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.431+0000 7f41aeb90640 1 -- 172.21.15.8:0/4052971546 shutdown_connections 2023-10-14T10:33:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.431+0000 7f41aeb90640 1 -- 172.21.15.8:0/4052971546 >> 172.21.15.8:0/4052971546 conn(0x7f41a80a74d0 msgr2=0x7f41a80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.431+0000 7f41aeb90640 1 -- 172.21.15.8:0/4052971546 shutdown_connections 2023-10-14T10:33:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.431+0000 7f41aeb90640 1 -- 172.21.15.8:0/4052971546 wait complete. 2023-10-14T10:33:59.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.432+0000 7f41aeb90640 1 Processor -- start 2023-10-14T10:33:59.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.433+0000 7f41aeb90640 1 -- start start 2023-10-14T10:33:59.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.433+0000 7f41aeb90640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4194004d00 0x7f41a8151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.433+0000 7f41aeb90640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41a8151af0 0x7f41a81e8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.433+0000 7f41aeb90640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a81e8770 0x7f41a8140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.433+0000 7f41aeb90640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80c4840 con 0x7f4194004d00 2023-10-14T10:33:59.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.433+0000 7f41aeb90640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a81e8dc0 con 0x7f41a8151af0 2023-10-14T10:33:59.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.433+0000 7f41aeb90640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80c4a50 con 0x7f41a81e8770 2023-10-14T10:33:59.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.434+0000 7f41ac92c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4194004d00 0x7f41a8151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.434+0000 7f41ac92c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4194004d00 0x7f41a8151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40756/0 (socket says 172.21.15.8:40756) 2023-10-14T10:33:59.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.434+0000 7f41ac92c640 1 -- 172.21.15.8:0/3176862069 learned_addr learned my addr 172.21.15.8:0/3176862069 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:59.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.434+0000 7f41a7fff640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41a8151af0 0x7f41a81e8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.434+0000 7f41ac92c640 1 -- 172.21.15.8:0/3176862069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a81e8770 msgr2=0x7f41a8140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:59.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.434+0000 7f41ad12d640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a81e8770 0x7f41a8140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.434+0000 7f41ac92c640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a81e8770 0x7f41a8140960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.434+0000 7f41ac92c640 1 -- 172.21.15.8:0/3176862069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41a8151af0 msgr2=0x7f41a81e8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:59.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.434+0000 7f41ac92c640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41a8151af0 0x7f41a81e8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.434+0000 7f41ac92c640 1 -- 172.21.15.8:0/3176862069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a80c4d30 con 0x7f4194004d00 2023-10-14T10:33:59.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.434+0000 7f41a7fff640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41a8151af0 0x7f41a81e8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:33:59.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.434+0000 7f41ac92c640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4194004d00 0x7f41a8151230 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4198009fb0 tx=0x7f41980115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:59.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.435+0000 7f41a57fa640 1 -- 172.21.15.8:0/3176862069 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419800e030 con 0x7f4194004d00 2023-10-14T10:33:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.435+0000 7f41a57fa640 1 -- 172.21.15.8:0/3176862069 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4198016470 con 0x7f4194004d00 2023-10-14T10:33:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.435+0000 7f41a57fa640 1 -- 172.21.15.8:0/3176862069 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4198016820 con 0x7f4194004d00 2023-10-14T10:33:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.435+0000 7f41aeb90640 1 -- 172.21.15.8:0/3176862069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a80c5010 con 0x7f4194004d00 2023-10-14T10:33:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.435+0000 7f41aeb90640 1 -- 172.21.15.8:0/3176862069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a8140ea0 con 0x7f4194004d00 2023-10-14T10:33:59.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.436+0000 7f41aeb90640 1 -- 172.21.15.8:0/3176862069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a81e8b50 con 0x7f4194004d00 2023-10-14T10:33:59.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.437+0000 7f41a57fa640 1 -- 172.21.15.8:0/3176862069 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4198016980 con 0x7f4194004d00 2023-10-14T10:33:59.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.438+0000 7f41a57fa640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f418806ae70 0x7f418806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.439+0000 7f41a57fa640 1 -- 172.21.15.8:0/3176862069 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f419800f070 con 0x7f4194004d00 2023-10-14T10:33:59.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.439+0000 7f41a7fff640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f418806ae70 0x7f418806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.440+0000 7f41a7fff640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f418806ae70 0x7f418806d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f41a8145080 tx=0x7f4190008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:59.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.443+0000 7f41a57fa640 1 -- 172.21.15.8:0/3176862069 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4198055720 con 0x7f4194004d00 2023-10-14T10:33:59.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.643+0000 7f41aeb90640 1 -- 172.21.15.8:0/3176862069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41a8073b50 con 0x7f4194004d00 2023-10-14T10:33:59.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.646+0000 7f41a57fa640 1 -- 172.21.15.8:0/3176862069 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7f4198058d40 con 0x7f4194004d00 2023-10-14T10:33:59.648 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:33:59.648 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:33:59.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.648+0000 7f41aeb90640 1 -- 172.21.15.8:0/3176862069 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f418806ae70 msgr2=0x7f418806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:59.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.648+0000 7f41aeb90640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f418806ae70 0x7f418806d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f41a8145080 tx=0x7f4190008040 comp rx=0 tx=0).stop 2023-10-14T10:33:59.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.648+0000 7f41aeb90640 1 -- 172.21.15.8:0/3176862069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4194004d00 msgr2=0x7f41a8151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:59.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.648+0000 7f41aeb90640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4194004d00 0x7f41a8151230 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4198009fb0 tx=0x7f41980115a0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.649+0000 7f41aeb90640 1 -- 172.21.15.8:0/3176862069 shutdown_connections 2023-10-14T10:33:59.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.649+0000 7f41aeb90640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f418806ae70 0x7f418806d330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.649+0000 7f41aeb90640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a81e8770 0x7f41a8140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.649+0000 7f41aeb90640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41a8151af0 0x7f41a81e8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.649+0000 7f41aeb90640 1 --2- 172.21.15.8:0/3176862069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4194004d00 0x7f41a8151230 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.649+0000 7f41aeb90640 1 -- 172.21.15.8:0/3176862069 >> 172.21.15.8:0/3176862069 conn(0x7f41a80a74d0 msgr2=0x7f41a8071670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:59.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.649+0000 7f41aeb90640 1 -- 172.21.15.8:0/3176862069 shutdown_connections 2023-10-14T10:33:59.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.649+0000 7f41aeb90640 1 -- 172.21.15.8:0/3176862069 wait complete. 2023-10-14T10:33:59.671 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T10:33:44.913451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T10:33:46.397320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:33:59.671 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:33:59.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.891+0000 7f9911275640 1 Processor -- start 2023-10-14T10:33:59.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.891+0000 7f9911275640 1 -- start start 2023-10-14T10:33:59.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.893+0000 7f9911275640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f990c0c06e0 0x7f990c071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.893+0000 7f9911275640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f990c0bf710 0x7f990c06e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.893+0000 7f9911275640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c151a90 con 0x7f990c0c0d80 2023-10-14T10:33:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.893+0000 7f9911275640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c0c27a0 con 0x7f990c0bf710 2023-10-14T10:33:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.893+0000 7f9911275640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c06aaf0 con 0x7f990c0c06e0 2023-10-14T10:33:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.894+0000 7f990b7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f990c0bf710 0x7f990c06e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.894+0000 7f990b7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f990c0bf710 0x7f990c06e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40762/0 (socket says 172.21.15.8:40762) 2023-10-14T10:33:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.894+0000 7f990b7fe640 1 -- 172.21.15.8:0/3660500837 learned_addr learned my addr 172.21.15.8:0/3660500837 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.894+0000 7f990bfff640 1 --2- 172.21.15.8:0/3660500837 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f990c0c06e0 0x7f990c071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.894+0000 7f990b7fe640 1 -- 172.21.15.8:0/3660500837 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f990c0c06e0 msgr2=0x7f990c071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:33:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.894+0000 7f990b7fe640 1 --2- 172.21.15.8:0/3660500837 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f990c0c06e0 0x7f990c071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.894+0000 7f990b7fe640 1 -- 172.21.15.8:0/3660500837 >> v1:172.21.15.92:6789/0 conn(0x7f990c0c0d80 legacy=0x7f990c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.894+0000 7f990b7fe640 1 -- 172.21.15.8:0/3660500837 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c06ebb0 con 0x7f990c0bf710 2023-10-14T10:33:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.895+0000 7f990b7fe640 1 --2- 172.21.15.8:0/3660500837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f990c0bf710 0x7f990c06e670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9900009870 tx=0x7f990002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e51416c17f938ae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.895+0000 7f990affd640 1 -- 172.21.15.8:0/3660500837 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99000317c0 con 0x7f990c0bf710 2023-10-14T10:33:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.896+0000 7f990affd640 1 -- 172.21.15.8:0/3660500837 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9900031920 con 0x7f990c0bf710 2023-10-14T10:33:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.896+0000 7f990affd640 1 -- 172.21.15.8:0/3660500837 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900031cb0 con 0x7f990c0bf710 2023-10-14T10:33:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.896+0000 7f9911275640 1 -- 172.21.15.8:0/3660500837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f990c0bf710 msgr2=0x7f990c06e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.896+0000 7f9911275640 1 --2- 172.21.15.8:0/3660500837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f990c0bf710 0x7f990c06e670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9900009870 tx=0x7f990002b860 comp rx=0 tx=0).stop 2023-10-14T10:33:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.896+0000 7f9911275640 1 -- 172.21.15.8:0/3660500837 shutdown_connections 2023-10-14T10:33:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.896+0000 7f9911275640 1 --2- 172.21.15.8:0/3660500837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f990c0bf710 0x7f990c06e670 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.896+0000 7f9911275640 1 --2- 172.21.15.8:0/3660500837 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f990c0c06e0 0x7f990c071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.896+0000 7f9911275640 1 -- 172.21.15.8:0/3660500837 >> 172.21.15.8:0/3660500837 conn(0x7f990c0c2e80 msgr2=0x7f990c0c3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:33:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.896+0000 7f9911275640 1 -- 172.21.15.8:0/3660500837 shutdown_connections 2023-10-14T10:33:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.897+0000 7f9911275640 1 -- 172.21.15.8:0/3660500837 wait complete. 2023-10-14T10:33:59.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.899+0000 7f9911275640 1 Processor -- start 2023-10-14T10:33:59.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.899+0000 7f9911275640 1 -- start start 2023-10-14T10:33:59.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.900+0000 7f9911275640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f990c0bf710 0x7f990c14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.900+0000 7f9911275640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f990c0c06e0 0x7f990c155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.900+0000 7f9911275640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f990c0c0d80 0x7f990c145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.900+0000 7f9911275640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c1576e0 con 0x7f990c0c0d80 2023-10-14T10:33:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.900+0000 7f9911275640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c1ed2c0 con 0x7f990c0bf710 2023-10-14T10:33:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.900+0000 7f9911275640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c1ed7f0 con 0x7f990c0c06e0 2023-10-14T10:33:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.900+0000 7f9910a74640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f990c0c0d80 0x7f990c145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.900+0000 7f9910a74640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f990c0c0d80 0x7f990c145c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40772/0 (socket says 172.21.15.8:40772) 2023-10-14T10:33:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.900+0000 7f9910a74640 1 -- 172.21.15.8:0/626488051 learned_addr learned my addr 172.21.15.8:0/626488051 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:33:59.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.901+0000 7f990bfff640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f990c0bf710 0x7f990c14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.901+0000 7f990b7fe640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f990c0c06e0 0x7f990c155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.901+0000 7f9910a74640 1 -- 172.21.15.8:0/626488051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f990c0c06e0 msgr2=0x7f990c155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:59.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.901+0000 7f9910a74640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f990c0c06e0 0x7f990c155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.901+0000 7f9910a74640 1 -- 172.21.15.8:0/626488051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f990c0bf710 msgr2=0x7f990c14ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:33:59.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.901+0000 7f9910a74640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f990c0bf710 0x7f990c14ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:33:59.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.901+0000 7f9910a74640 1 -- 172.21.15.8:0/626488051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99000094d0 con 0x7f990c0c0d80 2023-10-14T10:33:59.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.901+0000 7f9910a74640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f990c0c0d80 0x7f990c145c90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f990400c400 tx=0x7f990400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:59.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.902+0000 7f9908ff9640 1 -- 172.21.15.8:0/626488051 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99040052d0 con 0x7f990c0c0d80 2023-10-14T10:33:59.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.902+0000 7f9908ff9640 1 -- 172.21.15.8:0/626488051 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9904005430 con 0x7f990c0c0d80 2023-10-14T10:33:59.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.902+0000 7f9908ff9640 1 -- 172.21.15.8:0/626488051 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904003810 con 0x7f990c0c0d80 2023-10-14T10:33:59.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.902+0000 7f9911275640 1 -- 172.21.15.8:0/626488051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990c1ed510 con 0x7f990c0c0d80 2023-10-14T10:33:59.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.902+0000 7f9911275640 1 -- 172.21.15.8:0/626488051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c1e97c0 con 0x7f990c0c0d80 2023-10-14T10:33:59.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.903+0000 7f9911275640 1 -- 172.21.15.8:0/626488051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990c06edf0 con 0x7f990c0c0d80 2023-10-14T10:33:59.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.904+0000 7f9908ff9640 1 -- 172.21.15.8:0/626488051 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9904003970 con 0x7f990c0c0d80 2023-10-14T10:33:59.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.905+0000 7f9908ff9640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f98f806aea0 0x7f98f806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:33:59.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.905+0000 7f9908ff9640 1 -- 172.21.15.8:0/626488051 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9904088b20 con 0x7f990c0c0d80 2023-10-14T10:33:59.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.905+0000 7f990bfff640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f98f806aea0 0x7f98f806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:33:59.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.906+0000 7f990bfff640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f98f806aea0 0x7f98f806d360 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f98fc003aa0 tx=0x7f98fc009830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:33:59.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:33:59.909+0000 7f9908ff9640 1 -- 172.21.15.8:0/626488051 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9904053c70 con 0x7f990c0c0d80 2023-10-14T10:34:00.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.102+0000 7f9911275640 1 -- 172.21.15.8:0/626488051 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f990c1e9340 con 0x7f990c0c0d80 2023-10-14T10:34:00.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.102+0000 7f9908ff9640 1 -- 172.21.15.8:0/626488051 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f990c1e9340 con 0x7f990c0c0d80 2023-10-14T10:34:00.105 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:34:00.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.105+0000 7f9911275640 1 -- 172.21.15.8:0/626488051 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f98f806aea0 msgr2=0x7f98f806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.105+0000 7f9911275640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f98f806aea0 0x7f98f806d360 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f98fc003aa0 tx=0x7f98fc009830 comp rx=0 tx=0).stop 2023-10-14T10:34:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.105+0000 7f9911275640 1 -- 172.21.15.8:0/626488051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f990c0c0d80 msgr2=0x7f990c145c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.105+0000 7f9911275640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f990c0c0d80 0x7f990c145c90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f990400c400 tx=0x7f990400c8c0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.105+0000 7f9911275640 1 -- 172.21.15.8:0/626488051 shutdown_connections 2023-10-14T10:34:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.105+0000 7f9911275640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f98f806aea0 0x7f98f806d360 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.105+0000 7f9911275640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f990c0c0d80 0x7f990c145c90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.105+0000 7f9911275640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f990c0c06e0 0x7f990c155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.105+0000 7f9911275640 1 --2- 172.21.15.8:0/626488051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f990c0bf710 0x7f990c14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.105+0000 7f9911275640 1 -- 172.21.15.8:0/626488051 >> 172.21.15.8:0/626488051 conn(0x7f990c0c2e80 msgr2=0x7f990c1511c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:00.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.106+0000 7f9911275640 1 -- 172.21.15.8:0/626488051 shutdown_connections 2023-10-14T10:34:00.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.106+0000 7f9911275640 1 -- 172.21.15.8:0/626488051 wait complete. 2023-10-14T10:34:00.128 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T10:34:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.350+0000 7f49f3e32640 1 Processor -- start 2023-10-14T10:34:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.351+0000 7f49f3e32640 1 -- start start 2023-10-14T10:34:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.352+0000 7f49f3e32640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f49ec0c4290 0x7f49ec154d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:00.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.352+0000 7f49f3e32640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f49ec0c66e0 0x7f49ec0c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:00.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.353+0000 7f49f3e32640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ec0c6af0 con 0x7f49ec0c7810 2023-10-14T10:34:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.353+0000 7f49f3e32640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ec06bf80 con 0x7f49ec0c66e0 2023-10-14T10:34:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.353+0000 7f49f3e32640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ec13cf00 con 0x7f49ec0c4290 2023-10-14T10:34:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.353+0000 7f49f23cf640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f49ec0c66e0 0x7f49ec0c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.353+0000 7f49f23cf640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f49ec0c66e0 0x7f49ec0c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40776/0 (socket says 172.21.15.8:40776) 2023-10-14T10:34:00.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.353+0000 7f49f23cf640 1 -- 172.21.15.8:0/2582217930 learned_addr learned my addr 172.21.15.8:0/2582217930 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:00.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.353+0000 7f49f1bce640 1 --2- 172.21.15.8:0/2582217930 >> v2:172.21.15.92:3300/0 conn(0x7f49ec0c4290 0x7f49ec154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:00.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.353+0000 7f49f23cf640 1 -- 172.21.15.8:0/2582217930 >> v2:172.21.15.92:3300/0 conn(0x7f49ec0c4290 msgr2=0x7f49ec154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:00.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.353+0000 7f49f23cf640 1 --2- 172.21.15.8:0/2582217930 >> v2:172.21.15.92:3300/0 conn(0x7f49ec0c4290 0x7f49ec154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.353+0000 7f49f23cf640 1 -- 172.21.15.8:0/2582217930 >> v1:172.21.15.92:6789/0 conn(0x7f49ec0c7810 legacy=0x7f49ec157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:00.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.353+0000 7f49f23cf640 1 -- 172.21.15.8:0/2582217930 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec0c7030 con 0x7f49ec0c66e0 2023-10-14T10:34:00.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.354+0000 7f49f1bce640 1 --2- 172.21.15.8:0/2582217930 >> v2:172.21.15.92:3300/0 conn(0x7f49ec0c4290 0x7f49ec154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:00.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.355+0000 7f49f23cf640 1 --2- 172.21.15.8:0/2582217930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0c66e0 0x7f49ec0c4670 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f49ec066a00 tx=0x7f49e402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36da24217b8f23f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:00.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.355+0000 7f49f0bcc640 1 -- 172.21.15.8:0/2582217930 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4031750 con 0x7f49ec0c66e0 2023-10-14T10:34:00.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.356+0000 7f49f0bcc640 1 -- 172.21.15.8:0/2582217930 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e40318b0 con 0x7f49ec0c66e0 2023-10-14T10:34:00.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.356+0000 7f49f0bcc640 1 -- 172.21.15.8:0/2582217930 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4031c40 con 0x7f49ec0c66e0 2023-10-14T10:34:00.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.356+0000 7f49f3e32640 1 -- 172.21.15.8:0/2582217930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0c66e0 msgr2=0x7f49ec0c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:00.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.356+0000 7f49f3e32640 1 --2- 172.21.15.8:0/2582217930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0c66e0 0x7f49ec0c4670 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f49ec066a00 tx=0x7f49e402b7f0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.356+0000 7f49f3e32640 1 -- 172.21.15.8:0/2582217930 shutdown_connections 2023-10-14T10:34:00.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.356+0000 7f49f3e32640 1 --2- 172.21.15.8:0/2582217930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0c66e0 0x7f49ec0c4670 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.356+0000 7f49f3e32640 1 --2- 172.21.15.8:0/2582217930 >> v2:172.21.15.92:3300/0 conn(0x7f49ec0c4290 0x7f49ec154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.356+0000 7f49f3e32640 1 -- 172.21.15.8:0/2582217930 >> 172.21.15.8:0/2582217930 conn(0x7f49ec065c90 msgr2=0x7f49ec0660a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:00.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.356+0000 7f49f3e32640 1 -- 172.21.15.8:0/2582217930 shutdown_connections 2023-10-14T10:34:00.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.356+0000 7f49f3e32640 1 -- 172.21.15.8:0/2582217930 wait complete. 2023-10-14T10:34:00.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.358+0000 7f49f3e32640 1 Processor -- start 2023-10-14T10:34:00.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.358+0000 7f49f3e32640 1 -- start start 2023-10-14T10:34:00.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.359+0000 7f49f3e32640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0c4290 0x7f49ec0abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:00.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.359+0000 7f49f3e32640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49ec0c66e0 0x7f49ec0aa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:00.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.359+0000 7f49f3e32640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49ec0c7810 0x7f49ec1322f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:00.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.359+0000 7f49f3e32640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec156370 con 0x7f49ec0c4290 2023-10-14T10:34:00.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.359+0000 7f49f3e32640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec0abbe0 con 0x7f49ec0c7810 2023-10-14T10:34:00.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.359+0000 7f49f3e32640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec157b50 con 0x7f49ec0c66e0 2023-10-14T10:34:00.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.359+0000 7f49f1bce640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0c4290 0x7f49ec0abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:00.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.360+0000 7f49f1bce640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0c4290 0x7f49ec0abfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40792/0 (socket says 172.21.15.8:40792) 2023-10-14T10:34:00.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.360+0000 7f49f1bce640 1 -- 172.21.15.8:0/1473612951 learned_addr learned my addr 172.21.15.8:0/1473612951 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:00.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.360+0000 7f49f13cd640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49ec0c66e0 0x7f49ec0aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.360+0000 7f49f23cf640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49ec0c7810 0x7f49ec1322f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.360+0000 7f49f1bce640 1 -- 172.21.15.8:0/1473612951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49ec0c66e0 msgr2=0x7f49ec0aa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:00.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.360+0000 7f49f1bce640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49ec0c66e0 0x7f49ec0aa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.360+0000 7f49f1bce640 1 -- 172.21.15.8:0/1473612951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49ec0c7810 msgr2=0x7f49ec1322f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:00.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.360+0000 7f49f1bce640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49ec0c7810 0x7f49ec1322f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.360+0000 7f49f1bce640 1 -- 172.21.15.8:0/1473612951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e40094d0 con 0x7f49ec0c4290 2023-10-14T10:34:00.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.360+0000 7f49f1bce640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0c4290 0x7f49ec0abfe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f49e800ce00 tx=0x7f49e800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:00.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.361+0000 7f49e27fc640 1 -- 172.21.15.8:0/1473612951 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800f890 con 0x7f49ec0c4290 2023-10-14T10:34:00.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.361+0000 7f49e27fc640 1 -- 172.21.15.8:0/1473612951 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e800f9f0 con 0x7f49ec0c4290 2023-10-14T10:34:00.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.361+0000 7f49e27fc640 1 -- 172.21.15.8:0/1473612951 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800fd80 con 0x7f49ec0c4290 2023-10-14T10:34:00.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.361+0000 7f49f3e32640 1 -- 172.21.15.8:0/1473612951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec0c3970 con 0x7f49ec0c4290 2023-10-14T10:34:00.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.361+0000 7f49f3e32640 1 -- 172.21.15.8:0/1473612951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec0a9500 con 0x7f49ec0c4290 2023-10-14T10:34:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.362+0000 7f49f3e32640 1 -- 172.21.15.8:0/1473612951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec0a9720 con 0x7f49ec0c4290 2023-10-14T10:34:00.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.363+0000 7f49e27fc640 1 -- 172.21.15.8:0/1473612951 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f49e800b040 con 0x7f49ec0c4290 2023-10-14T10:34:00.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.364+0000 7f49e27fc640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f49d006ae70 0x7f49d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:00.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.364+0000 7f49e27fc640 1 -- 172.21.15.8:0/1473612951 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49e8089ff0 con 0x7f49ec0c4290 2023-10-14T10:34:00.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.364+0000 7f49f13cd640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f49d006ae70 0x7f49d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:00.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.365+0000 7f49f13cd640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f49d006ae70 0x7f49d006d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0c32f0 tx=0x7f49dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:00.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.369+0000 7f49e27fc640 1 -- 172.21.15.8:0/1473612951 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f49e8055090 con 0x7f49ec0c4290 2023-10-14T10:34:00.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.567+0000 7f49f3e32640 1 -- 172.21.15.8:0/1473612951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49ec04e9b0 con 0x7f49ec0c4290 2023-10-14T10:34:00.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.568+0000 7f49e27fc640 1 -- 172.21.15.8:0/1473612951 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f49e801d020 con 0x7f49ec0c4290 2023-10-14T10:34:00.571 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T10:34:00.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.570+0000 7f49f3e32640 1 -- 172.21.15.8:0/1473612951 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f49d006ae70 msgr2=0x7f49d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:00.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.570+0000 7f49f3e32640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f49d006ae70 0x7f49d006d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0c32f0 tx=0x7f49dc009040 comp rx=0 tx=0).stop 2023-10-14T10:34:00.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.571+0000 7f49f3e32640 1 -- 172.21.15.8:0/1473612951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0c4290 msgr2=0x7f49ec0abfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:00.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.571+0000 7f49f3e32640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0c4290 0x7f49ec0abfe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f49e800ce00 tx=0x7f49e800a650 comp rx=0 tx=0).stop 2023-10-14T10:34:00.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.571+0000 7f49f3e32640 1 -- 172.21.15.8:0/1473612951 shutdown_connections 2023-10-14T10:34:00.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.571+0000 7f49f3e32640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f49d006ae70 0x7f49d006d330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.571+0000 7f49f3e32640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49ec0c7810 0x7f49ec1322f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.571+0000 7f49f3e32640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49ec0c66e0 0x7f49ec0aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.571+0000 7f49f3e32640 1 --2- 172.21.15.8:0/1473612951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f49ec0c4290 0x7f49ec0abfe0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.571+0000 7f49f3e32640 1 -- 172.21.15.8:0/1473612951 >> 172.21.15.8:0/1473612951 conn(0x7f49ec065c90 msgr2=0x7f49ec0c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:00.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.571+0000 7f49f3e32640 1 -- 172.21.15.8:0/1473612951 shutdown_connections 2023-10-14T10:34:00.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.571+0000 7f49f3e32640 1 -- 172.21.15.8:0/1473612951 wait complete. 2023-10-14T10:34:00.592 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T10:34:00.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.811+0000 7fe8d9c83640 1 Processor -- start 2023-10-14T10:34:00.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.811+0000 7fe8d9c83640 1 -- start start 2023-10-14T10:34:00.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.813+0000 7fe8d9c83640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe8d414e0f0 0x7fe8d40719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:00.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.813+0000 7fe8d9c83640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d40ba150 0x7fe8d40c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:00.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.813+0000 7fe8d9c83640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d4154060 con 0x7fe8d40c2670 2023-10-14T10:34:00.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.813+0000 7fe8d9c83640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d414e4d0 con 0x7fe8d414e0f0 2023-10-14T10:34:00.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.813+0000 7fe8d9c83640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4154ce0 con 0x7fe8d40ba150 2023-10-14T10:34:00.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.813+0000 7fe8cbfff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d40ba150 0x7fe8d40c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:00.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.813+0000 7fe8cbfff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d40ba150 0x7fe8d40c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:58454/0 (socket says 172.21.15.8:58454) 2023-10-14T10:34:00.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.813+0000 7fe8cbfff640 1 -- 172.21.15.8:0/3926126122 learned_addr learned my addr 172.21.15.8:0/3926126122 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:00.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.813+0000 7fe8d9482640 1 --1- 172.21.15.8:0/3926126122 >> v1:172.21.15.92:6789/0 conn(0x7fe8d40c2670 0x7fe8d4157640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:60870/0 (socket says 172.21.15.8:60870) 2023-10-14T10:34:00.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.814+0000 7fe8d8c81640 1 --2- 172.21.15.8:0/3926126122 >> v2:172.21.15.92:3300/0 conn(0x7fe8d414e0f0 0x7fe8d40719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:00.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.814+0000 7fe8cb7fe640 1 -- 172.21.15.8:0/3926126122 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319924231 0 0) 0x7fe8d4154060 con 0x7fe8d40c2670 2023-10-14T10:34:00.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.814+0000 7fe8cb7fe640 1 -- 172.21.15.8:0/3926126122 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8bc003520 con 0x7fe8d40c2670 2023-10-14T10:34:00.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.814+0000 7fe8d8c81640 1 -- 172.21.15.8:0/3926126122 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d40ba150 msgr2=0x7fe8d40c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:00.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.814+0000 7fe8d8c81640 1 --2- 172.21.15.8:0/3926126122 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d40ba150 0x7fe8d40c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.814+0000 7fe8d8c81640 1 -- 172.21.15.8:0/3926126122 >> v1:172.21.15.92:6789/0 conn(0x7fe8d40c2670 legacy=0x7fe8d4157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:00.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.814+0000 7fe8d8c81640 1 -- 172.21.15.8:0/3926126122 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4154340 con 0x7fe8d414e0f0 2023-10-14T10:34:00.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.814+0000 7fe8cbfff640 1 --2- 172.21.15.8:0/3926126122 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d40ba150 0x7fe8d40c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:34:00.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.816+0000 7fe8d8c81640 1 --2- 172.21.15.8:0/3926126122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d414e0f0 0x7fe8d40719f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009d90 tx=0x7fe8d002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68e7309020af6d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:00.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.816+0000 7fe8cb7fe640 1 -- 172.21.15.8:0/3926126122 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d002cc60 con 0x7fe8d414e0f0 2023-10-14T10:34:00.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.816+0000 7fe8cb7fe640 1 -- 172.21.15.8:0/3926126122 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d002cdc0 con 0x7fe8d414e0f0 2023-10-14T10:34:00.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.816+0000 7fe8cb7fe640 1 -- 172.21.15.8:0/3926126122 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0034640 con 0x7fe8d414e0f0 2023-10-14T10:34:00.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.816+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3926126122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d414e0f0 msgr2=0x7fe8d40719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:00.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.816+0000 7fe8d9c83640 1 --2- 172.21.15.8:0/3926126122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d414e0f0 0x7fe8d40719f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009d90 tx=0x7fe8d002beb0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.817+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3926126122 shutdown_connections 2023-10-14T10:34:00.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.817+0000 7fe8d9c83640 1 --2- 172.21.15.8:0/3926126122 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d40ba150 0x7fe8d40c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.817+0000 7fe8d9c83640 1 --2- 172.21.15.8:0/3926126122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d414e0f0 0x7fe8d40719f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.817+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3926126122 >> 172.21.15.8:0/3926126122 conn(0x7fe8d406a200 msgr2=0x7fe8d406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:00.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.817+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3926126122 shutdown_connections 2023-10-14T10:34:00.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.817+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3926126122 wait complete. 2023-10-14T10:34:00.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.819+0000 7fe8d9c83640 1 Processor -- start 2023-10-14T10:34:00.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.819+0000 7fe8d9c83640 1 -- start start 2023-10-14T10:34:00.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.820+0000 7fe8d9c83640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d40ba150 0x7fe8d40a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:00.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.820+0000 7fe8d9c83640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d40c2670 0x7fe8d40bada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:00.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.820+0000 7fe8d9c83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d414e0f0 0x7fe8d41e9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:00.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.820+0000 7fe8d9c83640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d414e750 con 0x7fe8d40ba150 2023-10-14T10:34:00.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.820+0000 7fe8d9c83640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40a9cd0 con 0x7fe8d414e0f0 2023-10-14T10:34:00.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.820+0000 7fe8d9c83640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d41e8d40 con 0x7fe8d40c2670 2023-10-14T10:34:00.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.820+0000 7fe8d8c81640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d40ba150 0x7fe8d40a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:00.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.820+0000 7fe8d8c81640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d40ba150 0x7fe8d40a81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40804/0 (socket says 172.21.15.8:40804) 2023-10-14T10:34:00.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.820+0000 7fe8d8c81640 1 -- 172.21.15.8:0/3475969234 learned_addr learned my addr 172.21.15.8:0/3475969234 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:00.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.820+0000 7fe8d9482640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d414e0f0 0x7fe8d41e9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:00.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.820+0000 7fe8cbfff640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d40c2670 0x7fe8d40bada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:00.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.821+0000 7fe8d8c81640 1 -- 172.21.15.8:0/3475969234 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d40c2670 msgr2=0x7fe8d40bada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:00.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.821+0000 7fe8d8c81640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d40c2670 0x7fe8d40bada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.821+0000 7fe8d8c81640 1 -- 172.21.15.8:0/3475969234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d414e0f0 msgr2=0x7fe8d41e9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:00.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.821+0000 7fe8d8c81640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d414e0f0 0x7fe8d41e9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:00.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.821+0000 7fe8d8c81640 1 -- 172.21.15.8:0/3475969234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c40094d0 con 0x7fe8d40ba150 2023-10-14T10:34:00.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.821+0000 7fe8d8c81640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d40ba150 0x7fe8d40a81c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe8d002c4c0 tx=0x7fe8d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:00.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.821+0000 7fe8c97fa640 1 -- 172.21.15.8:0/3475969234 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d003e610 con 0x7fe8d40ba150 2023-10-14T10:34:00.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.821+0000 7fe8c97fa640 1 -- 172.21.15.8:0/3475969234 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d003e770 con 0x7fe8d40ba150 2023-10-14T10:34:00.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.821+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3475969234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d0009a70 con 0x7fe8d40ba150 2023-10-14T10:34:00.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.821+0000 7fe8c97fa640 1 -- 172.21.15.8:0/3475969234 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d003eb20 con 0x7fe8d40ba150 2023-10-14T10:34:00.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.821+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3475969234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d40aa200 con 0x7fe8d40ba150 2023-10-14T10:34:00.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.822+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3475969234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d40619f0 con 0x7fe8d40ba150 2023-10-14T10:34:00.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.823+0000 7fe8c97fa640 1 -- 172.21.15.8:0/3475969234 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe8d003b050 con 0x7fe8d40ba150 2023-10-14T10:34:00.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.825+0000 7fe8c97fa640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe8c006aef0 0x7fe8c006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:00.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.825+0000 7fe8c97fa640 1 -- 172.21.15.8:0/3475969234 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8d00aba60 con 0x7fe8d40ba150 2023-10-14T10:34:00.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.825+0000 7fe8cbfff640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe8c006aef0 0x7fe8c006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:00.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.826+0000 7fe8cbfff640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe8c006aef0 0x7fe8c006d3b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40c5180 tx=0x7fe8c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:00.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:00.829+0000 7fe8c97fa640 1 -- 172.21.15.8:0/3475969234 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe8d0076b80 con 0x7fe8d40ba150 2023-10-14T10:34:01.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.029+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3475969234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8d406ffd0 con 0x7fe8d40ba150 2023-10-14T10:34:01.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.030+0000 7fe8c97fa640 1 -- 172.21.15.8:0/3475969234 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8d0009450 con 0x7fe8d40ba150 2023-10-14T10:34:01.032 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T10:34:01.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.033+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3475969234 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe8c006aef0 msgr2=0x7fe8c006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.033+0000 7fe8d9c83640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe8c006aef0 0x7fe8c006d3b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40c5180 tx=0x7fe8c4008040 comp rx=0 tx=0).stop 2023-10-14T10:34:01.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.033+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3475969234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d40ba150 msgr2=0x7fe8d40a81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.033+0000 7fe8d9c83640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d40ba150 0x7fe8d40a81c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe8d002c4c0 tx=0x7fe8d0004a40 comp rx=0 tx=0).stop 2023-10-14T10:34:01.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.033+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3475969234 shutdown_connections 2023-10-14T10:34:01.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.033+0000 7fe8d9c83640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe8c006aef0 0x7fe8c006d3b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.033+0000 7fe8d9c83640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d414e0f0 0x7fe8d41e9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.033+0000 7fe8d9c83640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d40c2670 0x7fe8d40bada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.033+0000 7fe8d9c83640 1 --2- 172.21.15.8:0/3475969234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d40ba150 0x7fe8d40a81c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.033+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3475969234 >> 172.21.15.8:0/3475969234 conn(0x7fe8d406a200 msgr2=0x7fe8d4156160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:01.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.033+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3475969234 shutdown_connections 2023-10-14T10:34:01.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.034+0000 7fe8d9c83640 1 -- 172.21.15.8:0/3475969234 wait complete. 2023-10-14T10:34:01.055 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:34:01.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.283+0000 7fe19e05d640 1 Processor -- start 2023-10-14T10:34:01.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.283+0000 7fe19e05d640 1 -- start start 2023-10-14T10:34:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.285+0000 7fe19e05d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe1980c57a0 0x7fe198152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.285+0000 7fe19e05d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe198152ea0 con 0x7fe19813b260 2023-10-14T10:34:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.285+0000 7fe19e05d640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe198151ea0 con 0x7fe198071ff0 2023-10-14T10:34:01.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.285+0000 7fe19e05d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe198152540 con 0x7fe1980c57a0 2023-10-14T10:34:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.285+0000 7fe197fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe1980c57a0 0x7fe198152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.285+0000 7fe197fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe1980c57a0 0x7fe198152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40806/0 (socket says 172.21.15.8:40806) 2023-10-14T10:34:01.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.285+0000 7fe197fff640 1 -- 172.21.15.8:0/379946383 learned_addr learned my addr 172.21.15.8:0/379946383 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.286+0000 7fe197fff640 1 -- 172.21.15.8:0/379946383 >> v1:172.21.15.92:6789/0 conn(0x7fe198071ff0 legacy=0x7fe19806d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.286+0000 7fe197fff640 1 -- 172.21.15.8:0/379946383 >> v1:172.21.15.8:6789/0 conn(0x7fe19813b260 legacy=0x7fe1980c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.286+0000 7fe197fff640 1 -- 172.21.15.8:0/379946383 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980c5d80 con 0x7fe1980c57a0 2023-10-14T10:34:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.287+0000 7fe197fff640 1 --2- 172.21.15.8:0/379946383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1980c57a0 0x7fe198152960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe190009e50 tx=0x7fe19002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bdaeb57b3cbc6f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.287+0000 7fe196ffd640 1 -- 172.21.15.8:0/379946383 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19002cb10 con 0x7fe1980c57a0 2023-10-14T10:34:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.287+0000 7fe196ffd640 1 -- 172.21.15.8:0/379946383 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19002cc70 con 0x7fe1980c57a0 2023-10-14T10:34:01.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.287+0000 7fe196ffd640 1 -- 172.21.15.8:0/379946383 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1900343f0 con 0x7fe1980c57a0 2023-10-14T10:34:01.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.288+0000 7fe19e05d640 1 -- 172.21.15.8:0/379946383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1980c57a0 msgr2=0x7fe198152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.288+0000 7fe19e05d640 1 --2- 172.21.15.8:0/379946383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1980c57a0 0x7fe198152960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe190009e50 tx=0x7fe19002bf70 comp rx=0 tx=0).stop 2023-10-14T10:34:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.288+0000 7fe19e05d640 1 -- 172.21.15.8:0/379946383 shutdown_connections 2023-10-14T10:34:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.288+0000 7fe19e05d640 1 --2- 172.21.15.8:0/379946383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1980c57a0 0x7fe198152960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.288+0000 7fe19e05d640 1 -- 172.21.15.8:0/379946383 >> 172.21.15.8:0/379946383 conn(0x7fe1980a74d0 msgr2=0x7fe1980a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.288+0000 7fe19e05d640 1 -- 172.21.15.8:0/379946383 shutdown_connections 2023-10-14T10:34:01.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.288+0000 7fe19e05d640 1 -- 172.21.15.8:0/379946383 wait complete. 2023-10-14T10:34:01.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.290+0000 7fe19e05d640 1 Processor -- start 2023-10-14T10:34:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.290+0000 7fe19e05d640 1 -- start start 2023-10-14T10:34:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.291+0000 7fe19e05d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe198071ff0 0x7fe1981ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.291+0000 7fe19e05d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1980c57a0 0x7fe1981ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.291+0000 7fe19e05d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe19813b260 0x7fe1980beac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:01.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.291+0000 7fe19e05d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1981e9a00 con 0x7fe19813b260 2023-10-14T10:34:01.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.291+0000 7fe19e05d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980aa620 con 0x7fe198071ff0 2023-10-14T10:34:01.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.291+0000 7fe19e05d640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980aa060 con 0x7fe1980c57a0 2023-10-14T10:34:01.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.291+0000 7fe197fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe19813b260 0x7fe1980beac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:01.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.291+0000 7fe197fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe19813b260 0x7fe1980beac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40816/0 (socket says 172.21.15.8:40816) 2023-10-14T10:34:01.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.291+0000 7fe197fff640 1 -- 172.21.15.8:0/2836145807 learned_addr learned my addr 172.21.15.8:0/2836145807 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:01.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.291+0000 7fe1977fe640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe198071ff0 0x7fe1981ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:01.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.292+0000 7fe18ffff640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1980c57a0 0x7fe1981ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:01.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.292+0000 7fe197fff640 1 -- 172.21.15.8:0/2836145807 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1980c57a0 msgr2=0x7fe1981ed4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.292+0000 7fe197fff640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1980c57a0 0x7fe1981ed4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.292+0000 7fe197fff640 1 -- 172.21.15.8:0/2836145807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe198071ff0 msgr2=0x7fe1981ea9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.292+0000 7fe197fff640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe198071ff0 0x7fe1981ea9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.292+0000 7fe197fff640 1 -- 172.21.15.8:0/2836145807 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190009b30 con 0x7fe19813b260 2023-10-14T10:34:01.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.292+0000 7fe197fff640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe19813b260 0x7fe1980beac0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe190009e50 tx=0x7fe190004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:01.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.292+0000 7fe194ff9640 1 -- 172.21.15.8:0/2836145807 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190009510 con 0x7fe19813b260 2023-10-14T10:34:01.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.292+0000 7fe194ff9640 1 -- 172.21.15.8:0/2836145807 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19003e450 con 0x7fe19813b260 2023-10-14T10:34:01.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.292+0000 7fe194ff9640 1 -- 172.21.15.8:0/2836145807 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19003e800 con 0x7fe19813b260 2023-10-14T10:34:01.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.292+0000 7fe19e05d640 1 -- 172.21.15.8:0/2836145807 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1980aa340 con 0x7fe19813b260 2023-10-14T10:34:01.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.292+0000 7fe19e05d640 1 -- 172.21.15.8:0/2836145807 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1981ed9e0 con 0x7fe19813b260 2023-10-14T10:34:01.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.293+0000 7fe19e05d640 1 -- 172.21.15.8:0/2836145807 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1981e94f0 con 0x7fe19813b260 2023-10-14T10:34:01.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.294+0000 7fe194ff9640 1 -- 172.21.15.8:0/2836145807 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe19003e960 con 0x7fe19813b260 2023-10-14T10:34:01.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.296+0000 7fe194ff9640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe17806ae70 0x7fe17806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:01.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.296+0000 7fe194ff9640 1 -- 172.21.15.8:0/2836145807 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1900ac3d0 con 0x7fe19813b260 2023-10-14T10:34:01.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.296+0000 7fe1977fe640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe17806ae70 0x7fe17806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:01.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.297+0000 7fe1977fe640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe17806ae70 0x7fe17806d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe188000f60 tx=0x7fe188009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:01.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.300+0000 7fe194ff9640 1 -- 172.21.15.8:0/2836145807 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe1981e94f0 con 0x7fe19813b260 2023-10-14T10:34:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.535+0000 7fe19e05d640 1 -- 172.21.15.8:0/2836145807 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1981e94f0 con 0x7fe19813b260 2023-10-14T10:34:01.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.537+0000 7fe194ff9640 1 -- 172.21.15.8:0/2836145807 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4898 (secure 0 0 0) 0x7fe1981e94f0 con 0x7fe19813b260 2023-10-14T10:34:01.539 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:01.539 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3003490368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3003490368},{"type":"v1","addr":"172.21.15.92:6834","nonce":3003490368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3352501671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":3352501671},{"type":"v1","addr":"172.21.15.92:6835","nonce":3352501671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4157669185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4157669185},{"type":"v1","addr":"172.21.15.8:6837","nonce":4157669185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:33:47.398252+0000","modified":"2023-10-14T10:33:50.442698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6835/524862170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":524862170},{"type":"v1","addr":"172.21.15.8:6835","nonce":524862170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T10:34:01.540 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T10:34:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.540+0000 7fe19e05d640 1 -- 172.21.15.8:0/2836145807 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe17806ae70 msgr2=0x7fe17806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.540+0000 7fe19e05d640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe17806ae70 0x7fe17806d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe188000f60 tx=0x7fe188009040 comp rx=0 tx=0).stop 2023-10-14T10:34:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.540+0000 7fe19e05d640 1 -- 172.21.15.8:0/2836145807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe19813b260 msgr2=0x7fe1980beac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.540+0000 7fe19e05d640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe19813b260 0x7fe1980beac0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe190009e50 tx=0x7fe190004a40 comp rx=0 tx=0).stop 2023-10-14T10:34:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.540+0000 7fe19e05d640 1 -- 172.21.15.8:0/2836145807 shutdown_connections 2023-10-14T10:34:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.540+0000 7fe19e05d640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe17806ae70 0x7fe17806d330 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.540+0000 7fe19e05d640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe19813b260 0x7fe1980beac0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.540+0000 7fe19e05d640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1980c57a0 0x7fe1981ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.540+0000 7fe19e05d640 1 --2- 172.21.15.8:0/2836145807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe198071ff0 0x7fe1981ea9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.540+0000 7fe19e05d640 1 -- 172.21.15.8:0/2836145807 >> 172.21.15.8:0/2836145807 conn(0x7fe1980a74d0 msgr2=0x7fe1980c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.540+0000 7fe19e05d640 1 -- 172.21.15.8:0/2836145807 shutdown_connections 2023-10-14T10:34:01.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.540+0000 7fe19e05d640 1 -- 172.21.15.8:0/2836145807 wait complete. 2023-10-14T10:34:01.561 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:01.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.785+0000 7f0874fc4640 1 Processor -- start 2023-10-14T10:34:01.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.786+0000 7f0874fc4640 1 -- start start 2023-10-14T10:34:01.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.787+0000 7f0874fc4640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f087006b5d0 0x7f08700c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:01.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.787+0000 7f0874fc4640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0870154840 0x7f08700c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:01.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.787+0000 7f0874fc4640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08701543b0 con 0x7f08701514c0 2023-10-14T10:34:01.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.787+0000 7f0874fc4640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087006c3c0 con 0x7f087006b5d0 2023-10-14T10:34:01.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.787+0000 7f0874fc4640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0870153e30 con 0x7f0870154840 2023-10-14T10:34:01.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.787+0000 7f0867fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f087006b5d0 0x7f08700c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:01.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.788+0000 7f0867fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f087006b5d0 0x7f08700c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40828/0 (socket says 172.21.15.8:40828) 2023-10-14T10:34:01.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.788+0000 7f0867fff640 1 -- 172.21.15.8:0/215657170 learned_addr learned my addr 172.21.15.8:0/215657170 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:01.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.788+0000 7f086f7fe640 1 --1- 172.21.15.8:0/215657170 >> v1:172.21.15.8:6789/0 conn(0x7f08701514c0 0x7f08700c7530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46814/0 (socket says 172.21.15.8:46814) 2023-10-14T10:34:01.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.788+0000 7f086ffff640 1 --2- 172.21.15.8:0/215657170 >> v2:172.21.15.92:3300/0 conn(0x7f0870154840 0x7f08700c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:01.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.788+0000 7f0867fff640 1 -- 172.21.15.8:0/215657170 >> v2:172.21.15.92:3300/0 conn(0x7f0870154840 msgr2=0x7f08700c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:01.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.788+0000 7f0867fff640 1 --2- 172.21.15.8:0/215657170 >> v2:172.21.15.92:3300/0 conn(0x7f0870154840 0x7f08700c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.788+0000 7f0867fff640 1 -- 172.21.15.8:0/215657170 >> v1:172.21.15.8:6789/0 conn(0x7f08701514c0 legacy=0x7f08700c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.788+0000 7f0867fff640 1 -- 172.21.15.8:0/215657170 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08700c5630 con 0x7f087006b5d0 2023-10-14T10:34:01.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.789+0000 7f0867fff640 1 --2- 172.21.15.8:0/215657170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f087006b5d0 0x7f08700c50f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0858009870 tx=0x7f085802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997d0bef5b45fb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:01.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.789+0000 7f086effd640 1 -- 172.21.15.8:0/215657170 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858031860 con 0x7f087006b5d0 2023-10-14T10:34:01.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.789+0000 7f086effd640 1 -- 172.21.15.8:0/215657170 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08580319c0 con 0x7f087006b5d0 2023-10-14T10:34:01.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.789+0000 7f086effd640 1 -- 172.21.15.8:0/215657170 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858031d50 con 0x7f087006b5d0 2023-10-14T10:34:01.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.790+0000 7f0874fc4640 1 -- 172.21.15.8:0/215657170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f087006b5d0 msgr2=0x7f08700c50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.790+0000 7f0874fc4640 1 --2- 172.21.15.8:0/215657170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f087006b5d0 0x7f08700c50f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0858009870 tx=0x7f085802b900 comp rx=0 tx=0).stop 2023-10-14T10:34:01.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.790+0000 7f0874fc4640 1 -- 172.21.15.8:0/215657170 shutdown_connections 2023-10-14T10:34:01.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.790+0000 7f0874fc4640 1 --2- 172.21.15.8:0/215657170 >> v2:172.21.15.92:3300/0 conn(0x7f0870154840 0x7f08700c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.790+0000 7f0874fc4640 1 --2- 172.21.15.8:0/215657170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f087006b5d0 0x7f08700c50f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.790+0000 7f0874fc4640 1 -- 172.21.15.8:0/215657170 >> 172.21.15.8:0/215657170 conn(0x7f08700c60b0 msgr2=0x7f08700c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:01.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.790+0000 7f0874fc4640 1 -- 172.21.15.8:0/215657170 shutdown_connections 2023-10-14T10:34:01.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.790+0000 7f0874fc4640 1 -- 172.21.15.8:0/215657170 wait complete. 2023-10-14T10:34:01.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.792+0000 7f0874fc4640 1 Processor -- start 2023-10-14T10:34:01.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.792+0000 7f0874fc4640 1 -- start start 2023-10-14T10:34:01.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.793+0000 7f0874fc4640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f087006b5d0 0x7f087014b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:01.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.793+0000 7f0874fc4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08701514c0 0x7f0870145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:01.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.793+0000 7f0874fc4640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0870154840 0x7f08701ec8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:01.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.793+0000 7f0874fc4640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08700aa700 con 0x7f087006b5d0 2023-10-14T10:34:01.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.793+0000 7f0874fc4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08701ec150 con 0x7f08701514c0 2023-10-14T10:34:01.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.793+0000 7f0874fc4640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08700abeb0 con 0x7f0870154840 2023-10-14T10:34:01.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.793+0000 7f086f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f087006b5d0 0x7f087014b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:01.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.793+0000 7f086f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f087006b5d0 0x7f087014b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40830/0 (socket says 172.21.15.8:40830) 2023-10-14T10:34:01.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.793+0000 7f086f7fe640 1 -- 172.21.15.8:0/1333740161 learned_addr learned my addr 172.21.15.8:0/1333740161 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:01.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.793+0000 7f0867fff640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08701514c0 0x7f0870145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:01.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.794+0000 7f086ffff640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0870154840 0x7f08701ec8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:01.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.794+0000 7f086f7fe640 1 -- 172.21.15.8:0/1333740161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0870154840 msgr2=0x7f08701ec8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.794+0000 7f086f7fe640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0870154840 0x7f08701ec8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.794+0000 7f086f7fe640 1 -- 172.21.15.8:0/1333740161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08701514c0 msgr2=0x7f0870145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:01.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.794+0000 7f086f7fe640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08701514c0 0x7f0870145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:01.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.794+0000 7f086f7fe640 1 -- 172.21.15.8:0/1333740161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580094d0 con 0x7f087006b5d0 2023-10-14T10:34:01.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.794+0000 7f086ffff640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0870154840 0x7f08701ec8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:01.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.794+0000 7f086f7fe640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f087006b5d0 0x7f087014b760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f086000c4d0 tx=0x7f086000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:01.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.794+0000 7f086cff9640 1 -- 172.21.15.8:0/1333740161 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0860007480 con 0x7f087006b5d0 2023-10-14T10:34:01.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.794+0000 7f086cff9640 1 -- 172.21.15.8:0/1333740161 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08600075e0 con 0x7f087006b5d0 2023-10-14T10:34:01.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.794+0000 7f086cff9640 1 -- 172.21.15.8:0/1333740161 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600049e0 con 0x7f087006b5d0 2023-10-14T10:34:01.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.794+0000 7f0874fc4640 1 -- 172.21.15.8:0/1333740161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08700a8f50 con 0x7f087006b5d0 2023-10-14T10:34:01.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.795+0000 7f0874fc4640 1 -- 172.21.15.8:0/1333740161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08701ec3a0 con 0x7f087006b5d0 2023-10-14T10:34:01.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.796+0000 7f0874fc4640 1 -- 172.21.15.8:0/1333740161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087004e9b0 con 0x7f087006b5d0 2023-10-14T10:34:01.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.797+0000 7f086cff9640 1 -- 172.21.15.8:0/1333740161 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0860004b40 con 0x7f087006b5d0 2023-10-14T10:34:01.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.797+0000 7f086cff9640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f085006ae70 0x7f085006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:01.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.798+0000 7f086cff9640 1 -- 172.21.15.8:0/1333740161 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08600886a0 con 0x7f087006b5d0 2023-10-14T10:34:01.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.798+0000 7f0867fff640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f085006ae70 0x7f085006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:01.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.799+0000 7f0867fff640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f085006ae70 0x7f085006d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0858036000 tx=0x7f085803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:01.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.802+0000 7f086cff9640 1 -- 172.21.15.8:0/1333740161 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08600537f0 con 0x7f087006b5d0 2023-10-14T10:34:01.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.995+0000 7f0874fc4640 1 -- 172.21.15.8:0/1333740161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08700c5e20 con 0x7f087006b5d0 2023-10-14T10:34:01.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:01.997+0000 7f086cff9640 1 -- 172.21.15.8:0/1333740161 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7f0860056e10 con 0x7f087006b5d0 2023-10-14T10:34:02.000 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:02.000 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:02.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.000+0000 7f0874fc4640 1 -- 172.21.15.8:0/1333740161 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f085006ae70 msgr2=0x7f085006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:02.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.000+0000 7f0874fc4640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f085006ae70 0x7f085006d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0858036000 tx=0x7f085803c040 comp rx=0 tx=0).stop 2023-10-14T10:34:02.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.000+0000 7f0874fc4640 1 -- 172.21.15.8:0/1333740161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f087006b5d0 msgr2=0x7f087014b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:02.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.000+0000 7f0874fc4640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f087006b5d0 0x7f087014b760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f086000c4d0 tx=0x7f086000c990 comp rx=0 tx=0).stop 2023-10-14T10:34:02.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.000+0000 7f0874fc4640 1 -- 172.21.15.8:0/1333740161 shutdown_connections 2023-10-14T10:34:02.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.000+0000 7f0874fc4640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f085006ae70 0x7f085006d330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.000+0000 7f0874fc4640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0870154840 0x7f08701ec8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.000+0000 7f0874fc4640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08701514c0 0x7f0870145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.000+0000 7f0874fc4640 1 --2- 172.21.15.8:0/1333740161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f087006b5d0 0x7f087014b760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.000+0000 7f0874fc4640 1 -- 172.21.15.8:0/1333740161 >> 172.21.15.8:0/1333740161 conn(0x7f08700c60b0 msgr2=0x7f087006a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.000+0000 7f0874fc4640 1 -- 172.21.15.8:0/1333740161 shutdown_connections 2023-10-14T10:34:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.000+0000 7f0874fc4640 1 -- 172.21.15.8:0/1333740161 wait complete. 2023-10-14T10:34:02.021 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T10:33:44.913451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T10:33:46.397320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:34:02.022 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:34:02.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.249+0000 7f55e8c00640 1 Processor -- start 2023-10-14T10:34:02.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.249+0000 7f55e8c00640 1 -- start start 2023-10-14T10:34:02.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.250+0000 7f55e8c00640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f55e41517a0 0x7f55e406ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.250+0000 7f55e8c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f55e406f1e0 0x7f55e406f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.250+0000 7f55e8c00640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e406fbb0 0x7f55e40c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.250+0000 7f55e8c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e4151b80 con 0x7f55e406f1e0 2023-10-14T10:34:02.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.250+0000 7f55e8c00640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e4070740 con 0x7f55e41517a0 2023-10-14T10:34:02.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.250+0000 7f55e8c00640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e4154be0 con 0x7f55e406fbb0 2023-10-14T10:34:02.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.250+0000 7f55e1d9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f55e406f1e0 0x7f55e406f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.251+0000 7f55e1d9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f55e406f1e0 0x7f55e406f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40836/0 (socket says 172.21.15.8:40836) 2023-10-14T10:34:02.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.251+0000 7f55e1d9b640 1 -- 172.21.15.8:0/3370412415 learned_addr learned my addr 172.21.15.8:0/3370412415 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:02.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.251+0000 7f55e2d9d640 1 --2- 172.21.15.8:0/3370412415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e406fbb0 0x7f55e40c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.251+0000 7f55e259c640 1 --2- 172.21.15.8:0/3370412415 >> v2:172.21.15.92:3300/0 conn(0x7f55e41517a0 0x7f55e406ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.251+0000 7f55e1d9b640 1 -- 172.21.15.8:0/3370412415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e406fbb0 msgr2=0x7f55e40c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:02.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.251+0000 7f55e1d9b640 1 --2- 172.21.15.8:0/3370412415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e406fbb0 0x7f55e40c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.251+0000 7f55e1d9b640 1 -- 172.21.15.8:0/3370412415 >> v2:172.21.15.92:3300/0 conn(0x7f55e41517a0 msgr2=0x7f55e406ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:02.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.251+0000 7f55e1d9b640 1 --2- 172.21.15.8:0/3370412415 >> v2:172.21.15.92:3300/0 conn(0x7f55e41517a0 0x7f55e406ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.251+0000 7f55e1d9b640 1 -- 172.21.15.8:0/3370412415 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e4154ec0 con 0x7f55e406f1e0 2023-10-14T10:34:02.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.251+0000 7f55e2d9d640 1 --2- 172.21.15.8:0/3370412415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e406fbb0 0x7f55e40c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.252+0000 7f55e1d9b640 1 --2- 172.21.15.8:0/3370412415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406f1e0 0x7f55e406f670 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f55e4071840 tx=0x7f55cc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37618266e7f773 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:02.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.252+0000 7f55e159a640 1 -- 172.21.15.8:0/3370412415 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc0317e0 con 0x7f55e406f1e0 2023-10-14T10:34:02.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.252+0000 7f55e159a640 1 -- 172.21.15.8:0/3370412415 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc031940 con 0x7f55e406f1e0 2023-10-14T10:34:02.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.252+0000 7f55e159a640 1 -- 172.21.15.8:0/3370412415 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc031cd0 con 0x7f55e406f1e0 2023-10-14T10:34:02.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.253+0000 7f55e8c00640 1 -- 172.21.15.8:0/3370412415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406f1e0 msgr2=0x7f55e406f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:02.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.253+0000 7f55e8c00640 1 --2- 172.21.15.8:0/3370412415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406f1e0 0x7f55e406f670 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f55e4071840 tx=0x7f55cc02b880 comp rx=0 tx=0).stop 2023-10-14T10:34:02.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.253+0000 7f55e8c00640 1 -- 172.21.15.8:0/3370412415 shutdown_connections 2023-10-14T10:34:02.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.253+0000 7f55e8c00640 1 --2- 172.21.15.8:0/3370412415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e406fbb0 0x7f55e40c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.253+0000 7f55e8c00640 1 --2- 172.21.15.8:0/3370412415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406f1e0 0x7f55e406f670 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.253+0000 7f55e8c00640 1 --2- 172.21.15.8:0/3370412415 >> v2:172.21.15.92:3300/0 conn(0x7f55e41517a0 0x7f55e406ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.253+0000 7f55e8c00640 1 -- 172.21.15.8:0/3370412415 >> 172.21.15.8:0/3370412415 conn(0x7f55e40a9250 msgr2=0x7f55e40a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:02.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.253+0000 7f55e8c00640 1 -- 172.21.15.8:0/3370412415 shutdown_connections 2023-10-14T10:34:02.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.253+0000 7f55e8c00640 1 -- 172.21.15.8:0/3370412415 wait complete. 2023-10-14T10:34:02.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.255+0000 7f55e8c00640 1 Processor -- start 2023-10-14T10:34:02.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.255+0000 7f55e8c00640 1 -- start start 2023-10-14T10:34:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.256+0000 7f55e8c00640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e406f1e0 0x7f55e4157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.256+0000 7f55e8c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406fbb0 0x7f55e40bff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.256+0000 7f55e8c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55e41517a0 0x7f55e40bd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.256+0000 7f55e8c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40c0a70 con 0x7f55e406fbb0 2023-10-14T10:34:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.256+0000 7f55e8c00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e4156f70 con 0x7f55e41517a0 2023-10-14T10:34:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.256+0000 7f55e8c00640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e41e9b80 con 0x7f55e406f1e0 2023-10-14T10:34:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.256+0000 7f55e1d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406fbb0 0x7f55e40bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.256+0000 7f55e1d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406fbb0 0x7f55e40bff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40840/0 (socket says 172.21.15.8:40840) 2023-10-14T10:34:02.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.256+0000 7f55e1d9b640 1 -- 172.21.15.8:0/3600320515 learned_addr learned my addr 172.21.15.8:0/3600320515 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:02.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.256+0000 7f55e2d9d640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55e41517a0 0x7f55e40bd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.256+0000 7f55e259c640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e406f1e0 0x7f55e4157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.257+0000 7f55e1d9b640 1 -- 172.21.15.8:0/3600320515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e406f1e0 msgr2=0x7f55e4157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:02.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.257+0000 7f55e1d9b640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e406f1e0 0x7f55e4157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.257+0000 7f55e1d9b640 1 -- 172.21.15.8:0/3600320515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55e41517a0 msgr2=0x7f55e40bd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:02.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.257+0000 7f55e1d9b640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55e41517a0 0x7f55e40bd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.257+0000 7f55e1d9b640 1 -- 172.21.15.8:0/3600320515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc0094d0 con 0x7f55e406fbb0 2023-10-14T10:34:02.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.257+0000 7f55e259c640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e406f1e0 0x7f55e4157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:02.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.257+0000 7f55e1d9b640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406fbb0 0x7f55e40bff30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f55cc000c00 tx=0x7f55cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:02.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.257+0000 7f55daffd640 1 -- 172.21.15.8:0/3600320515 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc032880 con 0x7f55e406fbb0 2023-10-14T10:34:02.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.257+0000 7f55daffd640 1 -- 172.21.15.8:0/3600320515 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc032a20 con 0x7f55e406fbb0 2023-10-14T10:34:02.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.257+0000 7f55daffd640 1 -- 172.21.15.8:0/3600320515 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc032dd0 con 0x7f55e406fbb0 2023-10-14T10:34:02.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.257+0000 7f55e8c00640 1 -- 172.21.15.8:0/3600320515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e41ea0b0 con 0x7f55e406fbb0 2023-10-14T10:34:02.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.257+0000 7f55e8c00640 1 -- 172.21.15.8:0/3600320515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e4157ad0 con 0x7f55e406fbb0 2023-10-14T10:34:02.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.259+0000 7f55e8c00640 1 -- 172.21.15.8:0/3600320515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e4157c60 con 0x7f55e406fbb0 2023-10-14T10:34:02.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.260+0000 7f55daffd640 1 -- 172.21.15.8:0/3600320515 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f55cc04e450 con 0x7f55e406fbb0 2023-10-14T10:34:02.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.261+0000 7f55daffd640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f55c406ae70 0x7f55c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.261+0000 7f55daffd640 1 -- 172.21.15.8:0/3600320515 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55cc0ab7b0 con 0x7f55e406fbb0 2023-10-14T10:34:02.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.261+0000 7f55e259c640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f55c406ae70 0x7f55c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.262+0000 7f55e259c640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f55c406ae70 0x7f55c406d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009ed0 tx=0x7f55d400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:02.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.265+0000 7f55daffd640 1 -- 172.21.15.8:0/3600320515 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f55cc076910 con 0x7f55e406fbb0 2023-10-14T10:34:02.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.460+0000 7f55e8c00640 1 -- 172.21.15.8:0/3600320515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55e4073b50 con 0x7f55e406fbb0 2023-10-14T10:34:02.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.461+0000 7f55daffd640 1 -- 172.21.15.8:0/3600320515 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55cc079f30 con 0x7f55e406fbb0 2023-10-14T10:34:02.464 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:34:02.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.463+0000 7f55e8c00640 1 -- 172.21.15.8:0/3600320515 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f55c406ae70 msgr2=0x7f55c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:02.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.463+0000 7f55e8c00640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f55c406ae70 0x7f55c406d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009ed0 tx=0x7f55d400b040 comp rx=0 tx=0).stop 2023-10-14T10:34:02.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.463+0000 7f55e8c00640 1 -- 172.21.15.8:0/3600320515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406fbb0 msgr2=0x7f55e40bff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:02.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.463+0000 7f55e8c00640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406fbb0 0x7f55e40bff30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f55cc000c00 tx=0x7f55cc0046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.464+0000 7f55e8c00640 1 -- 172.21.15.8:0/3600320515 shutdown_connections 2023-10-14T10:34:02.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.464+0000 7f55e8c00640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f55c406ae70 0x7f55c406d330 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.464+0000 7f55e8c00640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55e41517a0 0x7f55e40bd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.464+0000 7f55e8c00640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406fbb0 0x7f55e40bff30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.464+0000 7f55e8c00640 1 --2- 172.21.15.8:0/3600320515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e406f1e0 0x7f55e4157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.464+0000 7f55e8c00640 1 -- 172.21.15.8:0/3600320515 >> 172.21.15.8:0/3600320515 conn(0x7f55e40a9250 msgr2=0x7f55e40a7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:02.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.464+0000 7f55e8c00640 1 -- 172.21.15.8:0/3600320515 shutdown_connections 2023-10-14T10:34:02.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.464+0000 7f55e8c00640 1 -- 172.21.15.8:0/3600320515 wait complete. 2023-10-14T10:34:02.484 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T10:34:02.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.702+0000 7ff02295e640 1 Processor -- start 2023-10-14T10:34:02.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.702+0000 7ff02295e640 1 -- start start 2023-10-14T10:34:02.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.703+0000 7ff02295e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff01c14f3a0 0x7ff01c071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.703+0000 7ff02295e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff01c155440 0x7ff01c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.704+0000 7ff02295e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff01c06dbd0 0x7ff01c152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.704+0000 7ff02295e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c06cee0 con 0x7ff01c155440 2023-10-14T10:34:02.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.704+0000 7ff02295e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c151e50 con 0x7ff01c14f3a0 2023-10-14T10:34:02.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.704+0000 7ff02295e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0c57a0 con 0x7ff01c06dbd0 2023-10-14T10:34:02.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.704+0000 7ff01b7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff01c155440 0x7ff01c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.704+0000 7ff01b7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff01c155440 0x7ff01c06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40844/0 (socket says 172.21.15.8:40844) 2023-10-14T10:34:02.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.704+0000 7ff01b7fe640 1 -- 172.21.15.8:0/2732941278 learned_addr learned my addr 172.21.15.8:0/2732941278 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:02.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.704+0000 7ff020efb640 1 --2- 172.21.15.8:0/2732941278 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff01c06dbd0 0x7ff01c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.704+0000 7ff01bfff640 1 --2- 172.21.15.8:0/2732941278 >> v2:172.21.15.92:3300/0 conn(0x7ff01c14f3a0 0x7ff01c071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.705+0000 7ff01b7fe640 1 -- 172.21.15.8:0/2732941278 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff01c06dbd0 msgr2=0x7ff01c152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:02.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.705+0000 7ff01b7fe640 1 --2- 172.21.15.8:0/2732941278 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff01c06dbd0 0x7ff01c152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.705+0000 7ff01b7fe640 1 -- 172.21.15.8:0/2732941278 >> v2:172.21.15.92:3300/0 conn(0x7ff01c14f3a0 msgr2=0x7ff01c071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:02.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.705+0000 7ff01b7fe640 1 --2- 172.21.15.8:0/2732941278 >> v2:172.21.15.92:3300/0 conn(0x7ff01c14f3a0 0x7ff01c071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.705+0000 7ff01b7fe640 1 -- 172.21.15.8:0/2732941278 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c0c59f0 con 0x7ff01c155440 2023-10-14T10:34:02.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.706+0000 7ff01b7fe640 1 --2- 172.21.15.8:0/2732941278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff01c155440 0x7ff01c06d690 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0c1f40 tx=0x7ff01002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21d83067696a536 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:02.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.706+0000 7ff01affd640 1 -- 172.21.15.8:0/2732941278 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100317d0 con 0x7ff01c155440 2023-10-14T10:34:02.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.706+0000 7ff01affd640 1 -- 172.21.15.8:0/2732941278 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff010031930 con 0x7ff01c155440 2023-10-14T10:34:02.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.706+0000 7ff01affd640 1 -- 172.21.15.8:0/2732941278 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff010031cc0 con 0x7ff01c155440 2023-10-14T10:34:02.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.707+0000 7ff02295e640 1 -- 172.21.15.8:0/2732941278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff01c155440 msgr2=0x7ff01c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:02.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.707+0000 7ff02295e640 1 --2- 172.21.15.8:0/2732941278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff01c155440 0x7ff01c06d690 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0c1f40 tx=0x7ff01002b870 comp rx=0 tx=0).stop 2023-10-14T10:34:02.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.707+0000 7ff02295e640 1 -- 172.21.15.8:0/2732941278 shutdown_connections 2023-10-14T10:34:02.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.707+0000 7ff02295e640 1 --2- 172.21.15.8:0/2732941278 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff01c06dbd0 0x7ff01c152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.707+0000 7ff02295e640 1 --2- 172.21.15.8:0/2732941278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff01c155440 0x7ff01c06d690 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.707+0000 7ff02295e640 1 --2- 172.21.15.8:0/2732941278 >> v2:172.21.15.92:3300/0 conn(0x7ff01c14f3a0 0x7ff01c071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.707+0000 7ff02295e640 1 -- 172.21.15.8:0/2732941278 >> 172.21.15.8:0/2732941278 conn(0x7ff01c0a74d0 msgr2=0x7ff01c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:02.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.707+0000 7ff02295e640 1 -- 172.21.15.8:0/2732941278 shutdown_connections 2023-10-14T10:34:02.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.707+0000 7ff02295e640 1 -- 172.21.15.8:0/2732941278 wait complete. 2023-10-14T10:34:02.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.708+0000 7ff02295e640 1 Processor -- start 2023-10-14T10:34:02.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.709+0000 7ff02295e640 1 -- start start 2023-10-14T10:34:02.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.709+0000 7ff02295e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff01c06dbd0 0x7ff01c1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.709+0000 7ff02295e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff01c14f3a0 0x7ff01c1470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff02295e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff01c155440 0x7ff01c147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff02295e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c154850 con 0x7ff01c14f3a0 2023-10-14T10:34:02.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff02295e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c1543c0 con 0x7ff01c155440 2023-10-14T10:34:02.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff02295e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c14d2d0 con 0x7ff01c06dbd0 2023-10-14T10:34:02.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff01b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff01c14f3a0 0x7ff01c1470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff01b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff01c14f3a0 0x7ff01c1470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40860/0 (socket says 172.21.15.8:40860) 2023-10-14T10:34:02.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff01b7fe640 1 -- 172.21.15.8:0/1270531491 learned_addr learned my addr 172.21.15.8:0/1270531491 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:02.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff020efb640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff01c155440 0x7ff01c147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff01bfff640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff01c06dbd0 0x7ff01c1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff01b7fe640 1 -- 172.21.15.8:0/1270531491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff01c06dbd0 msgr2=0x7ff01c1536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:02.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff01b7fe640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff01c06dbd0 0x7ff01c1536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff01b7fe640 1 -- 172.21.15.8:0/1270531491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff01c155440 msgr2=0x7ff01c147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff01b7fe640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff01c155440 0x7ff01c147610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff01b7fe640 1 -- 172.21.15.8:0/1270531491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100094d0 con 0x7ff01c14f3a0 2023-10-14T10:34:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.710+0000 7ff020efb640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff01c155440 0x7ff01c147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.711+0000 7ff01b7fe640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff01c14f3a0 0x7ff01c1470d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff01002b8b0 tx=0x7ff0100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.711+0000 7ff018ff9640 1 -- 172.21.15.8:0/1270531491 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff010032870 con 0x7ff01c14f3a0 2023-10-14T10:34:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.711+0000 7ff018ff9640 1 -- 172.21.15.8:0/1270531491 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff010032a10 con 0x7ff01c14f3a0 2023-10-14T10:34:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.711+0000 7ff02295e640 1 -- 172.21.15.8:0/1270531491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c154090 con 0x7ff01c14f3a0 2023-10-14T10:34:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.711+0000 7ff018ff9640 1 -- 172.21.15.8:0/1270531491 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff010032dc0 con 0x7ff01c14f3a0 2023-10-14T10:34:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.711+0000 7ff02295e640 1 -- 172.21.15.8:0/1270531491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c14cff0 con 0x7ff01c14f3a0 2023-10-14T10:34:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.713+0000 7ff02295e640 1 -- 172.21.15.8:0/1270531491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c153cc0 con 0x7ff01c14f3a0 2023-10-14T10:34:02.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.713+0000 7ff018ff9640 1 -- 172.21.15.8:0/1270531491 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff010030070 con 0x7ff01c14f3a0 2023-10-14T10:34:02.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.714+0000 7ff018ff9640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff00806ae70 0x7ff00806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:02.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.714+0000 7ff018ff9640 1 -- 172.21.15.8:0/1270531491 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0100ab430 con 0x7ff01c14f3a0 2023-10-14T10:34:02.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.714+0000 7ff01bfff640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff00806ae70 0x7ff00806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:02.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.715+0000 7ff01bfff640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff00806ae70 0x7ff00806d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff00c006fd0 tx=0x7ff00c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:02.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.719+0000 7ff018ff9640 1 -- 172.21.15.8:0/1270531491 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff01c153cc0 con 0x7ff01c14f3a0 2023-10-14T10:34:02.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.911+0000 7ff02295e640 1 -- 172.21.15.8:0/1270531491 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff01c153cc0 con 0x7ff01c14f3a0 2023-10-14T10:34:02.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.912+0000 7ff018ff9640 1 -- 172.21.15.8:0/1270531491 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff01c153cc0 con 0x7ff01c14f3a0 2023-10-14T10:34:02.915 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T10:34:02.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.915+0000 7ff02295e640 1 -- 172.21.15.8:0/1270531491 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff00806ae70 msgr2=0x7ff00806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:02.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.915+0000 7ff02295e640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff00806ae70 0x7ff00806d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff00c006fd0 tx=0x7ff00c008040 comp rx=0 tx=0).stop 2023-10-14T10:34:02.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.915+0000 7ff02295e640 1 -- 172.21.15.8:0/1270531491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff01c14f3a0 msgr2=0x7ff01c1470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:02.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.915+0000 7ff02295e640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff01c14f3a0 0x7ff01c1470d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff01002b8b0 tx=0x7ff0100046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.915+0000 7ff02295e640 1 -- 172.21.15.8:0/1270531491 shutdown_connections 2023-10-14T10:34:02.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.915+0000 7ff02295e640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff00806ae70 0x7ff00806d330 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.915+0000 7ff02295e640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff01c155440 0x7ff01c147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.915+0000 7ff02295e640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff01c14f3a0 0x7ff01c1470d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.915+0000 7ff02295e640 1 --2- 172.21.15.8:0/1270531491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff01c06dbd0 0x7ff01c1536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:02.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.915+0000 7ff02295e640 1 -- 172.21.15.8:0/1270531491 >> 172.21.15.8:0/1270531491 conn(0x7ff01c0a74d0 msgr2=0x7ff01c0c1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:02.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.916+0000 7ff02295e640 1 -- 172.21.15.8:0/1270531491 shutdown_connections 2023-10-14T10:34:02.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:02.916+0000 7ff02295e640 1 -- 172.21.15.8:0/1270531491 wait complete. 2023-10-14T10:34:02.937 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T10:34:03.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.162+0000 7fbecc81a640 1 Processor -- start 2023-10-14T10:34:03.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.162+0000 7fbecc81a640 1 -- start start 2023-10-14T10:34:03.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.163+0000 7fbecc81a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbec8151640 0x7fbec806b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.163+0000 7fbecc81a640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec8158330 con 0x7fbec806ae00 2023-10-14T10:34:03.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.163+0000 7fbecc81a640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec80c5e30 con 0x7fbec80c4450 2023-10-14T10:34:03.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.163+0000 7fbecc81a640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec80c4a40 con 0x7fbec8151640 2023-10-14T10:34:03.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.164+0000 7fbec7fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbec806ae00 0x7fbec8157420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46828/0 (socket says 172.21.15.8:46828) 2023-10-14T10:34:03.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.164+0000 7fbec7fff640 1 -- 172.21.15.8:0/1409774388 learned_addr learned my addr 172.21.15.8:0/1409774388 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:03.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.164+0000 7fbec77fe640 1 --2- 172.21.15.8:0/1409774388 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbec8151640 0x7fbec806b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.164+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965396770 0 0) 0x7fbec8158330 con 0x7fbec806ae00 2023-10-14T10:34:03.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.164+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb4003520 con 0x7fbec806ae00 2023-10-14T10:34:03.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189886664 0 0) 0x7fbec80c5e30 con 0x7fbec80c4450 2023-10-14T10:34:03.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec8158330 con 0x7fbec80c4450 2023-10-14T10:34:03.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2417580199 0 0) 0x7fbeb4003520 con 0x7fbec806ae00 2023-10-14T10:34:03.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbec8151640 msgr2=0x7fbec806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:03.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 --2- 172.21.15.8:0/1409774388 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbec8151640 0x7fbec806b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 >> v1:172.21.15.92:6789/0 conn(0x7fbec80c4450 legacy=0x7fbec80c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec80c4d20 con 0x7fbec806ae00 2023-10-14T10:34:03.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fbec0001670 con 0x7fbec806ae00 2023-10-14T10:34:03.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 >> v1:172.21.15.8:6789/0 conn(0x7fbec806ae00 legacy=0x7fbec8157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 --2- 172.21.15.8:0/1409774388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb4003b30 0x7fbeb4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 --2- 172.21.15.8:0/1409774388 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbec8151640 0x7fbeb40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 --2- 172.21.15.8:0/1409774388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb4004d00 0x7fbeb4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec80c4a40 con 0x7fbeb4004d00 2023-10-14T10:34:03.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb400bb90 con 0x7fbeb4003b30 2023-10-14T10:34:03.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb400bd50 con 0x7fbec8151640 2023-10-14T10:34:03.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.165+0000 7fbec7fff640 1 --2- 172.21.15.8:0/1409774388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb4004d00 0x7fbeb4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.166+0000 7fbec6ffd640 1 --2- 172.21.15.8:0/1409774388 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbec8151640 0x7fbeb40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.166+0000 7fbec77fe640 1 --2- 172.21.15.8:0/1409774388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb4003b30 0x7fbeb4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.166+0000 7fbec7fff640 1 -- 172.21.15.8:0/1409774388 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbec8151640 msgr2=0x7fbeb40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:03.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.166+0000 7fbec7fff640 1 --2- 172.21.15.8:0/1409774388 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbec8151640 0x7fbeb40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.166+0000 7fbec7fff640 1 -- 172.21.15.8:0/1409774388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb4003b30 msgr2=0x7fbeb4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:03.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.166+0000 7fbec7fff640 1 --2- 172.21.15.8:0/1409774388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb4003b30 0x7fbeb4003f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.166+0000 7fbec7fff640 1 -- 172.21.15.8:0/1409774388 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb4003520 con 0x7fbeb4004d00 2023-10-14T10:34:03.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.167+0000 7fbec7fff640 1 --2- 172.21.15.8:0/1409774388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb4004d00 0x7fbeb4005180 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbec0007fa0 tx=0x7fbeb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc7e4cc51df33f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:03.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.167+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0005ad0 con 0x7fbeb4004d00 2023-10-14T10:34:03.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.167+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec0005c50 con 0x7fbeb4004d00 2023-10-14T10:34:03.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.167+0000 7fbec67fc640 1 -- 172.21.15.8:0/1409774388 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0007070 con 0x7fbeb4004d00 2023-10-14T10:34:03.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.167+0000 7fbecc81a640 1 -- 172.21.15.8:0/1409774388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb4004d00 msgr2=0x7fbeb4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.168+0000 7fbecc81a640 1 --2- 172.21.15.8:0/1409774388 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb4004d00 0x7fbeb4005180 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbec0007fa0 tx=0x7fbeb40057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.168+0000 7fbec7fff640 1 -- 172.21.15.8:0/1409774388 reap_dead start 2023-10-14T10:34:03.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.168+0000 7fbecc81a640 1 -- 172.21.15.8:0/1409774388 shutdown_connections 2023-10-14T10:34:03.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.168+0000 7fbecc81a640 1 -- 172.21.15.8:0/1409774388 >> 172.21.15.8:0/1409774388 conn(0x7fbec80c96b0 msgr2=0x7fbec80c9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:03.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.168+0000 7fbecc81a640 1 -- 172.21.15.8:0/1409774388 shutdown_connections 2023-10-14T10:34:03.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.168+0000 7fbecc81a640 1 -- 172.21.15.8:0/1409774388 wait complete. 2023-10-14T10:34:03.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.169+0000 7fbecc81a640 1 Processor -- start 2023-10-14T10:34:03.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.170+0000 7fbecc81a640 1 -- start start 2023-10-14T10:34:03.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.170+0000 7fbecc81a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb4004d00 0x7fbec8156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.170+0000 7fbecc81a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbec8154b60 0x7fbec81526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.170+0000 7fbecc81a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbec8156ad0 0x7fbec8152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.170+0000 7fbecc81a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8154710 con 0x7fbeb4004d00 2023-10-14T10:34:03.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.171+0000 7fbecc81a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec80c93b0 con 0x7fbec8154b60 2023-10-14T10:34:03.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.171+0000 7fbecc81a640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8152070 con 0x7fbec8156ad0 2023-10-14T10:34:03.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.171+0000 7fbec77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb4004d00 0x7fbec8156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.171+0000 7fbec77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb4004d00 0x7fbec8156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40884/0 (socket says 172.21.15.8:40884) 2023-10-14T10:34:03.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.171+0000 7fbec77fe640 1 -- 172.21.15.8:0/2862522595 learned_addr learned my addr 172.21.15.8:0/2862522595 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:03.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.171+0000 7fbec77fe640 1 -- 172.21.15.8:0/2862522595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbec8156ad0 msgr2=0x7fbec8152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.171+0000 7fbec77fe640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbec8156ad0 0x7fbec8152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.171+0000 7fbec6ffd640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbec8154b60 0x7fbec81526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.171+0000 7fbec77fe640 1 -- 172.21.15.8:0/2862522595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbec8154b60 msgr2=0x7fbec81526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.171+0000 7fbec77fe640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbec8154b60 0x7fbec81526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.171+0000 7fbec77fe640 1 -- 172.21.15.8:0/2862522595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec80c3080 con 0x7fbeb4004d00 2023-10-14T10:34:03.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.172+0000 7fbec77fe640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb4004d00 0x7fbec8156590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80107e0 tx=0x7fbeb8010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:03.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.172+0000 7fbebffff640 1 -- 172.21.15.8:0/2862522595 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8009610 con 0x7fbeb4004d00 2023-10-14T10:34:03.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.172+0000 7fbebffff640 1 -- 172.21.15.8:0/2862522595 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb800eb60 con 0x7fbeb4004d00 2023-10-14T10:34:03.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.172+0000 7fbebffff640 1 -- 172.21.15.8:0/2862522595 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb801c400 con 0x7fbeb4004d00 2023-10-14T10:34:03.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.172+0000 7fbecc81a640 1 -- 172.21.15.8:0/2862522595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec80c3360 con 0x7fbeb4004d00 2023-10-14T10:34:03.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.172+0000 7fbecc81a640 1 -- 172.21.15.8:0/2862522595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec80c0250 con 0x7fbeb4004d00 2023-10-14T10:34:03.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.173+0000 7fbecc81a640 1 -- 172.21.15.8:0/2862522595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec80619f0 con 0x7fbeb4004d00 2023-10-14T10:34:03.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.174+0000 7fbebffff640 1 -- 172.21.15.8:0/2862522595 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbeb801c560 con 0x7fbeb4004d00 2023-10-14T10:34:03.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.175+0000 7fbebffff640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fbea806aea0 0x7fbea806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.175+0000 7fbebffff640 1 -- 172.21.15.8:0/2862522595 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbeb8089b50 con 0x7fbeb4004d00 2023-10-14T10:34:03.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.175+0000 7fbec6ffd640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fbea806aea0 0x7fbea806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.176+0000 7fbec6ffd640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fbea806aea0 0x7fbea806d360 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0001460 tx=0x7fbeb0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:03.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.180+0000 7fbebffff640 1 -- 172.21.15.8:0/2862522595 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbeb8054c10 con 0x7fbeb4004d00 2023-10-14T10:34:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.374+0000 7fbecc81a640 1 -- 172.21.15.8:0/2862522595 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbec80c41a0 con 0x7fbeb4004d00 2023-10-14T10:34:03.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.375+0000 7fbebffff640 1 -- 172.21.15.8:0/2862522595 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbeb8058230 con 0x7fbeb4004d00 2023-10-14T10:34:03.377 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T10:34:03.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.378+0000 7fbecc81a640 1 -- 172.21.15.8:0/2862522595 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fbea806aea0 msgr2=0x7fbea806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.378+0000 7fbecc81a640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fbea806aea0 0x7fbea806d360 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0001460 tx=0x7fbeb0009040 comp rx=0 tx=0).stop 2023-10-14T10:34:03.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.378+0000 7fbecc81a640 1 -- 172.21.15.8:0/2862522595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb4004d00 msgr2=0x7fbec8156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.378+0000 7fbecc81a640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb4004d00 0x7fbec8156590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80107e0 tx=0x7fbeb8010ca0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.378+0000 7fbecc81a640 1 -- 172.21.15.8:0/2862522595 shutdown_connections 2023-10-14T10:34:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.378+0000 7fbecc81a640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fbea806aea0 0x7fbea806d360 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.378+0000 7fbecc81a640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbec8156ad0 0x7fbec8152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.378+0000 7fbecc81a640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbec8154b60 0x7fbec81526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.378+0000 7fbecc81a640 1 --2- 172.21.15.8:0/2862522595 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb4004d00 0x7fbec8156590 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.378+0000 7fbecc81a640 1 -- 172.21.15.8:0/2862522595 >> 172.21.15.8:0/2862522595 conn(0x7fbec80c96b0 msgr2=0x7fbec80a90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:03.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.378+0000 7fbecc81a640 1 -- 172.21.15.8:0/2862522595 shutdown_connections 2023-10-14T10:34:03.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.378+0000 7fbecc81a640 1 -- 172.21.15.8:0/2862522595 wait complete. 2023-10-14T10:34:03.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:34:03.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.619+0000 7f86d92d7640 1 Processor -- start 2023-10-14T10:34:03.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.619+0000 7f86d92d7640 1 -- start start 2023-10-14T10:34:03.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.621+0000 7f86d92d7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f86d4151470 0x7f86d4070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.621+0000 7f86d92d7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d4071650 con 0x7f86d40a9610 2023-10-14T10:34:03.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.621+0000 7f86d92d7640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d41518e0 con 0x7f86d414abb0 2023-10-14T10:34:03.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.621+0000 7f86d92d7640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d4070740 con 0x7f86d4151470 2023-10-14T10:34:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.621+0000 7f86cb7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f86d40a9610 0x7f86d406faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46842/0 (socket says 172.21.15.8:46842) 2023-10-14T10:34:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.621+0000 7f86cb7fe640 1 -- 172.21.15.8:0/3632970423 learned_addr learned my addr 172.21.15.8:0/3632970423 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.621+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806207503 0 0) 0x7f86d4071650 con 0x7f86d40a9610 2023-10-14T10:34:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c0005730 con 0x7f86d40a9610 2023-10-14T10:34:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d8ad6640 1 --2- 172.21.15.8:0/3632970423 >> v2:172.21.15.92:3300/0 conn(0x7f86d4151470 0x7f86d4070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2754830935 0 0) 0x7f86c0005730 con 0x7f86d40a9610 2023-10-14T10:34:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 >> v2:172.21.15.92:3300/0 conn(0x7f86d4151470 msgr2=0x7f86d4070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:03.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 --2- 172.21.15.8:0/3632970423 >> v2:172.21.15.92:3300/0 conn(0x7f86d4151470 0x7f86d4070200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 >> v1:172.21.15.92:6789/0 conn(0x7f86d414abb0 legacy=0x7f86d40c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d40aa6f0 con 0x7f86d40a9610 2023-10-14T10:34:03.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f86bc001670 con 0x7f86d40a9610 2023-10-14T10:34:03.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 >> v1:172.21.15.8:6789/0 conn(0x7f86d40a9610 legacy=0x7f86d406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 --2- 172.21.15.8:0/3632970423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86c0005bd0 0x7f86c0005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 --2- 172.21.15.8:0/3632970423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86c00069d0 0x7f86c0006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 --2- 172.21.15.8:0/3632970423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86c00073e0 0x7f86c000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c000e300 con 0x7f86c00069d0 2023-10-14T10:34:03.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c000e470 con 0x7f86c0005bd0 2023-10-14T10:34:03.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.622+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c000e630 con 0x7f86c00073e0 2023-10-14T10:34:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.623+0000 7f86cb7fe640 1 --2- 172.21.15.8:0/3632970423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86c00069d0 0x7f86c0006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.623+0000 7f86d3fff640 1 --2- 172.21.15.8:0/3632970423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86c0005bd0 0x7f86c0005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.623+0000 7f86d8ad6640 1 --2- 172.21.15.8:0/3632970423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86c00073e0 0x7f86c000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.623+0000 7f86cb7fe640 1 -- 172.21.15.8:0/3632970423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86c00073e0 msgr2=0x7f86c000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.623+0000 7f86cb7fe640 1 --2- 172.21.15.8:0/3632970423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86c00073e0 0x7f86c000db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.623+0000 7f86cb7fe640 1 -- 172.21.15.8:0/3632970423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86c0005bd0 msgr2=0x7f86c0005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.623+0000 7f86cb7fe640 1 --2- 172.21.15.8:0/3632970423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86c0005bd0 0x7f86c0005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.623+0000 7f86cb7fe640 1 -- 172.21.15.8:0/3632970423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c0005730 con 0x7f86c00069d0 2023-10-14T10:34:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.623+0000 7f86d8ad6640 1 -- 172.21.15.8:0/3632970423 reap_dead start 2023-10-14T10:34:03.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.624+0000 7f86cb7fe640 1 --2- 172.21.15.8:0/3632970423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86c00069d0 0x7f86c0006e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c0e0 tx=0x7f86c0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ba810303ef1ff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:03.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.624+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc005ad0 con 0x7f86c00069d0 2023-10-14T10:34:03.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.624+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc005c30 con 0x7f86c00069d0 2023-10-14T10:34:03.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.624+0000 7f86d37fe640 1 -- 172.21.15.8:0/3632970423 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc02c7c0 con 0x7f86c00069d0 2023-10-14T10:34:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.625+0000 7f86d92d7640 1 -- 172.21.15.8:0/3632970423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86c00069d0 msgr2=0x7f86c0006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.625+0000 7f86d92d7640 1 --2- 172.21.15.8:0/3632970423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86c00069d0 0x7f86c0006e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c0e0 tx=0x7f86c0007a00 comp rx=0 tx=0).stop 2023-10-14T10:34:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.625+0000 7f86d92d7640 1 -- 172.21.15.8:0/3632970423 shutdown_connections 2023-10-14T10:34:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.625+0000 7f86d92d7640 1 --2- 172.21.15.8:0/3632970423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86c00069d0 0x7f86c0006e50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.625+0000 7f86d92d7640 1 -- 172.21.15.8:0/3632970423 >> 172.21.15.8:0/3632970423 conn(0x7f86d406a200 msgr2=0x7f86d406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:03.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.625+0000 7f86d92d7640 1 -- 172.21.15.8:0/3632970423 shutdown_connections 2023-10-14T10:34:03.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.625+0000 7f86d92d7640 1 -- 172.21.15.8:0/3632970423 wait complete. 2023-10-14T10:34:03.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.627+0000 7f86d92d7640 1 Processor -- start 2023-10-14T10:34:03.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.627+0000 7f86d92d7640 1 -- start start 2023-10-14T10:34:03.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.628+0000 7f86d92d7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86c00069d0 0x7f86d41491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.628+0000 7f86d92d7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86d4148640 0x7f86d41e80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.628+0000 7f86d92d7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86d414ca60 0x7f86d41e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.628+0000 7f86d92d7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d41e5540 con 0x7f86d4148640 2023-10-14T10:34:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.628+0000 7f86d92d7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d41e59d0 con 0x7f86c00069d0 2023-10-14T10:34:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.628+0000 7f86d92d7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40bf050 con 0x7f86d414ca60 2023-10-14T10:34:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.628+0000 7f86cb7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86d4148640 0x7f86d41e80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.628+0000 7f86cb7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86d4148640 0x7f86d41e80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40914/0 (socket says 172.21.15.8:40914) 2023-10-14T10:34:03.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.628+0000 7f86cb7fe640 1 -- 172.21.15.8:0/1208915348 learned_addr learned my addr 172.21.15.8:0/1208915348 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:03.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.629+0000 7f86d8ad6640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86d414ca60 0x7f86d41e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.629+0000 7f86d3fff640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86c00069d0 0x7f86d41491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.629+0000 7f86cb7fe640 1 -- 172.21.15.8:0/1208915348 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86d414ca60 msgr2=0x7f86d41e8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.629+0000 7f86cb7fe640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86d414ca60 0x7f86d41e8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.629+0000 7f86cb7fe640 1 -- 172.21.15.8:0/1208915348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86c00069d0 msgr2=0x7f86d41491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.629+0000 7f86cb7fe640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86c00069d0 0x7f86d41491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.629+0000 7f86cb7fe640 1 -- 172.21.15.8:0/1208915348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d40bed70 con 0x7f86d4148640 2023-10-14T10:34:03.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.629+0000 7f86cb7fe640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86d4148640 0x7f86d41e80d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f86bc000c00 tx=0x7f86bc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:03.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.629+0000 7f86d17fa640 1 -- 172.21.15.8:0/1208915348 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc03c040 con 0x7f86d4148640 2023-10-14T10:34:03.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.629+0000 7f86d17fa640 1 -- 172.21.15.8:0/1208915348 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc02ccb0 con 0x7f86d4148640 2023-10-14T10:34:03.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.629+0000 7f86d17fa640 1 -- 172.21.15.8:0/1208915348 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0072b0 con 0x7f86d4148640 2023-10-14T10:34:03.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.629+0000 7f86d92d7640 1 -- 172.21.15.8:0/1208915348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d41e4c10 con 0x7f86d4148640 2023-10-14T10:34:03.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.630+0000 7f86d92d7640 1 -- 172.21.15.8:0/1208915348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d41e51d0 con 0x7f86d4148640 2023-10-14T10:34:03.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.631+0000 7f86d92d7640 1 -- 172.21.15.8:0/1208915348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d41e56b0 con 0x7f86d4148640 2023-10-14T10:34:03.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.632+0000 7f86d17fa640 1 -- 172.21.15.8:0/1208915348 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f86bc032070 con 0x7f86d4148640 2023-10-14T10:34:03.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.633+0000 7f86d17fa640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f86b406ae70 0x7f86b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:03.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.633+0000 7f86d17fa640 1 -- 172.21.15.8:0/1208915348 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86bc0aa9a0 con 0x7f86d4148640 2023-10-14T10:34:03.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.633+0000 7f86d3fff640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f86b406ae70 0x7f86b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:03.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.633+0000 7f86d3fff640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f86b406ae70 0x7f86b406d330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86c4007fd0 tx=0x7f86c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:03.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.637+0000 7f86d17fa640 1 -- 172.21.15.8:0/1208915348 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86bc075a50 con 0x7f86d4148640 2023-10-14T10:34:03.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.867+0000 7f86d92d7640 1 -- 172.21.15.8:0/1208915348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86d404e9b0 con 0x7f86d4148640 2023-10-14T10:34:03.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.867+0000 7f86d17fa640 1 -- 172.21.15.8:0/1208915348 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4898 (secure 0 0 0) 0x7f86bc079070 con 0x7f86d4148640 2023-10-14T10:34:03.870 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:03.870 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3003490368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3003490368},{"type":"v1","addr":"172.21.15.92:6834","nonce":3003490368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3352501671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":3352501671},{"type":"v1","addr":"172.21.15.92:6835","nonce":3352501671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4157669185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4157669185},{"type":"v1","addr":"172.21.15.8:6837","nonce":4157669185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:33:47.398252+0000","modified":"2023-10-14T10:33:50.442698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6835/524862170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":524862170},{"type":"v1","addr":"172.21.15.8:6835","nonce":524862170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T10:34:03.871 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T10:34:03.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.870+0000 7f86d92d7640 1 -- 172.21.15.8:0/1208915348 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f86b406ae70 msgr2=0x7f86b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.870+0000 7f86d92d7640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f86b406ae70 0x7f86b406d330 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86c4007fd0 tx=0x7f86c4009040 comp rx=0 tx=0).stop 2023-10-14T10:34:03.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.870+0000 7f86d92d7640 1 -- 172.21.15.8:0/1208915348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86d4148640 msgr2=0x7f86d41e80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:03.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.870+0000 7f86d92d7640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86d4148640 0x7f86d41e80d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f86bc000c00 tx=0x7f86bc02e070 comp rx=0 tx=0).stop 2023-10-14T10:34:03.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.870+0000 7f86d92d7640 1 -- 172.21.15.8:0/1208915348 shutdown_connections 2023-10-14T10:34:03.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.870+0000 7f86d92d7640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f86b406ae70 0x7f86b406d330 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.870+0000 7f86d92d7640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86d414ca60 0x7f86d41e8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.870+0000 7f86d92d7640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86d4148640 0x7f86d41e80d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.870+0000 7f86d92d7640 1 --2- 172.21.15.8:0/1208915348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86c00069d0 0x7f86d41491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:03.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.870+0000 7f86d92d7640 1 -- 172.21.15.8:0/1208915348 >> 172.21.15.8:0/1208915348 conn(0x7f86d406a200 msgr2=0x7f86d406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.871+0000 7f86d92d7640 1 -- 172.21.15.8:0/1208915348 shutdown_connections 2023-10-14T10:34:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:03.871+0000 7f86d92d7640 1 -- 172.21.15.8:0/1208915348 wait complete. 2023-10-14T10:34:03.890 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:04.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.105+0000 7fcfc1d7c640 1 Processor -- start 2023-10-14T10:34:04.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.105+0000 7fcfc1d7c640 1 -- start start 2023-10-14T10:34:04.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.107+0000 7fcfc1d7c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc13b260 0x7fcfbc0c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.107+0000 7fcfc1d7c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfbc151ea0 con 0x7fcfbc071ff0 2023-10-14T10:34:04.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.107+0000 7fcfc1d7c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfbc0c5d80 con 0x7fcfbc152960 2023-10-14T10:34:04.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.107+0000 7fcfc1d7c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc152540 con 0x7fcfbc13b260 2023-10-14T10:34:04.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfb3fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fcfbc071ff0 0x7fcfbc0c1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46844/0 (socket says 172.21.15.8:46844) 2023-10-14T10:34:04.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfb3fff640 1 -- 172.21.15.8:0/2862744029 learned_addr learned my addr 172.21.15.8:0/2862744029 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:04.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfbb7fe640 1 --2- 172.21.15.8:0/2862744029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc13b260 0x7fcfbc0c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679006862 0 0) 0x7fcfbc151ea0 con 0x7fcfbc071ff0 2023-10-14T10:34:04.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa8003520 con 0x7fcfbc071ff0 2023-10-14T10:34:04.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036817566 0 0) 0x7fcfbc0c5d80 con 0x7fcfbc152960 2023-10-14T10:34:04.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfbc151ea0 con 0x7fcfbc152960 2023-10-14T10:34:04.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1330480366 0 0) 0x7fcfa8003520 con 0x7fcfbc071ff0 2023-10-14T10:34:04.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc13b260 msgr2=0x7fcfbc0c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:04.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfbaffd640 1 --2- 172.21.15.8:0/2862744029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc13b260 0x7fcfbc0c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 >> v1:172.21.15.92:6789/0 conn(0x7fcfbc152960 legacy=0x7fcfbc06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:04.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc0c6060 con 0x7fcfbc071ff0 2023-10-14T10:34:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.108+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fcfa4001670 con 0x7fcfbc071ff0 2023-10-14T10:34:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 >> v1:172.21.15.8:6789/0 conn(0x7fcfbc071ff0 legacy=0x7fcfbc0c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbaffd640 1 --2- 172.21.15.8:0/2862744029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc13b260 0x7fcfa8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbaffd640 1 --2- 172.21.15.8:0/2862744029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa8004090 0x7fcfa80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbaffd640 1 --2- 172.21.15.8:0/2862744029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa8004d00 0x7fcfa8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc152540 con 0x7fcfa8004d00 2023-10-14T10:34:04.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa800ff20 con 0x7fcfa8004090 2023-10-14T10:34:04.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80100b0 con 0x7fcfbc13b260 2023-10-14T10:34:04.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbbfff640 1 --2- 172.21.15.8:0/2862744029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa8004d00 0x7fcfa8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfb3fff640 1 --2- 172.21.15.8:0/2862744029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa8004090 0x7fcfa80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbb7fe640 1 --2- 172.21.15.8:0/2862744029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc13b260 0x7fcfa8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbbfff640 1 -- 172.21.15.8:0/2862744029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc13b260 msgr2=0x7fcfa8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:04.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbbfff640 1 --2- 172.21.15.8:0/2862744029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc13b260 0x7fcfa8003b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbbfff640 1 -- 172.21.15.8:0/2862744029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa8004090 msgr2=0x7fcfa80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:04.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbbfff640 1 --2- 172.21.15.8:0/2862744029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa8004090 0x7fcfa80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.109+0000 7fcfbbfff640 1 -- 172.21.15.8:0/2862744029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8003520 con 0x7fcfa8004d00 2023-10-14T10:34:04.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.110+0000 7fcfbbfff640 1 --2- 172.21.15.8:0/2862744029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa8004d00 0x7fcfa8005180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4001fd0 tx=0x7fcfa80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9795b3f36f33bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:04.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.111+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4003b70 con 0x7fcfa8004d00 2023-10-14T10:34:04.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.111+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb4003cd0 con 0x7fcfa8004d00 2023-10-14T10:34:04.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.111+0000 7fcfbaffd640 1 -- 172.21.15.8:0/2862744029 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40052f0 con 0x7fcfa8004d00 2023-10-14T10:34:04.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.111+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/2862744029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa8004d00 msgr2=0x7fcfa8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:04.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.111+0000 7fcfc1d7c640 1 --2- 172.21.15.8:0/2862744029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfa8004d00 0x7fcfa8005180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4001fd0 tx=0x7fcfa80057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.111+0000 7fcfbbfff640 1 -- 172.21.15.8:0/2862744029 reap_dead start 2023-10-14T10:34:04.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.111+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/2862744029 shutdown_connections 2023-10-14T10:34:04.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.111+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/2862744029 >> 172.21.15.8:0/2862744029 conn(0x7fcfbc0a74d0 msgr2=0x7fcfbc0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:04.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.111+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/2862744029 shutdown_connections 2023-10-14T10:34:04.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.112+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/2862744029 wait complete. 2023-10-14T10:34:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.113+0000 7fcfc1d7c640 1 Processor -- start 2023-10-14T10:34:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.113+0000 7fcfc1d7c640 1 -- start start 2023-10-14T10:34:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.114+0000 7fcfc1d7c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa8004d00 0x7fcfbc14f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.114+0000 7fcfc1d7c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc14d810 0x7fcfbc137ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.114+0000 7fcfc1d7c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc138420 0x7fcfbc1e8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.114+0000 7fcfc1d7c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc1e4c00 con 0x7fcfbc14d810 2023-10-14T10:34:04.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.114+0000 7fcfc1d7c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc14fba0 con 0x7fcfa8004d00 2023-10-14T10:34:04.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.114+0000 7fcfc1d7c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc14f8e0 con 0x7fcfbc138420 2023-10-14T10:34:04.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.115+0000 7fcfb3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc14d810 0x7fcfbc137ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.115+0000 7fcfb3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc14d810 0x7fcfbc137ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40934/0 (socket says 172.21.15.8:40934) 2023-10-14T10:34:04.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.115+0000 7fcfb3fff640 1 -- 172.21.15.8:0/1752299495 learned_addr learned my addr 172.21.15.8:0/1752299495 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:04.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.115+0000 7fcfbb7fe640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa8004d00 0x7fcfbc14f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.115+0000 7fcfbbfff640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc138420 0x7fcfbc1e8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.115+0000 7fcfb3fff640 1 -- 172.21.15.8:0/1752299495 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc138420 msgr2=0x7fcfbc1e8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:04.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.115+0000 7fcfb3fff640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc138420 0x7fcfbc1e8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.115+0000 7fcfb3fff640 1 -- 172.21.15.8:0/1752299495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa8004d00 msgr2=0x7fcfbc14f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:04.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.115+0000 7fcfb3fff640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa8004d00 0x7fcfbc14f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.115+0000 7fcfb3fff640 1 -- 172.21.15.8:0/1752299495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc0bf540 con 0x7fcfbc14d810 2023-10-14T10:34:04.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.116+0000 7fcfb3fff640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc14d810 0x7fcfbc137ee0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400d770 tx=0x7fcfa400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:04.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.116+0000 7fcfb8ff9640 1 -- 172.21.15.8:0/1752299495 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40074e0 con 0x7fcfbc14d810 2023-10-14T10:34:04.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.116+0000 7fcfb8ff9640 1 -- 172.21.15.8:0/1752299495 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa4007640 con 0x7fcfbc14d810 2023-10-14T10:34:04.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.116+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/1752299495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc0beca0 con 0x7fcfbc14d810 2023-10-14T10:34:04.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.116+0000 7fcfb8ff9640 1 -- 172.21.15.8:0/1752299495 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4004a00 con 0x7fcfbc14d810 2023-10-14T10:34:04.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.116+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/1752299495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc0bf260 con 0x7fcfbc14d810 2023-10-14T10:34:04.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.117+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/1752299495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc138800 con 0x7fcfbc14d810 2023-10-14T10:34:04.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.118+0000 7fcfb8ff9640 1 -- 172.21.15.8:0/1752299495 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcfa4004b60 con 0x7fcfbc14d810 2023-10-14T10:34:04.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.119+0000 7fcfb8ff9640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fcf9c06ae70 0x7fcf9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.119+0000 7fcfb8ff9640 1 -- 172.21.15.8:0/1752299495 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfa4089270 con 0x7fcfbc14d810 2023-10-14T10:34:04.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.119+0000 7fcfbb7fe640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fcf9c06ae70 0x7fcf9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.120+0000 7fcfbb7fe640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fcf9c06ae70 0x7fcf9c06d330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009a10 tx=0x7fcfac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:04.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.124+0000 7fcfb8ff9640 1 -- 172.21.15.8:0/1752299495 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcfa4054310 con 0x7fcfbc14d810 2023-10-14T10:34:04.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.319+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/1752299495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfbc073b50 con 0x7fcfbc14d810 2023-10-14T10:34:04.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.320+0000 7fcfb8ff9640 1 -- 172.21.15.8:0/1752299495 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7fcfa405ce60 con 0x7fcfbc14d810 2023-10-14T10:34:04.323 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:04.323 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:04.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.323+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/1752299495 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fcf9c06ae70 msgr2=0x7fcf9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:04.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.323+0000 7fcfc1d7c640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fcf9c06ae70 0x7fcf9c06d330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009a10 tx=0x7fcfac008040 comp rx=0 tx=0).stop 2023-10-14T10:34:04.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.323+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/1752299495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc14d810 msgr2=0x7fcfbc137ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:04.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.323+0000 7fcfc1d7c640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc14d810 0x7fcfbc137ee0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400d770 tx=0x7fcfa400dc30 comp rx=0 tx=0).stop 2023-10-14T10:34:04.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.323+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/1752299495 shutdown_connections 2023-10-14T10:34:04.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.323+0000 7fcfc1d7c640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fcf9c06ae70 0x7fcf9c06d330 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.323+0000 7fcfc1d7c640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfbc138420 0x7fcfbc1e8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.323+0000 7fcfc1d7c640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc14d810 0x7fcfbc137ee0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.323+0000 7fcfc1d7c640 1 --2- 172.21.15.8:0/1752299495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa8004d00 0x7fcfbc14f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.323+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/1752299495 >> 172.21.15.8:0/1752299495 conn(0x7fcfbc0a74d0 msgr2=0x7fcfbc1508b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:04.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.323+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/1752299495 shutdown_connections 2023-10-14T10:34:04.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.323+0000 7fcfc1d7c640 1 -- 172.21.15.8:0/1752299495 wait complete. 2023-10-14T10:34:04.345 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:34:04.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.566+0000 7f00e55c9640 1 Processor -- start 2023-10-14T10:34:04.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.566+0000 7f00e55c9640 1 -- start start 2023-10-14T10:34:04.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.568+0000 7f00e55c9640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f00e014ac70 0x7f00e01547d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.568+0000 7f00e55c9640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f00e0154d10 0x7f00e00c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.568+0000 7f00e55c9640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f00e00c5ce0 0x7f00e00c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.568+0000 7f00e55c9640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e01540a0 con 0x7f00e0154d10 2023-10-14T10:34:04.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.568+0000 7f00e55c9640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e00c1050 con 0x7f00e00c5ce0 2023-10-14T10:34:04.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.568+0000 7f00e55c9640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00c0a90 con 0x7f00e014ac70 2023-10-14T10:34:04.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.568+0000 7f00de7fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f00e0154d10 0x7f00e00c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.568+0000 7f00de7fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f00e0154d10 0x7f00e00c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40944/0 (socket says 172.21.15.8:40944) 2023-10-14T10:34:04.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.568+0000 7f00de7fc640 1 -- 172.21.15.8:0/4370470 learned_addr learned my addr 172.21.15.8:0/4370470 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:04.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.568+0000 7f00deffd640 1 --2- 172.21.15.8:0/4370470 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f00e014ac70 0x7f00e01547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.569+0000 7f00de7fc640 1 -- 172.21.15.8:0/4370470 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f00e014ac70 msgr2=0x7f00e01547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:04.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.569+0000 7f00de7fc640 1 --2- 172.21.15.8:0/4370470 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f00e014ac70 0x7f00e01547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.569+0000 7f00de7fc640 1 -- 172.21.15.8:0/4370470 >> v2:172.21.15.92:3300/0 conn(0x7f00e00c5ce0 msgr2=0x7f00e00c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:04.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.569+0000 7f00df7fe640 1 --2- 172.21.15.8:0/4370470 >> v2:172.21.15.92:3300/0 conn(0x7f00e00c5ce0 0x7f00e00c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.569+0000 7f00de7fc640 1 --2- 172.21.15.8:0/4370470 >> v2:172.21.15.92:3300/0 conn(0x7f00e00c5ce0 0x7f00e00c1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.569+0000 7f00de7fc640 1 -- 172.21.15.8:0/4370470 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e00c0d70 con 0x7f00e0154d10 2023-10-14T10:34:04.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.569+0000 7f00df7fe640 1 --2- 172.21.15.8:0/4370470 >> v2:172.21.15.92:3300/0 conn(0x7f00e00c5ce0 0x7f00e00c1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:04.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.570+0000 7f00de7fc640 1 --2- 172.21.15.8:0/4370470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0154d10 0x7f00e00c57a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f00e006ba20 tx=0x7f00d402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4529b6ee56e87d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:04.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.570+0000 7f00ddffb640 1 -- 172.21.15.8:0/4370470 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40317e0 con 0x7f00e0154d10 2023-10-14T10:34:04.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.570+0000 7f00ddffb640 1 -- 172.21.15.8:0/4370470 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d4031940 con 0x7f00e0154d10 2023-10-14T10:34:04.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.570+0000 7f00ddffb640 1 -- 172.21.15.8:0/4370470 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4031cd0 con 0x7f00e0154d10 2023-10-14T10:34:04.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.571+0000 7f00e55c9640 1 -- 172.21.15.8:0/4370470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0154d10 msgr2=0x7f00e00c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:04.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.571+0000 7f00e55c9640 1 --2- 172.21.15.8:0/4370470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0154d10 0x7f00e00c57a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f00e006ba20 tx=0x7f00d402b880 comp rx=0 tx=0).stop 2023-10-14T10:34:04.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.571+0000 7f00e55c9640 1 -- 172.21.15.8:0/4370470 shutdown_connections 2023-10-14T10:34:04.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.571+0000 7f00e55c9640 1 --2- 172.21.15.8:0/4370470 >> v2:172.21.15.92:3300/0 conn(0x7f00e00c5ce0 0x7f00e00c1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.571+0000 7f00e55c9640 1 --2- 172.21.15.8:0/4370470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0154d10 0x7f00e00c57a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.571+0000 7f00e55c9640 1 --2- 172.21.15.8:0/4370470 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f00e014ac70 0x7f00e01547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.571+0000 7f00e55c9640 1 -- 172.21.15.8:0/4370470 >> 172.21.15.8:0/4370470 conn(0x7f00e00a74d0 msgr2=0x7f00e00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:04.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.571+0000 7f00e55c9640 1 -- 172.21.15.8:0/4370470 shutdown_connections 2023-10-14T10:34:04.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.571+0000 7f00e55c9640 1 -- 172.21.15.8:0/4370470 wait complete. 2023-10-14T10:34:04.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.573+0000 7f00e55c9640 1 Processor -- start 2023-10-14T10:34:04.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.573+0000 7f00e55c9640 1 -- start start 2023-10-14T10:34:04.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00e55c9640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f00e00c5ce0 0x7f00e01ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00e55c9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e014ac70 0x7f00e01575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00e55c9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0155490 0x7f00e00c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00e55c9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e0071310 con 0x7f00e0155490 2023-10-14T10:34:04.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00e55c9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e01ec900 con 0x7f00e014ac70 2023-10-14T10:34:04.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00e55c9640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e013f000 con 0x7f00e00c5ce0 2023-10-14T10:34:04.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00df7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0155490 0x7f00e00c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00df7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0155490 0x7f00e00c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40956/0 (socket says 172.21.15.8:40956) 2023-10-14T10:34:04.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00df7fe640 1 -- 172.21.15.8:0/1271408738 learned_addr learned my addr 172.21.15.8:0/1271408738 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:04.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00deffd640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f00e00c5ce0 0x7f00e01ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00de7fc640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e014ac70 0x7f00e01575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00df7fe640 1 -- 172.21.15.8:0/1271408738 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f00e00c5ce0 msgr2=0x7f00e01ed0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:04.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00df7fe640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f00e00c5ce0 0x7f00e01ed0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00df7fe640 1 -- 172.21.15.8:0/1271408738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e014ac70 msgr2=0x7f00e01575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:04.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.574+0000 7f00df7fe640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e014ac70 0x7f00e01575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.575+0000 7f00df7fe640 1 -- 172.21.15.8:0/1271408738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d40094d0 con 0x7f00e0155490 2023-10-14T10:34:04.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.575+0000 7f00deffd640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f00e00c5ce0 0x7f00e01ed0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:04.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.575+0000 7f00de7fc640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e014ac70 0x7f00e01575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:04.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.575+0000 7f00df7fe640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0155490 0x7f00e00c4950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00d800c7f0 tx=0x7f00d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:04.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.575+0000 7f00c77fe640 1 -- 172.21.15.8:0/1271408738 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8007820 con 0x7f00e0155490 2023-10-14T10:34:04.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.575+0000 7f00c77fe640 1 -- 172.21.15.8:0/1271408738 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d8007980 con 0x7f00e0155490 2023-10-14T10:34:04.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.575+0000 7f00e55c9640 1 -- 172.21.15.8:0/1271408738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e01e9f10 con 0x7f00e0155490 2023-10-14T10:34:04.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.575+0000 7f00c77fe640 1 -- 172.21.15.8:0/1271408738 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8007d30 con 0x7f00e0155490 2023-10-14T10:34:04.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.575+0000 7f00e55c9640 1 -- 172.21.15.8:0/1271408738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e01ea1f0 con 0x7f00e0155490 2023-10-14T10:34:04.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.577+0000 7f00e55c9640 1 -- 172.21.15.8:0/1271408738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e01ecde0 con 0x7f00e0155490 2023-10-14T10:34:04.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.578+0000 7f00c77fe640 1 -- 172.21.15.8:0/1271408738 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f00d80113f0 con 0x7f00e0155490 2023-10-14T10:34:04.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.579+0000 7f00c77fe640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f00cc06aea0 0x7f00cc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:04.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.579+0000 7f00c77fe640 1 -- 172.21.15.8:0/1271408738 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00d80896c0 con 0x7f00e0155490 2023-10-14T10:34:04.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.579+0000 7f00deffd640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f00cc06aea0 0x7f00cc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:04.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.580+0000 7f00deffd640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f00cc06aea0 0x7f00cc06d360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00d0007f50 tx=0x7f00d00074a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:04.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.583+0000 7f00c77fe640 1 -- 172.21.15.8:0/1271408738 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00e01ecde0 con 0x7f00e0155490 2023-10-14T10:34:04.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.814+0000 7f00e55c9640 1 -- 172.21.15.8:0/1271408738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00e01ecde0 con 0x7f00e0155490 2023-10-14T10:34:04.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.816+0000 7f00c77fe640 1 -- 172.21.15.8:0/1271408738 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4898 (secure 0 0 0) 0x7f00e01ecde0 con 0x7f00e0155490 2023-10-14T10:34:04.818 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:04.818 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3003490368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3003490368},{"type":"v1","addr":"172.21.15.92:6834","nonce":3003490368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3352501671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":3352501671},{"type":"v1","addr":"172.21.15.92:6835","nonce":3352501671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4157669185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4157669185},{"type":"v1","addr":"172.21.15.8:6837","nonce":4157669185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:33:47.398252+0000","modified":"2023-10-14T10:33:50.442698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6835/524862170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":524862170},{"type":"v1","addr":"172.21.15.8:6835","nonce":524862170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T10:34:04.819 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T10:34:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.818+0000 7f00e55c9640 1 -- 172.21.15.8:0/1271408738 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f00cc06aea0 msgr2=0x7f00cc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.818+0000 7f00e55c9640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f00cc06aea0 0x7f00cc06d360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00d0007f50 tx=0x7f00d00074a0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.818+0000 7f00e55c9640 1 -- 172.21.15.8:0/1271408738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0155490 msgr2=0x7f00e00c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.818+0000 7f00e55c9640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0155490 0x7f00e00c4950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00d800c7f0 tx=0x7f00d800ccb0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.818+0000 7f00e55c9640 1 -- 172.21.15.8:0/1271408738 shutdown_connections 2023-10-14T10:34:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.818+0000 7f00e55c9640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f00cc06aea0 0x7f00cc06d360 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.819+0000 7f00e55c9640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00e0155490 0x7f00e00c4950 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.819+0000 7f00e55c9640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00e014ac70 0x7f00e01575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.819+0000 7f00e55c9640 1 --2- 172.21.15.8:0/1271408738 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f00e00c5ce0 0x7f00e01ed0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:04.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.819+0000 7f00e55c9640 1 -- 172.21.15.8:0/1271408738 >> 172.21.15.8:0/1271408738 conn(0x7f00e00a74d0 msgr2=0x7f00e006a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:04.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.819+0000 7f00e55c9640 1 -- 172.21.15.8:0/1271408738 shutdown_connections 2023-10-14T10:34:04.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:04.819+0000 7f00e55c9640 1 -- 172.21.15.8:0/1271408738 wait complete. 2023-10-14T10:34:05.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T10:33:47.398252+0000', 'modified': '2023-10-14T10:33:50.442698+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6835/524862170', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6834', 'nonce': 524862170}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 524862170}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T10:34:05.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T10:34:05.243 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T10:34:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.476+0000 7fd8c2b47640 1 Processor -- start 2023-10-14T10:34:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.476+0000 7fd8c2b47640 1 -- start start 2023-10-14T10:34:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.478+0000 7fd8c2b47640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd8bc13af90 0x7fd8bc0a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.478+0000 7fd8c2b47640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8bc0bfc10 0x7fd8bc0c0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.478+0000 7fd8c2b47640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc152ac0 con 0x7fd8bc06fb10 2023-10-14T10:34:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.478+0000 7fd8c2b47640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc151eb0 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.478+0000 7fd8c2b47640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc152190 con 0x7fd8bc13af90 2023-10-14T10:34:05.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.478+0000 7fd8c1344640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd8bc06fb10 0x7fd8bc0c2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46848/0 (socket says 172.21.15.8:46848) 2023-10-14T10:34:05.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.478+0000 7fd8c1344640 1 -- 172.21.15.8:0/95871840 learned_addr learned my addr 172.21.15.8:0/95871840 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:05.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.478+0000 7fd8c2346640 1 --2- 172.21.15.8:0/95871840 >> v2:172.21.15.8:3300/0 conn(0x7fd8bc0bfc10 0x7fd8bc0c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.478+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/95871840 >> v2:172.21.15.92:3300/0 conn(0x7fd8bc13af90 0x7fd8bc0a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.479+0000 7fd8c2346640 1 -- 172.21.15.8:0/95871840 >> v2:172.21.15.92:3300/0 conn(0x7fd8bc13af90 msgr2=0x7fd8bc0a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:05.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.479+0000 7fd8c2346640 1 --2- 172.21.15.8:0/95871840 >> v2:172.21.15.92:3300/0 conn(0x7fd8bc13af90 0x7fd8bc0a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.479+0000 7fd8c2346640 1 -- 172.21.15.8:0/95871840 >> v1:172.21.15.8:6789/0 conn(0x7fd8bc06fb10 legacy=0x7fd8bc0c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:05.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.479+0000 7fd8c2346640 1 -- 172.21.15.8:0/95871840 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc152470 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.480+0000 7fd8c2346640 1 --2- 172.21.15.8:0/95871840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc0bfc10 0x7fd8bc0c0080 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0c1660 tx=0x7fd8b402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7578a2ddb0386eea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:05.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.480+0000 7fd8c0b43640 1 -- 172.21.15.8:0/95871840 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b402cbe0 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.480+0000 7fd8c0b43640 1 -- 172.21.15.8:0/95871840 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b402cd40 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.480+0000 7fd8c0b43640 1 -- 172.21.15.8:0/95871840 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4034660 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.481+0000 7fd8c2b47640 1 -- 172.21.15.8:0/95871840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc0bfc10 msgr2=0x7fd8bc0c0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:05.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.481+0000 7fd8c2b47640 1 --2- 172.21.15.8:0/95871840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc0bfc10 0x7fd8bc0c0080 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0c1660 tx=0x7fd8b402be30 comp rx=0 tx=0).stop 2023-10-14T10:34:05.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.481+0000 7fd8c2b47640 1 -- 172.21.15.8:0/95871840 shutdown_connections 2023-10-14T10:34:05.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.481+0000 7fd8c2b47640 1 --2- 172.21.15.8:0/95871840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc0bfc10 0x7fd8bc0c0080 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.481+0000 7fd8c2b47640 1 --2- 172.21.15.8:0/95871840 >> v2:172.21.15.92:3300/0 conn(0x7fd8bc13af90 0x7fd8bc0a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.481+0000 7fd8c2b47640 1 -- 172.21.15.8:0/95871840 >> 172.21.15.8:0/95871840 conn(0x7fd8bc06a200 msgr2=0x7fd8bc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:05.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.481+0000 7fd8c2b47640 1 -- 172.21.15.8:0/95871840 shutdown_connections 2023-10-14T10:34:05.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.481+0000 7fd8c2b47640 1 -- 172.21.15.8:0/95871840 wait complete. 2023-10-14T10:34:05.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.483+0000 7fd8c2b47640 1 Processor -- start 2023-10-14T10:34:05.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.483+0000 7fd8c2b47640 1 -- start start 2023-10-14T10:34:05.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c2b47640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8bc06fb10 0x7fd8bc14ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c2b47640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc0bfc10 0x7fd8bc0bb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c2b47640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8bc13af90 0x7fd8bc135f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c2b47640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc1e9080 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c2b47640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc1e9300 con 0x7fd8bc13af90 2023-10-14T10:34:05.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c2b47640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc1e95e0 con 0x7fd8bc06fb10 2023-10-14T10:34:05.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c1344640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc0bfc10 0x7fd8bc0bb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c1344640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc0bfc10 0x7fd8bc0bb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40978/0 (socket says 172.21.15.8:40978) 2023-10-14T10:34:05.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c1344640 1 -- 172.21.15.8:0/1897688744 learned_addr learned my addr 172.21.15.8:0/1897688744 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:05.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8bc06fb10 0x7fd8bc14ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c1344640 1 -- 172.21.15.8:0/1897688744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8bc06fb10 msgr2=0x7fd8bc14ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:05.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c1344640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8bc06fb10 0x7fd8bc14ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c1344640 1 -- 172.21.15.8:0/1897688744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8bc13af90 msgr2=0x7fd8bc135f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:05.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c1344640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8bc13af90 0x7fd8bc135f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.484+0000 7fd8c1344640 1 -- 172.21.15.8:0/1897688744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b4009a70 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.485+0000 7fd8c1344640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc0bfc10 0x7fd8bc0bb2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00c3c0 tx=0x7fd8ac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:05.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.485+0000 7fd8b27fc640 1 -- 172.21.15.8:0/1897688744 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac005ce0 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.485+0000 7fd8b27fc640 1 -- 172.21.15.8:0/1897688744 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac005e40 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.485+0000 7fd8c2b47640 1 -- 172.21.15.8:0/1897688744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc1e98c0 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.485+0000 7fd8b27fc640 1 -- 172.21.15.8:0/1897688744 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0072d0 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.485+0000 7fd8c2b47640 1 -- 172.21.15.8:0/1897688744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc14f3b0 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.488+0000 7fd8b27fc640 1 -- 172.21.15.8:0/1897688744 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd8ac0074f0 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.489+0000 7fd8b27fc640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd8a006ae70 0x7fd8a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.489+0000 7fd8b27fc640 1 -- 172.21.15.8:0/1897688744 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8ac088b30 con 0x7fd8bc0bfc10 2023-10-14T10:34:05.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.489+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd8a006ae70 0x7fd8a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.489+0000 7fd8c6a11740 1 Processor -- start 2023-10-14T10:34:05.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.489+0000 7fd8c6a11740 1 -- start start 2023-10-14T10:34:05.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.490+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd8a006ae70 0x7fd8a006d330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009a10 tx=0x7fd8b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:05.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.490+0000 7fd8c6a11740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 0x55a5715e09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.490+0000 7fd8c6a11740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715a5c20 0x55a5715dfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.490+0000 7fd8c6a11740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a5715a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.490+0000 7fd8c6a11740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5714bf7a0 con 0x55a5715df880 2023-10-14T10:34:05.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.490+0000 7fd8c6a11740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a571511740 con 0x55a5715e29f0 2023-10-14T10:34:05.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.490+0000 7fd8c6a11740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a57150ee30 con 0x55a5715a5c20 2023-10-14T10:34:05.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.490+0000 7fd8c1b45640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 0x55a5715e09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.491+0000 7fd8c1b45640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 0x55a5715e09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40988/0 (socket says 172.21.15.8:40988) 2023-10-14T10:34:05.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.491+0000 7fd8c1b45640 1 -- 172.21.15.8:0/3522248772 learned_addr learned my addr 172.21.15.8:0/3522248772 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.491+0000 7fd8c1b45640 1 -- 172.21.15.8:0/3522248772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715a5c20 msgr2=0x55a5715dfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.491+0000 7fd8c1344640 1 --2- 172.21.15.8:0/3522248772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715a5c20 0x55a5715dfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.491+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/3522248772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715a5c20 0x55a5715dfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.491+0000 7fd8c1b45640 1 -- 172.21.15.8:0/3522248772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 msgr2=0x55a5715a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:05.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.491+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/3522248772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a5715a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.491+0000 7fd8c1b45640 1 -- 172.21.15.8:0/3522248772 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5714ce910 con 0x55a5715df880 2023-10-14T10:34:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.491+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/3522248772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 0x55a5715e09f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8010bb0 tx=0x7fd8b8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2b9cbeebd2d2cc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.491+0000 7fd89f7fe640 1 -- 172.21.15.8:0/3522248772 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8021440 con 0x55a5715df880 2023-10-14T10:34:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.492+0000 7fd89f7fe640 1 -- 172.21.15.8:0/3522248772 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b801a070 con 0x55a5715df880 2023-10-14T10:34:05.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.492+0000 7fd89f7fe640 1 -- 172.21.15.8:0/3522248772 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80217a0 con 0x55a5715df880 2023-10-14T10:34:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.492+0000 7fd8c6a11740 1 -- 172.21.15.8:0/3522248772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 msgr2=0x55a5715e09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.492+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/3522248772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 0x55a5715e09f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8010bb0 tx=0x7fd8b8013000 comp rx=0 tx=0).stop 2023-10-14T10:34:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.492+0000 7fd8c6a11740 1 -- 172.21.15.8:0/3522248772 shutdown_connections 2023-10-14T10:34:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.492+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/3522248772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a5715a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.492+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/3522248772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715a5c20 0x55a5715dfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.492+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/3522248772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 0x55a5715e09f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.492+0000 7fd8c6a11740 1 -- 172.21.15.8:0/3522248772 >> 172.21.15.8:0/3522248772 conn(0x55a5715a1260 msgr2=0x55a5715c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:05.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.492+0000 7fd8c6a11740 1 -- 172.21.15.8:0/3522248772 shutdown_connections 2023-10-14T10:34:05.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.492+0000 7fd8c6a11740 1 -- 172.21.15.8:0/3522248772 wait complete. 2023-10-14T10:34:05.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.493+0000 7fd8c6a11740 1 -- start start 2023-10-14T10:34:05.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.493+0000 7fd8c6a11740 1 Processor -- start 2023-10-14T10:34:05.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.494+0000 7fd8c6a11740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715df880 0x55a5715f1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.494+0000 7fd8c6a11740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a5715c5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.494+0000 7fd8c6a11740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715f1cc0 0x55a5715f4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.494+0000 7fd8c6a11740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a57150a720 con 0x55a5715f1cc0 2023-10-14T10:34:05.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.494+0000 7fd8c6a11740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5714a8970 con 0x55a5715e29f0 2023-10-14T10:34:05.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.494+0000 7fd8c6a11740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5714a8610 con 0x55a5715df880 2023-10-14T10:34:05.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.494+0000 7fd8c6a11740 10 client.0 _ll_register_callbacks cb 0x55a5714ca9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:34:05.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.495+0000 7fd8c2346640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715f1cc0 0x55a5715f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.495+0000 7fd8c2346640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715f1cc0 0x55a5715f4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41000/0 (socket says 172.21.15.8:41000) 2023-10-14T10:34:05.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.495+0000 7fd8c2346640 1 -- 172.21.15.8:0/1600598891 learned_addr learned my addr 172.21.15.8:0/1600598891 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:05.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.495+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715df880 0x55a5715f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.495+0000 7fd8c1344640 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a5715c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.495+0000 7fd8c2346640 1 -- 172.21.15.8:0/1600598891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715df880 msgr2=0x55a5715f1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:05.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.495+0000 7fd8c2346640 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715df880 0x55a5715f1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.495+0000 7fd8c2346640 1 -- 172.21.15.8:0/1600598891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 msgr2=0x55a5715c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:05.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.495+0000 7fd8c2346640 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a5715c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.495+0000 7fd8c2346640 1 -- 172.21.15.8:0/1600598891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b800e050 con 0x55a5715f1cc0 2023-10-14T10:34:05.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.495+0000 7fd8c2346640 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715f1cc0 0x55a5715f4590 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd8b402c440 tx=0x7fd8b4034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ee1a6e965e01f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:05.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.495+0000 7fd89cff9640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:34:05.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd89cff9640 1 -- 172.21.15.8:0/1600598891 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4034bf0 con 0x55a5715f1cc0 2023-10-14T10:34:05.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1600598891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a571531160 con 0x55a5715f1cc0 2023-10-14T10:34:05.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd89cff9640 1 -- 172.21.15.8:0/1600598891 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8b4034d50 con 0x55a5715f1cc0 2023-10-14T10:34:05.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd89cff9640 1 -- 172.21.15.8:0/1600598891 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8b4003990 con 0x55a5715f1cc0 2023-10-14T10:34:05.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd8c6a11740 10 client.4659 fetch_fsmap learned FSMap version 8 2023-10-14T10:34:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1600598891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a571508da0 con 0x55a5715f1cc0 2023-10-14T10:34:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd89cff9640 1 -- 172.21.15.8:0/1600598891 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a571531160 con 0x55a5715f1cc0 2023-10-14T10:34:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd89cff9640 1 -- 172.21.15.8:0/1600598891 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd8b4040450 con 0x55a5715f1cc0 2023-10-14T10:34:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd8c6a11740 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T10:34:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd8c6a11740 10 client.4659 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T10:34:05.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd8c6a11740 20 client.4659 populate_metadata read hostname 'smithi008' 2023-10-14T10:34:05.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.8:6834/524862170,v1:172.21.15.8:6835/524862170] conn(0x55a5715f4ad0 0x55a5715f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.496+0000 7fd8c6a11740 4 client.4659 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T10:34:05.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.497+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1600598891 --> [v2:172.21.15.8:6834/524862170,v1:172.21.15.8:6835/524862170] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5714dccc0 con 0x55a5715f4ad0 2023-10-14T10:34:05.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.497+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.8:6834/524862170,v1:172.21.15.8:6835/524862170] conn(0x55a5715f4ad0 0x55a5715f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.497+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.8:6834/524862170,v1:172.21.15.8:6835/524862170] conn(0x55a5715f4ad0 0x55a5715f4eb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30add64386e52f3e server_cookie=660a5d2a4cad1d0d in_seq=0 out_seq=0 2023-10-14T10:34:05.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.497+0000 7fd89cff9640 10 client.4659 ms_handle_connect on v2:172.21.15.8:6834/524862170 2023-10-14T10:34:05.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.498+0000 7fd89cff9640 1 -- 172.21.15.8:0/1600598891 <== mds.0 v2:172.21.15.8:6834/524862170 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a5714dccc0 con 0x55a5715f4ad0 2023-10-14T10:34:05.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.498+0000 7fd89cff9640 10 client.4659 handle_command_reply: tid=0 2023-10-14T10:34:05.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.498+0000 7fd8c6a11740 1 client.4659 shutdown 2023-10-14T10:34:05.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.498+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1600598891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715f1cc0 msgr2=0x55a5715f4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.498+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715f1cc0 0x55a5715f4590 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd8b402c440 tx=0x7fd8b4034670 comp rx=0 tx=0).stop 2023-10-14T10:34:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.499+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1600598891 shutdown_connections 2023-10-14T10:34:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.499+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.8:6834/524862170,v1:172.21.15.8:6835/524862170] conn(0x55a5715f4ad0 0x55a5715f4eb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.499+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715f1cc0 0x55a5715f4590 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.499+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a5715c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.499+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/1600598891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715df880 0x55a5715f1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.499+0000 7fd89cff9640 0 client.4659 ms_handle_reset on v2:172.21.15.8:6834/524862170 2023-10-14T10:34:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.499+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1600598891 >> 172.21.15.8:0/1600598891 conn(0x55a5715a5c20 msgr2=0x55a5715e0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.499+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1600598891 shutdown_connections 2023-10-14T10:34:05.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.499+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1600598891 wait complete. 2023-10-14T10:34:05.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.499+0000 7fd8c6a11740 20 client.4659 trim_cache size 0 max 16384 2023-10-14T10:34:05.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.516+0000 7fd8c6a11740 1 Processor -- start 2023-10-14T10:34:05.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.516+0000 7fd8c6a11740 1 -- start start 2023-10-14T10:34:05.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.516+0000 7fd8c6a11740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715df880 0x55a5715d86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.516+0000 7fd8c6a11740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a5715dc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.516+0000 7fd8c6a11740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715dcca0 0x55a5715d98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.516+0000 7fd8c6a11740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5715a4f20 con 0x55a5715dcca0 2023-10-14T10:34:05.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.516+0000 7fd8c6a11740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a57126ef20 con 0x55a5715e29f0 2023-10-14T10:34:05.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.516+0000 7fd8c6a11740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5715d6a80 con 0x55a5715df880 2023-10-14T10:34:05.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.517+0000 7fd8c2346640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715dcca0 0x55a5715d98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.517+0000 7fd8c2346640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715dcca0 0x55a5715d98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41004/0 (socket says 172.21.15.8:41004) 2023-10-14T10:34:05.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.517+0000 7fd8c2346640 1 -- 172.21.15.8:0/344871622 learned_addr learned my addr 172.21.15.8:0/344871622 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:05.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.517+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/344871622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715df880 0x55a5715d86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.517+0000 7fd8c1344640 1 --2- 172.21.15.8:0/344871622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a5715dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.517+0000 7fd8c2346640 1 -- 172.21.15.8:0/344871622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715df880 msgr2=0x55a5715d86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:05.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.517+0000 7fd8c2346640 1 --2- 172.21.15.8:0/344871622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715df880 0x55a5715d86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.517+0000 7fd8c2346640 1 -- 172.21.15.8:0/344871622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 msgr2=0x55a5715dc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:05.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.517+0000 7fd8c2346640 1 --2- 172.21.15.8:0/344871622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a5715dc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.517+0000 7fd8c2346640 1 -- 172.21.15.8:0/344871622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5714a7b80 con 0x55a5715dcca0 2023-10-14T10:34:05.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.517+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/344871622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715df880 0x55a5715d86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:05.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.518+0000 7fd8c2346640 1 --2- 172.21.15.8:0/344871622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715dcca0 0x55a5715d98c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4002230 tx=0x7fd8b4040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf362f009fe27f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:05.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.518+0000 7fd89ffff640 1 -- 172.21.15.8:0/344871622 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4034650 con 0x55a5715dcca0 2023-10-14T10:34:05.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.518+0000 7fd89ffff640 1 -- 172.21.15.8:0/344871622 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b40349f0 con 0x55a5715dcca0 2023-10-14T10:34:05.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.518+0000 7fd89ffff640 1 -- 172.21.15.8:0/344871622 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4034da0 con 0x55a5715dcca0 2023-10-14T10:34:05.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.519+0000 7fd8c6a11740 1 -- 172.21.15.8:0/344871622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715dcca0 msgr2=0x55a5715d98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:05.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.519+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/344871622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715dcca0 0x55a5715d98c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4002230 tx=0x7fd8b4040000 comp rx=0 tx=0).stop 2023-10-14T10:34:05.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.519+0000 7fd8c6a11740 1 -- 172.21.15.8:0/344871622 shutdown_connections 2023-10-14T10:34:05.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.519+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/344871622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715dcca0 0x55a5715d98c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.519+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/344871622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a5715dc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.519+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/344871622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715df880 0x55a5715d86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.519+0000 7fd8c6a11740 1 -- 172.21.15.8:0/344871622 >> 172.21.15.8:0/344871622 conn(0x55a5715a5c20 msgr2=0x55a571603c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:05.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.519+0000 7fd8c6a11740 1 -- 172.21.15.8:0/344871622 shutdown_connections 2023-10-14T10:34:05.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.519+0000 7fd8c6a11740 1 -- 172.21.15.8:0/344871622 wait complete. 2023-10-14T10:34:05.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.520+0000 7fd8c6a11740 1 -- start start 2023-10-14T10:34:05.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.520+0000 7fd8c6a11740 1 Processor -- start 2023-10-14T10:34:05.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c6a11740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715dcca0 0x55a5715d7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c6a11740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 0x55a5715ee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c6a11740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a571646850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c6a11740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5715e0600 con 0x55a5715df880 2023-10-14T10:34:05.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c6a11740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5715f9ac0 con 0x55a5715e29f0 2023-10-14T10:34:05.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c6a11740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5715fb430 con 0x55a5715dcca0 2023-10-14T10:34:05.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c6a11740 10 client.0 _ll_register_callbacks cb 0x55a5715f20b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:34:05.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c1344640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 0x55a5715ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c1344640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 0x55a5715ee120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41006/0 (socket says 172.21.15.8:41006) 2023-10-14T10:34:05.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c1344640 1 -- 172.21.15.8:0/1601110481 learned_addr learned my addr 172.21.15.8:0/1601110481 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:05.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/1601110481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715dcca0 0x55a5715d7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c1344640 1 -- 172.21.15.8:0/1601110481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715dcca0 msgr2=0x55a5715d7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:05.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c1344640 1 --2- 172.21.15.8:0/1601110481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715dcca0 0x55a5715d7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c1344640 1 -- 172.21.15.8:0/1601110481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 msgr2=0x55a571646850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:05.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c1344640 1 --2- 172.21.15.8:0/1601110481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a571646850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.521+0000 7fd8c1344640 1 -- 172.21.15.8:0/1601110481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a571508da0 con 0x55a5715df880 2023-10-14T10:34:05.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd8c1344640 1 --2- 172.21.15.8:0/1601110481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 0x55a5715ee120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00cfd0 tx=0x7fd8ac0579f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15c6a20cf08f7c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:05.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd89cff9640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:34:05.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd89cff9640 1 -- 172.21.15.8:0/1601110481 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac05f870 con 0x55a5715df880 2023-10-14T10:34:05.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd89cff9640 1 -- 172.21.15.8:0/1601110481 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8ac058b30 con 0x55a5715df880 2023-10-14T10:34:05.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1601110481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd8b801a070 con 0x55a5715df880 2023-10-14T10:34:05.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd89cff9640 1 -- 172.21.15.8:0/1601110481 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8ac058cf0 con 0x55a5715df880 2023-10-14T10:34:05.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd8c6a11740 10 client.4665 fetch_fsmap learned FSMap version 8 2023-10-14T10:34:05.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1601110481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a5714cd170 con 0x55a5715df880 2023-10-14T10:34:05.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd89cff9640 1 -- 172.21.15.8:0/1601110481 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b801a070 con 0x55a5715df880 2023-10-14T10:34:05.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd89cff9640 1 -- 172.21.15.8:0/1601110481 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd8ac0536a0 con 0x55a5715df880 2023-10-14T10:34:05.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd8c6a11740 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T10:34:05.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd8c6a11740 10 client.4665 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T10:34:05.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd8c6a11740 20 client.4665 populate_metadata read hostname 'smithi008' 2023-10-14T10:34:05.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/1601110481 >> [v2:172.21.15.8:6834/524862170,v1:172.21.15.8:6835/524862170] conn(0x55a571646d90 0x55a57164cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:05.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd8c6a11740 4 client.4665 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T10:34:05.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.522+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1601110481 --> [v2:172.21.15.8:6834/524862170,v1:172.21.15.8:6835/524862170] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a571503700 con 0x55a571646d90 2023-10-14T10:34:05.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.523+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/1601110481 >> [v2:172.21.15.8:6834/524862170,v1:172.21.15.8:6835/524862170] conn(0x55a571646d90 0x55a57164cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:05.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.523+0000 7fd8c1b45640 1 --2- 172.21.15.8:0/1601110481 >> [v2:172.21.15.8:6834/524862170,v1:172.21.15.8:6835/524862170] conn(0x55a571646d90 0x55a57164cc10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f1061043c637572 server_cookie=8d4c933207777eef in_seq=0 out_seq=0 2023-10-14T10:34:05.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.523+0000 7fd89cff9640 10 client.4665 ms_handle_connect on v2:172.21.15.8:6834/524862170 2023-10-14T10:34:05.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.523+0000 7fd89cff9640 1 -- 172.21.15.8:0/1601110481 <== mds.0 v2:172.21.15.8:6834/524862170 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55a571503700 con 0x55a571646d90 2023-10-14T10:34:05.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.523+0000 7fd89cff9640 10 client.4665 handle_command_reply: tid=0 2023-10-14T10:34:05.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.523+0000 7fd8c6a11740 1 client.4665 shutdown 2023-10-14T10:34:05.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.524+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1601110481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 msgr2=0x55a5715ee120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:05.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.524+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/1601110481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 0x55a5715ee120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00cfd0 tx=0x7fd8ac0579f0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.524+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1601110481 shutdown_connections 2023-10-14T10:34:05.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.524+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/1601110481 >> [v2:172.21.15.8:6834/524862170,v1:172.21.15.8:6835/524862170] conn(0x55a571646d90 0x55a57164cc10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.524+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/1601110481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a5715e29f0 0x55a571646850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.524+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/1601110481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5715df880 0x55a5715ee120 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.524+0000 7fd8c6a11740 1 --2- 172.21.15.8:0/1601110481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55a5715dcca0 0x55a5715d7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.524+0000 7fd89cff9640 0 client.4665 ms_handle_reset on v2:172.21.15.8:6834/524862170 2023-10-14T10:34:05.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.524+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1601110481 >> 172.21.15.8:0/1601110481 conn(0x55a5715a5c20 msgr2=0x55a571603c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:05.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.524+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1601110481 shutdown_connections 2023-10-14T10:34:05.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.524+0000 7fd8c6a11740 1 -- 172.21.15.8:0/1601110481 wait complete. 2023-10-14T10:34:05.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.524+0000 7fd8c6a11740 20 client.4665 trim_cache size 0 max 16384 2023-10-14T10:34:05.539 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:34:05.540 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "452b10b4-f8ad-4e99-85d0-4d157f344356", 2023-10-14T10:34:05.540 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-14T10:34:05.540 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4272, 2023-10-14T10:34:05.540 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-14T10:34:05.540 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-14T10:34:05.541 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-14T10:34:05.541 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 17.614281074000001, 2023-10-14T10:34:05.541 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 8, 2023-10-14T10:34:05.541 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 21, 2023-10-14T10:34:05.541 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 21, 2023-10-14T10:34:05.542 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 25.729831707999999 2023-10-14T10:34:05.542 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:34:05.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.525+0000 7fd8c2b47640 1 -- 172.21.15.8:0/1897688744 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd8a006ae70 msgr2=0x7fd8a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:05.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.525+0000 7fd8c2b47640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd8a006ae70 0x7fd8a006d330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009a10 tx=0x7fd8b8008040 comp rx=0 tx=0).stop 2023-10-14T10:34:05.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.525+0000 7fd8c2b47640 1 -- 172.21.15.8:0/1897688744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc0bfc10 msgr2=0x7fd8bc0bb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:05.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.525+0000 7fd8c2b47640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc0bfc10 0x7fd8bc0bb2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00c3c0 tx=0x7fd8ac00c880 comp rx=0 tx=0).stop 2023-10-14T10:34:05.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.525+0000 7fd8c2b47640 1 -- 172.21.15.8:0/1897688744 shutdown_connections 2023-10-14T10:34:05.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.525+0000 7fd8c2b47640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd8a006ae70 0x7fd8a006d330 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.525+0000 7fd8c2b47640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8bc13af90 0x7fd8bc135f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.525+0000 7fd8c2b47640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8bc0bfc10 0x7fd8bc0bb2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.525+0000 7fd8c2b47640 1 --2- 172.21.15.8:0/1897688744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8bc06fb10 0x7fd8bc14ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:05.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.525+0000 7fd8c2b47640 1 -- 172.21.15.8:0/1897688744 >> 172.21.15.8:0/1897688744 conn(0x7fd8bc06a200 msgr2=0x7fd8bc070250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:05.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.525+0000 7fd8c2b47640 1 -- 172.21.15.8:0/1897688744 shutdown_connections 2023-10-14T10:34:05.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:05.525+0000 7fd8c2b47640 1 -- 172.21.15.8:0/1897688744 wait complete. 2023-10-14T10:34:05.546 INFO:teuthology.run_tasks:Running task kclient... 2023-10-14T10:34:05.568 INFO:tasks.kclient:Mounting kernel clients... 2023-10-14T10:34:05.569 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-10-14T10:34:05.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:05.570 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-14T10:34:05.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:05.630 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-10-14T10:34:05.736 INFO:teuthology.orchestra.run.smithi008.stderr:Cannot find device "ceph-brx" 2023-10-14T10:34:05.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T10:34:05.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:05.742 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-14T10:34:05.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:05.804 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-10-14T10:34:05.908 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2023-10-14T10:34:05.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T10:34:05.913 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-14T10:34:05.913 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T10:34:05.913 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T10:34:05.914 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T10:34:06.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.151+0000 7f1733fff640 1 Processor -- start 2023-10-14T10:34:06.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.151+0000 7f1733fff640 1 -- start start 2023-10-14T10:34:06.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.153+0000 7f1733fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f17340bafa0 0x7f17340bfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:06.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.153+0000 7f1733fff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17340c0830 con 0x7f173414d980 2023-10-14T10:34:06.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.153+0000 7f1733fff640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17340bb480 con 0x7f1734153a00 2023-10-14T10:34:06.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.153+0000 7f1733fff640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17340bb760 con 0x7f17340bafa0 2023-10-14T10:34:06.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.153+0000 7f1732ffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f173414d980 0x7f17340a8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46854/0 (socket says 172.21.15.8:46854) 2023-10-14T10:34:06.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.153+0000 7f1732ffd640 1 -- 172.21.15.8:0/3173814364 learned_addr learned my addr 172.21.15.8:0/3173814364 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:06.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.153+0000 7f17327fc640 1 --2- 172.21.15.8:0/3173814364 >> v2:172.21.15.8:3300/0 conn(0x7f17340bafa0 0x7f17340bfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:06.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.154+0000 7f17327fc640 1 -- 172.21.15.8:0/3173814364 >> v1:172.21.15.92:6789/0 conn(0x7f1734153a00 legacy=0x7f17340c0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:06.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.154+0000 7f17327fc640 1 -- 172.21.15.8:0/3173814364 >> v1:172.21.15.8:6789/0 conn(0x7f173414d980 legacy=0x7f17340a8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:06.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.154+0000 7f17327fc640 1 -- 172.21.15.8:0/3173814364 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17340bba40 con 0x7f17340bafa0 2023-10-14T10:34:06.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.155+0000 7f17327fc640 1 --2- 172.21.15.8:0/3173814364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17340bafa0 0x7f17340bfbe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f17280097a0 tx=0x7f172802da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23b4fbe9ef6f0b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:06.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.155+0000 7f1731ffb640 1 -- 172.21.15.8:0/3173814364 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728031870 con 0x7f17340bafa0 2023-10-14T10:34:06.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.155+0000 7f1731ffb640 1 -- 172.21.15.8:0/3173814364 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17280319d0 con 0x7f17340bafa0 2023-10-14T10:34:06.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.155+0000 7f1731ffb640 1 -- 172.21.15.8:0/3173814364 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728031d60 con 0x7f17340bafa0 2023-10-14T10:34:06.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.156+0000 7f1733fff640 1 -- 172.21.15.8:0/3173814364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17340bafa0 msgr2=0x7f17340bfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:06.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.156+0000 7f1733fff640 1 --2- 172.21.15.8:0/3173814364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17340bafa0 0x7f17340bfbe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f17280097a0 tx=0x7f172802da50 comp rx=0 tx=0).stop 2023-10-14T10:34:06.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.156+0000 7f1733fff640 1 -- 172.21.15.8:0/3173814364 shutdown_connections 2023-10-14T10:34:06.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.156+0000 7f1733fff640 1 --2- 172.21.15.8:0/3173814364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17340bafa0 0x7f17340bfbe0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:06.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.156+0000 7f1733fff640 1 -- 172.21.15.8:0/3173814364 >> 172.21.15.8:0/3173814364 conn(0x7f173406a200 msgr2=0x7f173406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:06.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.156+0000 7f1733fff640 1 -- 172.21.15.8:0/3173814364 shutdown_connections 2023-10-14T10:34:06.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.156+0000 7f1733fff640 1 -- 172.21.15.8:0/3173814364 wait complete. 2023-10-14T10:34:06.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.157+0000 7f1733fff640 1 Processor -- start 2023-10-14T10:34:06.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.158+0000 7f1733fff640 1 -- start start 2023-10-14T10:34:06.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.158+0000 7f1733fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17340bafa0 0x7f17341ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:06.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f1733fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173414d980 0x7f1734147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f1733fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1734153a00 0x7f17341e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f1733fff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173406c790 con 0x7f1734153a00 2023-10-14T10:34:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f1733fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17341e9780 con 0x7f173414d980 2023-10-14T10:34:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f1733fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17341e9a20 con 0x7f17340bafa0 2023-10-14T10:34:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f17337fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1734153a00 0x7f17341e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f17337fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1734153a00 0x7f17341e9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41020/0 (socket says 172.21.15.8:41020) 2023-10-14T10:34:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f17337fe640 1 -- 172.21.15.8:0/1783761121 learned_addr learned my addr 172.21.15.8:0/1783761121 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f1732ffd640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17340bafa0 0x7f17341ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f17327fc640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173414d980 0x7f1734147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f17337fe640 1 -- 172.21.15.8:0/1783761121 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17340bafa0 msgr2=0x7f17341ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f17337fe640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17340bafa0 0x7f17341ed6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f17337fe640 1 -- 172.21.15.8:0/1783761121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173414d980 msgr2=0x7f1734147e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f17337fe640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173414d980 0x7f1734147e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.159+0000 7f17337fe640 1 -- 172.21.15.8:0/1783761121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728009400 con 0x7f1734153a00 2023-10-14T10:34:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.160+0000 7f17337fe640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1734153a00 0x7f17341e9eb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f172c00c410 tx=0x7f172c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.160+0000 7f171b7fe640 1 -- 172.21.15.8:0/1783761121 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c011790 con 0x7f1734153a00 2023-10-14T10:34:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.160+0000 7f171b7fe640 1 -- 172.21.15.8:0/1783761121 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c0118f0 con 0x7f1734153a00 2023-10-14T10:34:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.160+0000 7f1733fff640 1 -- 172.21.15.8:0/1783761121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173406c1d0 con 0x7f1734153a00 2023-10-14T10:34:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.160+0000 7f171b7fe640 1 -- 172.21.15.8:0/1783761121 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c011ce0 con 0x7f1734153a00 2023-10-14T10:34:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.160+0000 7f1733fff640 1 -- 172.21.15.8:0/1783761121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17341483d0 con 0x7f1734153a00 2023-10-14T10:34:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.161+0000 7f1733fff640 1 -- 172.21.15.8:0/1783761121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17341e9bd0 con 0x7f1734153a00 2023-10-14T10:34:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.163+0000 7f171b7fe640 1 -- 172.21.15.8:0/1783761121 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f172c01c460 con 0x7f1734153a00 2023-10-14T10:34:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.164+0000 7f171b7fe640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f172006aea0 0x7f172006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.164+0000 7f171b7fe640 1 -- 172.21.15.8:0/1783761121 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f172c089200 con 0x7f1734153a00 2023-10-14T10:34:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.164+0000 7f1732ffd640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f172006aea0 0x7f172006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.165+0000 7f1732ffd640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f172006aea0 0x7f172006d360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1724005c00 tx=0x7f1724009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:06.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.168+0000 7f171b7fe640 1 -- 172.21.15.8:0/1783761121 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17341e9bd0 con 0x7f1734153a00 2023-10-14T10:34:06.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.403+0000 7f1733fff640 1 -- 172.21.15.8:0/1783761121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f17341e9bd0 con 0x7f1734153a00 2023-10-14T10:34:06.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.403+0000 7f171b7fe640 1 -- 172.21.15.8:0/1783761121 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f17341e9bd0 con 0x7f1734153a00 2023-10-14T10:34:06.406 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T10:34:06.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.406+0000 7f1733fff640 1 -- 172.21.15.8:0/1783761121 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f172006aea0 msgr2=0x7f172006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.406+0000 7f1733fff640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f172006aea0 0x7f172006d360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1724005c00 tx=0x7f1724009040 comp rx=0 tx=0).stop 2023-10-14T10:34:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.406+0000 7f1733fff640 1 -- 172.21.15.8:0/1783761121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1734153a00 msgr2=0x7f17341e9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.406+0000 7f1733fff640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1734153a00 0x7f17341e9eb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f172c00c410 tx=0x7f172c00c8d0 comp rx=0 tx=0).stop 2023-10-14T10:34:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.406+0000 7f1733fff640 1 -- 172.21.15.8:0/1783761121 shutdown_connections 2023-10-14T10:34:06.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.406+0000 7f1733fff640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f172006aea0 0x7f172006d360 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:06.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.406+0000 7f1733fff640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1734153a00 0x7f17341e9eb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:06.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.406+0000 7f1733fff640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f173414d980 0x7f1734147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:06.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.406+0000 7f1733fff640 1 --2- 172.21.15.8:0/1783761121 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17340bafa0 0x7f17341ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:06.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.406+0000 7f1733fff640 1 -- 172.21.15.8:0/1783761121 >> 172.21.15.8:0/1783761121 conn(0x7f173406a200 msgr2=0x7f17340732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.407+0000 7f1733fff640 1 -- 172.21.15.8:0/1783761121 shutdown_connections 2023-10-14T10:34:06.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:06.407+0000 7f1733fff640 1 -- 172.21.15.8:0/1783761121 wait complete. 2023-10-14T10:34:06.428 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T10:34:06.429 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T10:34:06.429 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-10-14T10:34:06.429 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T10:34:06.430 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T10:34:06.430 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T10:34:06.430 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T10:34:06.430 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T10:34:06.431 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T10:34:06.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:06.431 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-10-14T10:34:06.487 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T10:34:06.487 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T10:34:06.487 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T10:34:06.487 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-14T10:34:06.488 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-10-14T10:34:06.488 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-14T10:34:06.488 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T10:34:06.488 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-10-14T10:34:06.489 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2023-10-14T10:34:06.489 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T10:34:06.489 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-10-14T10:34:06.489 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2023-10-14T10:34:06.489 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T10:34:06.490 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-10-14T10:34:06.490 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2023-10-14T10:34:06.490 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T10:34:06.490 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42350sec preferred_lft 42350sec 2023-10-14T10:34:06.491 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link noprefixroute 2023-10-14T10:34:06.491 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-14T10:34:06.491 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T10:34:06.491 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-10-14T10:34:06.491 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2023-10-14T10:34:06.493 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T10:34:06.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:06.493 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-14T10:34:06.494 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-14T10:34:06.494 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2023-10-14T10:34:06.494 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2023-10-14T10:34:06.495 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2023-10-14T10:34:06.495 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T10:34:06.495 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-14T10:34:06.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:06.988 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T10:34:07.070 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-10-14T10:34:07.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:07.074 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-10-14T10:34:07.139 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-10-14T10:34:07.140 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T10:34:07.140 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T10:34:07.140 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T10:34:07.140 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T10:34:07.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:07.141 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-14T10:34:07.142 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-14T10:34:07.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T10:34:07.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T10:34:07.143 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T10:34:07.143 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-14T10:34:07.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:07.901 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-14T10:34:07.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:07.948 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2023-10-14T10:34:08.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:08.039 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-14T10:34:08.039 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-14T10:34:08.039 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T10:34:08.040 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-14T10:34:08.040 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-14T10:34:08.168 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-14T10:34:08.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:08.168 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-14T10:34:08.169 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-14T10:34:08.169 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-14T10:34:08.169 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T10:34:08.170 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-14T10:34:08.170 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-14T10:34:08.170 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-14T10:34:08.170 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-14T10:34:08.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:08.440 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-14T10:34:08.441 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-14T10:34:08.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2023-10-14T10:34:08.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T10:34:08.441 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-14T10:34:08.604 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T10:34:08.605 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T10:34:08.653 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T10:34:08.653 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T10:34:08.654 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T10:34:08.698 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T10:34:08.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:08.699 DEBUG:teuthology.orchestra.run.smithi008:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T10:34:08.877 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T10:34:08.878 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T10:34:08.878 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2023-10-14T10:34:08.924 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:34:08.934 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:34:09.385 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T10:34:09.386 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T10:34:09.386 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2023-10-14T10:34:09.386 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T10:34:09.386 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T10:34:09.423 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T10:34:09.423 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T10:34:09.424 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2023-10-14T10:34:09.424 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T10:34:09.424 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T10:34:09.424 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-10-14T10:34:09.424 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-10-14T10:34:09.425 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=452b10b4-f8ad-4e99-85d0-4d157f344356" will pass to kernel 2023-10-14T10:34:09.425 INFO:teuthology.orchestra.run.smithi008.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-10-14T10:34:09.426 INFO:teuthology.orchestra.run.smithi008.stdout: You just mounted a file system that supports labels which does not 2023-10-14T10:34:09.426 INFO:teuthology.orchestra.run.smithi008.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-10-14T10:34:09.426 INFO:teuthology.orchestra.run.smithi008.stdout: applications will generate AVC messages and not be allowed access to 2023-10-14T10:34:09.426 INFO:teuthology.orchestra.run.smithi008.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-10-14T10:34:09.430 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T10:34:09.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:09.431 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T10:34:09.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:09.530 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T10:34:09.602 INFO:teuthology.orchestra.run.smithi008.stdout:client4567 2023-10-14T10:34:09.602 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:34:09.603 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T10:34:09.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:09.660 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T10:34:09.725 INFO:teuthology.orchestra.run.smithi008.stdout:client4567 2023-10-14T10:34:09.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:09.726 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T10:34:09.790 INFO:teuthology.orchestra.run.smithi008.stdout:client4567 2023-10-14T10:34:09.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:09.791 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/452b10b4-f8ad-4e99-85d0-4d157f344356.client4567/status') 2023-10-14T10:34:09.880 INFO:teuthology.orchestra.run.smithi008.stdout:instance: client.4567 (3)172.21.15.8:0/597055736 2023-10-14T10:34:09.881 INFO:teuthology.orchestra.run.smithi008.stdout:blocklisted: false 2023-10-14T10:34:09.881 INFO:teuthology.orchestra.run.smithi008.stderr:0+1 records in 2023-10-14T10:34:09.881 INFO:teuthology.orchestra.run.smithi008.stderr:0+1 records out 2023-10-14T10:34:09.881 INFO:teuthology.orchestra.run.smithi008.stderr:68 bytes copied, 7.5595e-05 s, 900 kB/s 2023-10-14T10:34:09.885 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-14T10:34:09.885 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T10:34:09.885 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T10:34:09.886 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T10:34:10.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.106+0000 7fe4ff159640 1 Processor -- start 2023-10-14T10:34:10.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.106+0000 7fe4ff159640 1 -- start start 2023-10-14T10:34:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.108+0000 7fe4ff159640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe4f815b930 0x7fe4f815bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.108+0000 7fe4ff159640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f80a9840 con 0x7fe4f80aa150 2023-10-14T10:34:10.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.108+0000 7fe4ff159640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f8159020 con 0x7fe4f81558c0 2023-10-14T10:34:10.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.108+0000 7fe4ff159640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f8158450 con 0x7fe4f815b930 2023-10-14T10:34:10.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.108+0000 7fe4fd956640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe4f80aa150 0x7fe4f80c2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47662/0 (socket says 172.21.15.8:47662) 2023-10-14T10:34:10.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.108+0000 7fe4fd956640 1 -- 172.21.15.8:0/2607036994 learned_addr learned my addr 172.21.15.8:0/2607036994 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:10.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.109+0000 7fe4fe958640 1 --2- 172.21.15.8:0/2607036994 >> v2:172.21.15.92:3300/0 conn(0x7fe4f815b930 0x7fe4f815bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:10.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.109+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052065761 0 0) 0x7fe4e8001110 con 0x7fe4f80aa150 2023-10-14T10:34:10.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.109+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4e4003520 con 0x7fe4f80aa150 2023-10-14T10:34:10.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.109+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3019981102 0 0) 0x7fe4e4003520 con 0x7fe4f80aa150 2023-10-14T10:34:10.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.109+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 >> v2:172.21.15.92:3300/0 conn(0x7fe4f815b930 msgr2=0x7fe4f815bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:10.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.109+0000 7fe4fd155640 1 --2- 172.21.15.8:0/2607036994 >> v2:172.21.15.92:3300/0 conn(0x7fe4f815b930 0x7fe4f815bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:10.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.109+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 >> v1:172.21.15.92:6789/0 conn(0x7fe4f81558c0 legacy=0x7fe4f80ba0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.109+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f81586f0 con 0x7fe4f80aa150 2023-10-14T10:34:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.109+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fe4e8001800 con 0x7fe4f80aa150 2023-10-14T10:34:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.109+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 >> v1:172.21.15.8:6789/0 conn(0x7fe4f80aa150 legacy=0x7fe4f80c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.109+0000 7fe4fd155640 1 --2- 172.21.15.8:0/2607036994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4e4003970 0x7fe4e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fd155640 1 --2- 172.21.15.8:0/2607036994 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4e40047c0 0x7fe4e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fd155640 1 --2- 172.21.15.8:0/2607036994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4e4005180 0x7fe4e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f8158450 con 0x7fe4e4005180 2023-10-14T10:34:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e400c020 con 0x7fe4e4003970 2023-10-14T10:34:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e400c1e0 con 0x7fe4e40047c0 2023-10-14T10:34:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fe958640 1 --2- 172.21.15.8:0/2607036994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4e4005180 0x7fe4e400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fd956640 1 --2- 172.21.15.8:0/2607036994 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4e40047c0 0x7fe4e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fe958640 1 -- 172.21.15.8:0/2607036994 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4e40047c0 msgr2=0x7fe4e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fe958640 1 --2- 172.21.15.8:0/2607036994 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4e40047c0 0x7fe4e4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fe958640 1 -- 172.21.15.8:0/2607036994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4e4003970 msgr2=0x7fe4e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fe157640 1 --2- 172.21.15.8:0/2607036994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4e4003970 0x7fe4e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fe958640 1 --2- 172.21.15.8:0/2607036994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4e4003970 0x7fe4e4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.110+0000 7fe4fe958640 1 -- 172.21.15.8:0/2607036994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e4003520 con 0x7fe4e4005180 2023-10-14T10:34:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.111+0000 7fe4fe958640 1 -- 172.21.15.8:0/2607036994 reap_dead start 2023-10-14T10:34:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.111+0000 7fe4fe958640 1 --2- 172.21.15.8:0/2607036994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4e4005180 0x7fe4e400b980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009fc0 tx=0x7fe4e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d348fdf96d137fd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.112+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f002cc60 con 0x7fe4e4005180 2023-10-14T10:34:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.112+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f000f040 con 0x7fe4e4005180 2023-10-14T10:34:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.112+0000 7fe4fd155640 1 -- 172.21.15.8:0/2607036994 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0003990 con 0x7fe4e4005180 2023-10-14T10:34:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.112+0000 7fe4ff159640 1 -- 172.21.15.8:0/2607036994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4e4005180 msgr2=0x7fe4e400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.112+0000 7fe4ff159640 1 --2- 172.21.15.8:0/2607036994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4e4005180 0x7fe4e400b980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009fc0 tx=0x7fe4e40057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.112+0000 7fe4ff159640 1 -- 172.21.15.8:0/2607036994 shutdown_connections 2023-10-14T10:34:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.112+0000 7fe4ff159640 1 --2- 172.21.15.8:0/2607036994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4e4005180 0x7fe4e400b980 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.112+0000 7fe4ff159640 1 -- 172.21.15.8:0/2607036994 >> 172.21.15.8:0/2607036994 conn(0x7fe4f806a200 msgr2=0x7fe4f806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.112+0000 7fe4ff159640 1 -- 172.21.15.8:0/2607036994 shutdown_connections 2023-10-14T10:34:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.113+0000 7fe4ff159640 1 -- 172.21.15.8:0/2607036994 wait complete. 2023-10-14T10:34:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.114+0000 7fe4ff159640 1 Processor -- start 2023-10-14T10:34:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.115+0000 7fe4ff159640 1 -- start start 2023-10-14T10:34:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.115+0000 7fe4ff159640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4e4005180 0x7fe4f81ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.115+0000 7fe4ff159640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4f815b410 0x7fe4f81f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.115+0000 7fe4ff159640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4f8159850 0x7fe4f806caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.115+0000 7fe4ff159640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f81502b0 con 0x7fe4f8159850 2023-10-14T10:34:10.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.115+0000 7fe4ff159640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80bbca0 con 0x7fe4e4005180 2023-10-14T10:34:10.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.115+0000 7fe4ff159640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80bbef0 con 0x7fe4f815b410 2023-10-14T10:34:10.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.116+0000 7fe4fe958640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4f8159850 0x7fe4f806caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:10.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.116+0000 7fe4fe958640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4f8159850 0x7fe4f806caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57566/0 (socket says 172.21.15.8:57566) 2023-10-14T10:34:10.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.116+0000 7fe4fe958640 1 -- 172.21.15.8:0/3546610277 learned_addr learned my addr 172.21.15.8:0/3546610277 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:10.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.116+0000 7fe4fe157640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4e4005180 0x7fe4f81ed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.116+0000 7fe4fd956640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4f815b410 0x7fe4f81f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.116+0000 7fe4fe958640 1 -- 172.21.15.8:0/3546610277 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4f815b410 msgr2=0x7fe4f81f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.116+0000 7fe4fe958640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4f815b410 0x7fe4f81f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.116+0000 7fe4fe958640 1 -- 172.21.15.8:0/3546610277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4e4005180 msgr2=0x7fe4f81ed2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.116+0000 7fe4fe958640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4e4005180 0x7fe4f81ed2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.116+0000 7fe4fe958640 1 -- 172.21.15.8:0/3546610277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80bc1d0 con 0x7fe4f8159850 2023-10-14T10:34:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.116+0000 7fe4fe157640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4e4005180 0x7fe4f81ed2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.116+0000 7fe4fd956640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4f815b410 0x7fe4f81f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.117+0000 7fe4fe958640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4f8159850 0x7fe4f806caa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000e230 tx=0x7fe4f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.117+0000 7fe4eeffd640 1 -- 172.21.15.8:0/3546610277 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0003da0 con 0x7fe4f8159850 2023-10-14T10:34:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.117+0000 7fe4eeffd640 1 -- 172.21.15.8:0/3546610277 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f00358d0 con 0x7fe4f8159850 2023-10-14T10:34:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.117+0000 7fe4eeffd640 1 -- 172.21.15.8:0/3546610277 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0035ca0 con 0x7fe4f8159850 2023-10-14T10:34:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.117+0000 7fe4ff159640 1 -- 172.21.15.8:0/3546610277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f81f0850 con 0x7fe4f8159850 2023-10-14T10:34:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.117+0000 7fe4ff159640 1 -- 172.21.15.8:0/3546610277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f8157050 con 0x7fe4f8159850 2023-10-14T10:34:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.118+0000 7fe4ff159640 1 -- 172.21.15.8:0/3546610277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f81571e0 con 0x7fe4f8159850 2023-10-14T10:34:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.119+0000 7fe4eeffd640 1 -- 172.21.15.8:0/3546610277 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe4f0004030 con 0x7fe4f8159850 2023-10-14T10:34:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.120+0000 7fe4eeffd640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe4dc06aea0 0x7fe4dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.120+0000 7fe4eeffd640 1 -- 172.21.15.8:0/3546610277 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4f00ac220 con 0x7fe4f8159850 2023-10-14T10:34:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.121+0000 7fe4fe157640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe4dc06aea0 0x7fe4dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.121+0000 7fe4fe157640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe4dc06aea0 0x7fe4dc06d360 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe4f81eb120 tx=0x7fe4f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.125+0000 7fe4eeffd640 1 -- 172.21.15.8:0/3546610277 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4f00773e0 con 0x7fe4f8159850 2023-10-14T10:34:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.356+0000 7fe4ff159640 1 -- 172.21.15.8:0/3546610277 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe4f80674b0 con 0x7fe4f8159850 2023-10-14T10:34:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.357+0000 7fe4eeffd640 1 -- 172.21.15.8:0/3546610277 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe4f007aa00 con 0x7fe4f8159850 2023-10-14T10:34:10.359 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T10:34:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.359+0000 7fe4ff159640 1 -- 172.21.15.8:0/3546610277 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe4dc06aea0 msgr2=0x7fe4dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.359+0000 7fe4ff159640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe4dc06aea0 0x7fe4dc06d360 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe4f81eb120 tx=0x7fe4f4009040 comp rx=0 tx=0).stop 2023-10-14T10:34:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.359+0000 7fe4ff159640 1 -- 172.21.15.8:0/3546610277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4f8159850 msgr2=0x7fe4f806caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.359+0000 7fe4ff159640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4f8159850 0x7fe4f806caa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000e230 tx=0x7fe4f0009750 comp rx=0 tx=0).stop 2023-10-14T10:34:10.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.359+0000 7fe4ff159640 1 -- 172.21.15.8:0/3546610277 shutdown_connections 2023-10-14T10:34:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.359+0000 7fe4ff159640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe4dc06aea0 0x7fe4dc06d360 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.359+0000 7fe4ff159640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4f8159850 0x7fe4f806caa0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.360+0000 7fe4ff159640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4f815b410 0x7fe4f81f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.360+0000 7fe4ff159640 1 --2- 172.21.15.8:0/3546610277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4e4005180 0x7fe4f81ed2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.360+0000 7fe4ff159640 1 -- 172.21.15.8:0/3546610277 >> 172.21.15.8:0/3546610277 conn(0x7fe4f806a200 msgr2=0x7fe4f80732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:10.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.360+0000 7fe4ff159640 1 -- 172.21.15.8:0/3546610277 shutdown_connections 2023-10-14T10:34:10.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:10.360+0000 7fe4ff159640 1 -- 172.21.15.8:0/3546610277 wait complete. 2023-10-14T10:34:10.380 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T10:34:10.381 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T10:34:10.381 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-10-14T10:34:10.381 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T10:34:10.382 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T10:34:10.382 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T10:34:10.382 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T10:34:10.382 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T10:34:10.383 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T10:34:10.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:10.383 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-10-14T10:34:10.442 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T10:34:10.442 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T10:34:10.442 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T10:34:10.443 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T10:34:10.443 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-10-14T10:34:10.443 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T10:34:10.443 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T10:34:10.444 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-10-14T10:34:10.444 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f0 2023-10-14T10:34:10.444 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T10:34:10.444 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-10-14T10:34:10.444 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f1 2023-10-14T10:34:10.445 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T10:34:10.445 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-10-14T10:34:10.445 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T10:34:10.445 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-10-14T10:34:10.446 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T10:34:10.446 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42360sec preferred_lft 42360sec 2023-10-14T10:34:10.446 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link 2023-10-14T10:34:10.446 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-10-14T10:34:10.447 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T10:34:10.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:10.448 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T10:34:10.449 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T10:34:10.449 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2023-10-14T10:34:10.449 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2023-10-14T10:34:10.450 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2023-10-14T10:34:10.450 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T10:34:10.450 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T10:34:10.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:10.909 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T10:34:10.994 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-10-14T10:34:10.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:10.998 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-10-14T10:34:11.050 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-10-14T10:34:11.050 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T10:34:11.050 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T10:34:11.051 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T10:34:11.051 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T10:34:11.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:11.051 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T10:34:11.052 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T10:34:11.052 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T10:34:11.052 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T10:34:11.053 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T10:34:11.053 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T10:34:11.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:11.787 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-14T10:34:11.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:11.847 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2023-10-14T10:34:11.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:11.901 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T10:34:11.902 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T10:34:11.902 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T10:34:11.902 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-14T10:34:11.903 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T10:34:12.045 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-14T10:34:12.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:12.046 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T10:34:12.046 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T10:34:12.047 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-14T10:34:12.047 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T10:34:12.047 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-14T10:34:12.047 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-14T10:34:12.048 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-14T10:34:12.048 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T10:34:12.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:12.349 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-10-14T10:34:12.349 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-10-14T10:34:12.350 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2023-10-14T10:34:12.350 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T10:34:12.350 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-10-14T10:34:12.519 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T10:34:12.519 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T10:34:12.570 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T10:34:12.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T10:34:12.571 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T10:34:12.665 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T10:34:12.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:12.666 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T10:34:12.806 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T10:34:12.806 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T10:34:12.807 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-10-14T10:34:13.306 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T10:34:13.307 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T10:34:13.307 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-10-14T10:34:13.307 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T10:34:13.307 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T10:34:13.339 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T10:34:13.339 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T10:34:13.339 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-10-14T10:34:13.339 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-10-14T10:34:13.339 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T10:34:13.340 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-10-14T10:34:13.340 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-10-14T10:34:13.340 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=452b10b4-f8ad-4e99-85d0-4d157f344356" will pass to kernel 2023-10-14T10:34:13.343 INFO:teuthology.orchestra.run.smithi092.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-10-14T10:34:13.343 INFO:teuthology.orchestra.run.smithi092.stdout: You just mounted a file system that supports labels which does not 2023-10-14T10:34:13.343 INFO:teuthology.orchestra.run.smithi092.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-10-14T10:34:13.343 INFO:teuthology.orchestra.run.smithi092.stdout: applications will generate AVC messages and not be allowed access to 2023-10-14T10:34:13.343 INFO:teuthology.orchestra.run.smithi092.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-10-14T10:34:13.347 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T10:34:13.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:13.347 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T10:34:13.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:13.439 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T10:34:13.498 INFO:teuthology.orchestra.run.smithi092.stdout:client4683 2023-10-14T10:34:13.499 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:34:13.499 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T10:34:13.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:13.546 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T10:34:13.648 INFO:teuthology.orchestra.run.smithi092.stdout:client4683 2023-10-14T10:34:13.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:13.649 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T10:34:13.705 INFO:teuthology.orchestra.run.smithi092.stdout:client4683 2023-10-14T10:34:13.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:13.705 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/452b10b4-f8ad-4e99-85d0-4d157f344356.client4683/status') 2023-10-14T10:34:13.791 INFO:teuthology.orchestra.run.smithi092.stdout:instance: client.4683 (3)172.21.15.92:0/33753206 2023-10-14T10:34:13.791 INFO:teuthology.orchestra.run.smithi092.stdout:blocklisted: false 2023-10-14T10:34:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records in 2023-10-14T10:34:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records out 2023-10-14T10:34:13.792 INFO:teuthology.orchestra.run.smithi092.stderr:68 bytes copied, 6.6317e-05 s, 1.0 MB/s 2023-10-14T10:34:13.795 INFO:teuthology.run_tasks:Running task exec... 2023-10-14T10:34:13.805 INFO:teuthology.task.exec:Executing custom commands... 2023-10-14T10:34:13.805 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:34:13.805 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/crash/warn_recent_interval 0' 2023-10-14T10:34:14.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.029+0000 7f3fef59e640 1 Processor -- start 2023-10-14T10:34:14.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.030+0000 7f3fef59e640 1 -- start start 2023-10-14T10:34:14.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.031+0000 7f3fef59e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3ff00c3f90 0x7f3ff00c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.031+0000 7f3fef59e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff00c8a20 con 0x7f3ff01513a0 2023-10-14T10:34:14.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.031+0000 7f3fef59e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff00c7b10 con 0x7f3ff0154830 2023-10-14T10:34:14.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.031+0000 7f3fef59e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff00c7df0 con 0x7f3ff00c3f90 2023-10-14T10:34:14.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.031+0000 7f3fee59c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3ff01513a0 0x7f3ff00c8eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47666/0 (socket says 172.21.15.8:47666) 2023-10-14T10:34:14.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.031+0000 7f3fee59c640 1 -- 172.21.15.8:0/1222030618 learned_addr learned my addr 172.21.15.8:0/1222030618 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:14.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.032+0000 7f3feed9d640 1 --2- 172.21.15.8:0/1222030618 >> v2:172.21.15.8:3300/0 conn(0x7f3ff00c3f90 0x7f3ff00c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.032+0000 7f3fed59a640 1 -- 172.21.15.8:0/1222030618 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204431163 0 0) 0x7f3ff00c8a20 con 0x7f3ff01513a0 2023-10-14T10:34:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.032+0000 7f3fed59a640 1 -- 172.21.15.8:0/1222030618 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fdc003520 con 0x7f3ff01513a0 2023-10-14T10:34:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.032+0000 7f3feed9d640 1 -- 172.21.15.8:0/1222030618 >> v1:172.21.15.92:6789/0 conn(0x7f3ff0154830 legacy=0x7f3ff0069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.032+0000 7f3feed9d640 1 -- 172.21.15.8:0/1222030618 >> v1:172.21.15.8:6789/0 conn(0x7f3ff01513a0 legacy=0x7f3ff00c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.032+0000 7f3feed9d640 1 -- 172.21.15.8:0/1222030618 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff00c83d0 con 0x7f3ff00c3f90 2023-10-14T10:34:14.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.033+0000 7f3feed9d640 1 --2- 172.21.15.8:0/1222030618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff00c3f90 0x7f3ff00c43b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80097a0 tx=0x7f3fe802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d55bcdf3aac0d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:14.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.034+0000 7f3fed59a640 1 -- 172.21.15.8:0/1222030618 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8031830 con 0x7f3ff00c3f90 2023-10-14T10:34:14.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.034+0000 7f3fed59a640 1 -- 172.21.15.8:0/1222030618 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe8031990 con 0x7f3ff00c3f90 2023-10-14T10:34:14.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.034+0000 7f3fed59a640 1 -- 172.21.15.8:0/1222030618 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8031d20 con 0x7f3ff00c3f90 2023-10-14T10:34:14.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.034+0000 7f3fef59e640 1 -- 172.21.15.8:0/1222030618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff00c3f90 msgr2=0x7f3ff00c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.034+0000 7f3fef59e640 1 --2- 172.21.15.8:0/1222030618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff00c3f90 0x7f3ff00c43b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80097a0 tx=0x7f3fe802b8d0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.034+0000 7f3fef59e640 1 -- 172.21.15.8:0/1222030618 shutdown_connections 2023-10-14T10:34:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.034+0000 7f3fef59e640 1 --2- 172.21.15.8:0/1222030618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff00c3f90 0x7f3ff00c43b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.034+0000 7f3fef59e640 1 -- 172.21.15.8:0/1222030618 >> 172.21.15.8:0/1222030618 conn(0x7f3ff00ab180 msgr2=0x7f3ff00ab590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.035+0000 7f3fef59e640 1 -- 172.21.15.8:0/1222030618 shutdown_connections 2023-10-14T10:34:14.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.035+0000 7f3fef59e640 1 -- 172.21.15.8:0/1222030618 wait complete. 2023-10-14T10:34:14.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.036+0000 7f3fef59e640 1 Processor -- start 2023-10-14T10:34:14.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.036+0000 7f3fef59e640 1 -- start start 2023-10-14T10:34:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.037+0000 7f3fef59e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff00c3f90 0x7f3ff00bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.037+0000 7f3fef59e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3ff01513a0 0x7f3ff0153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.037+0000 7f3fef59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ff0154830 0x7f3ff0149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.037+0000 7f3fef59e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff0157e20 con 0x7f3ff00c3f90 2023-10-14T10:34:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.037+0000 7f3fef59e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff00be8f0 con 0x7f3ff0154830 2023-10-14T10:34:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.037+0000 7f3fef59e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff00be610 con 0x7f3ff01513a0 2023-10-14T10:34:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.038+0000 7f3fee59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff00c3f90 0x7f3ff00bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.038+0000 7f3fee59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff00c3f90 0x7f3ff00bfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57578/0 (socket says 172.21.15.8:57578) 2023-10-14T10:34:14.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.038+0000 7f3fee59c640 1 -- 172.21.15.8:0/1147673303 learned_addr learned my addr 172.21.15.8:0/1147673303 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:14.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.038+0000 7f3feed9d640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ff0154830 0x7f3ff0149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.038+0000 7f3fedd9b640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3ff01513a0 0x7f3ff0153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.038+0000 7f3fee59c640 1 -- 172.21.15.8:0/1147673303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3ff01513a0 msgr2=0x7f3ff0153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.038+0000 7f3fee59c640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3ff01513a0 0x7f3ff0153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.038+0000 7f3fee59c640 1 -- 172.21.15.8:0/1147673303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ff0154830 msgr2=0x7f3ff0149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.038+0000 7f3fee59c640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ff0154830 0x7f3ff0149720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.038+0000 7f3fee59c640 1 -- 172.21.15.8:0/1147673303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8009400 con 0x7f3ff00c3f90 2023-10-14T10:34:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.038+0000 7f3fedd9b640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3ff01513a0 0x7f3ff0153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.039+0000 7f3fee59c640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff00c3f90 0x7f3ff00bfed0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000cbc0 tx=0x7f3fe000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.039+0000 7f3fe6ffd640 1 -- 172.21.15.8:0/1147673303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000ad40 con 0x7f3ff00c3f90 2023-10-14T10:34:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.039+0000 7f3fe6ffd640 1 -- 172.21.15.8:0/1147673303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe0012400 con 0x7f3ff00c3f90 2023-10-14T10:34:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.039+0000 7f3fef59e640 1 -- 172.21.15.8:0/1147673303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff0157760 con 0x7f3ff00c3f90 2023-10-14T10:34:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.039+0000 7f3fe6ffd640 1 -- 172.21.15.8:0/1147673303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000aea0 con 0x7f3ff00c3f90 2023-10-14T10:34:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.039+0000 7f3fef59e640 1 -- 172.21.15.8:0/1147673303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff0153650 con 0x7f3ff00c3f90 2023-10-14T10:34:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.040+0000 7f3fef59e640 1 -- 172.21.15.8:0/1147673303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff004e9b0 con 0x7f3ff00c3f90 2023-10-14T10:34:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.041+0000 7f3fe6ffd640 1 -- 172.21.15.8:0/1147673303 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3fe0007070 con 0x7f3ff00c3f90 2023-10-14T10:34:14.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.042+0000 7f3fe6ffd640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3fd006ae70 0x7f3fd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.042+0000 7f3fe6ffd640 1 -- 172.21.15.8:0/1147673303 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fe0089540 con 0x7f3ff00c3f90 2023-10-14T10:34:14.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.042+0000 7f3fedd9b640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3fd006ae70 0x7f3fd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.043+0000 7f3fedd9b640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3fd006ae70 0x7f3fd006d330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3ff014cf60 tx=0x7f3fd8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:14.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.048+0000 7f3fe6ffd640 1 -- 172.21.15.8:0/1147673303 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3fe0054730 con 0x7f3ff00c3f90 2023-10-14T10:34:14.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.242+0000 7f3fef59e640 1 -- 172.21.15.8:0/1147673303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/crash/warn_recent_interval}] v 0) v1 -- 0x7f3ff00aade0 con 0x7f3ff00c3f90 2023-10-14T10:34:14.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.247+0000 7f3fe6ffd640 1 -- 172.21.15.8:0/1147673303 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/crash/warn_recent_interval}]=0 v10)=0 v10) v1 ==== 128+0+0 (secure 0 0 0) 0x7f3fe0057d50 con 0x7f3ff00c3f90 2023-10-14T10:34:14.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.251+0000 7f3fef59e640 1 -- 172.21.15.8:0/1147673303 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3fd006ae70 msgr2=0x7f3fd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.251+0000 7f3fef59e640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3fd006ae70 0x7f3fd006d330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3ff014cf60 tx=0x7f3fd8009040 comp rx=0 tx=0).stop 2023-10-14T10:34:14.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.251+0000 7f3fef59e640 1 -- 172.21.15.8:0/1147673303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff00c3f90 msgr2=0x7f3ff00bfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.251+0000 7f3fef59e640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff00c3f90 0x7f3ff00bfed0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000cbc0 tx=0x7f3fe000a430 comp rx=0 tx=0).stop 2023-10-14T10:34:14.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.251+0000 7f3fef59e640 1 -- 172.21.15.8:0/1147673303 shutdown_connections 2023-10-14T10:34:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.251+0000 7f3fef59e640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3fd006ae70 0x7f3fd006d330 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.251+0000 7f3fef59e640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ff0154830 0x7f3ff0149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.251+0000 7f3fef59e640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3ff01513a0 0x7f3ff0153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.251+0000 7f3fef59e640 1 --2- 172.21.15.8:0/1147673303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ff00c3f90 0x7f3ff00bfed0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.251+0000 7f3fef59e640 1 -- 172.21.15.8:0/1147673303 >> 172.21.15.8:0/1147673303 conn(0x7f3ff00ab180 msgr2=0x7f3ff00a99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:14.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.252+0000 7f3fef59e640 1 -- 172.21.15.8:0/1147673303 shutdown_connections 2023-10-14T10:34:14.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.252+0000 7f3fef59e640 1 -- 172.21.15.8:0/1147673303 wait complete. 2023-10-14T10:34:14.274 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-14T10:34:14.289 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:14.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.514+0000 7f1416878640 1 Processor -- start 2023-10-14T10:34:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.515+0000 7f1416878640 1 -- start start 2023-10-14T10:34:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.516+0000 7f1416878640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14100c2380 0x7f1410070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.516+0000 7f1416878640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14100719e0 con 0x7f14100c06f0 2023-10-14T10:34:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.516+0000 7f1416878640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1410071cc0 con 0x7f1410071550 2023-10-14T10:34:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.516+0000 7f1416878640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1410071190 con 0x7f14100c2380 2023-10-14T10:34:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.516+0000 7f1416077640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f14100c06f0 0x7f14101511a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47670/0 (socket says 172.21.15.8:47670) 2023-10-14T10:34:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.516+0000 7f1416077640 1 -- 172.21.15.8:0/1759716995 learned_addr learned my addr 172.21.15.8:0/1759716995 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1415876640 1 --2- 172.21.15.8:0/1759716995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14100c2380 0x7f1410070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293169077 0 0) 0x7f14100719e0 con 0x7f14100c06f0 2023-10-14T10:34:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13fc003520 con 0x7f14100c06f0 2023-10-14T10:34:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1387020410 0 0) 0x7f13fc003520 con 0x7f14100c06f0 2023-10-14T10:34:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14100c2380 msgr2=0x7f1410070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 --2- 172.21.15.8:0/1759716995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14100c2380 0x7f1410070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 >> v1:172.21.15.92:6789/0 conn(0x7f1410071550 legacy=0x7f14100a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1410071fa0 con 0x7f14100c06f0 2023-10-14T10:34:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f14080019f0 con 0x7f14100c06f0 2023-10-14T10:34:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 >> v1:172.21.15.8:6789/0 conn(0x7f14100c06f0 legacy=0x7f14101511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 --2- 172.21.15.8:0/1759716995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13fc0039a0 0x7f13fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 --2- 172.21.15.8:0/1759716995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0047c0 0x7f13fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 --2- 172.21.15.8:0/1759716995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14100c2380 0x7f13fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1410071190 con 0x7f13fc0039a0 2023-10-14T10:34:14.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.517+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc00ba60 con 0x7f13fc0047c0 2023-10-14T10:34:14.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.518+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc00bc20 con 0x7f14100c2380 2023-10-14T10:34:14.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.518+0000 7f1415876640 1 --2- 172.21.15.8:0/1759716995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13fc0039a0 0x7f13fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.518+0000 7f1415876640 1 -- 172.21.15.8:0/1759716995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14100c2380 msgr2=0x7f13fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:14.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.518+0000 7f1415876640 1 --2- 172.21.15.8:0/1759716995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14100c2380 0x7f13fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.518+0000 7f1415876640 1 -- 172.21.15.8:0/1759716995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0047c0 msgr2=0x7f13fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:14.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.518+0000 7f1415876640 1 --2- 172.21.15.8:0/1759716995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13fc0047c0 0x7f13fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.518+0000 7f1415876640 1 -- 172.21.15.8:0/1759716995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc003520 con 0x7f13fc0039a0 2023-10-14T10:34:14.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.519+0000 7f1415876640 1 --2- 172.21.15.8:0/1759716995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13fc0039a0 0x7f13fc003dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f140c009a90 tx=0x7f13fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9981b789c09f99b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.519+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c02c6b0 con 0x7f13fc0039a0 2023-10-14T10:34:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.520+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c02c810 con 0x7f13fc0039a0 2023-10-14T10:34:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.520+0000 7f1414874640 1 -- 172.21.15.8:0/1759716995 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c02cba0 con 0x7f13fc0039a0 2023-10-14T10:34:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.520+0000 7f1416878640 1 -- 172.21.15.8:0/1759716995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13fc0039a0 msgr2=0x7f13fc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.520+0000 7f1416878640 1 --2- 172.21.15.8:0/1759716995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13fc0039a0 0x7f13fc003dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f140c009a90 tx=0x7f13fc0057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.520+0000 7f1416077640 1 -- 172.21.15.8:0/1759716995 reap_dead start 2023-10-14T10:34:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.520+0000 7f1416878640 1 -- 172.21.15.8:0/1759716995 shutdown_connections 2023-10-14T10:34:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.520+0000 7f1416878640 1 -- 172.21.15.8:0/1759716995 >> 172.21.15.8:0/1759716995 conn(0x7f141006a200 msgr2=0x7f141006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.520+0000 7f1416878640 1 -- 172.21.15.8:0/1759716995 shutdown_connections 2023-10-14T10:34:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.520+0000 7f1416878640 1 -- 172.21.15.8:0/1759716995 wait complete. 2023-10-14T10:34:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.522+0000 7f1416878640 1 Processor -- start 2023-10-14T10:34:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.522+0000 7f1416878640 1 -- start start 2023-10-14T10:34:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.523+0000 7f1416878640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13fc0039a0 0x7f1410147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.523+0000 7f1416878640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f141006ca20 0x7f1410150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.523+0000 7f1416878640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14100a8280 0x7f14101e8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.523+0000 7f1416878640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14100c4c50 con 0x7f13fc0039a0 2023-10-14T10:34:14.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.523+0000 7f1416878640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141006d7c0 con 0x7f141006ca20 2023-10-14T10:34:14.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.523+0000 7f1416878640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14101496f0 con 0x7f14100a8280 2023-10-14T10:34:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.523+0000 7f1415876640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13fc0039a0 0x7f1410147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.523+0000 7f1415876640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13fc0039a0 0x7f1410147150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57600/0 (socket says 172.21.15.8:57600) 2023-10-14T10:34:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.523+0000 7f1415876640 1 -- 172.21.15.8:0/3007714419 learned_addr learned my addr 172.21.15.8:0/3007714419 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.524+0000 7f1415876640 1 -- 172.21.15.8:0/3007714419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14100a8280 msgr2=0x7f14101e8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.524+0000 7f1416077640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14100a8280 0x7f14101e8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.524+0000 7f1415876640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14100a8280 0x7f14101e8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.524+0000 7f1415075640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f141006ca20 0x7f1410150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.524+0000 7f1415876640 1 -- 172.21.15.8:0/3007714419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f141006ca20 msgr2=0x7f1410150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.524+0000 7f1415876640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f141006ca20 0x7f1410150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.524+0000 7f1415876640 1 -- 172.21.15.8:0/3007714419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100738f0 con 0x7f13fc0039a0 2023-10-14T10:34:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.524+0000 7f1415075640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f141006ca20 0x7f1410150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.524+0000 7f1415876640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13fc0039a0 0x7f1410147150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f140c037040 tx=0x7f140c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.525+0000 7f14067fc640 1 -- 172.21.15.8:0/3007714419 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c003810 con 0x7f13fc0039a0 2023-10-14T10:34:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.525+0000 7f14067fc640 1 -- 172.21.15.8:0/3007714419 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c003970 con 0x7f13fc0039a0 2023-10-14T10:34:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.525+0000 7f14067fc640 1 -- 172.21.15.8:0/3007714419 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c003d20 con 0x7f13fc0039a0 2023-10-14T10:34:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.525+0000 7f1416878640 1 -- 172.21.15.8:0/3007714419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1410149c20 con 0x7f13fc0039a0 2023-10-14T10:34:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.525+0000 7f1416878640 1 -- 172.21.15.8:0/3007714419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141006d170 con 0x7f13fc0039a0 2023-10-14T10:34:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.526+0000 7f1416878640 1 -- 172.21.15.8:0/3007714419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141004e9b0 con 0x7f13fc0039a0 2023-10-14T10:34:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.527+0000 7f14067fc640 1 -- 172.21.15.8:0/3007714419 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f140c040450 con 0x7f13fc0039a0 2023-10-14T10:34:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.528+0000 7f14067fc640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f13f406aea0 0x7f13f406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.528+0000 7f14067fc640 1 -- 172.21.15.8:0/3007714419 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f140c0ab4a0 con 0x7f13fc0039a0 2023-10-14T10:34:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.528+0000 7f1415075640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f13f406aea0 0x7f13f406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.529+0000 7f1415075640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f13f406aea0 0x7f13f406d360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f14100c51c0 tx=0x7f1400009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.532+0000 7f14067fc640 1 -- 172.21.15.8:0/3007714419 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f140c076660 con 0x7f13fc0039a0 2023-10-14T10:34:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.729+0000 7f1416878640 1 -- 172.21.15.8:0/3007714419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14100734a0 con 0x7f13fc0039a0 2023-10-14T10:34:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.730+0000 7f14067fc640 1 -- 172.21.15.8:0/3007714419 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7f140c0044e0 con 0x7f13fc0039a0 2023-10-14T10:34:14.733 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:14.733 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:14.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.733+0000 7f1416878640 1 -- 172.21.15.8:0/3007714419 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f13f406aea0 msgr2=0x7f13f406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.733+0000 7f1416878640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f13f406aea0 0x7f13f406d360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f14100c51c0 tx=0x7f1400009040 comp rx=0 tx=0).stop 2023-10-14T10:34:14.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.733+0000 7f1416878640 1 -- 172.21.15.8:0/3007714419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13fc0039a0 msgr2=0x7f1410147150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.733+0000 7f1416878640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13fc0039a0 0x7f1410147150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f140c037040 tx=0x7f140c004730 comp rx=0 tx=0).stop 2023-10-14T10:34:14.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.733+0000 7f1416878640 1 -- 172.21.15.8:0/3007714419 shutdown_connections 2023-10-14T10:34:14.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.733+0000 7f1416878640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f13f406aea0 0x7f13f406d360 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.733+0000 7f1416878640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14100a8280 0x7f14101e8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.733+0000 7f1416878640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f141006ca20 0x7f1410150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.733+0000 7f1416878640 1 --2- 172.21.15.8:0/3007714419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13fc0039a0 0x7f1410147150 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.733+0000 7f1416878640 1 -- 172.21.15.8:0/3007714419 >> 172.21.15.8:0/3007714419 conn(0x7f141006a200 msgr2=0x7f141014e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:14.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.733+0000 7f1416878640 1 -- 172.21.15.8:0/3007714419 shutdown_connections 2023-10-14T10:34:14.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.733+0000 7f1416878640 1 -- 172.21.15.8:0/3007714419 wait complete. 2023-10-14T10:34:14.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T10:33:44.913451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T10:33:46.397320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:34:14.756 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:34:14.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.978+0000 7fa92cbd7640 1 Processor -- start 2023-10-14T10:34:14.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.978+0000 7fa92cbd7640 1 -- start start 2023-10-14T10:34:14.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.979+0000 7fa92cbd7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa9280c06f0 0x7fa9280c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.980+0000 7fa92cbd7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa928154c30 con 0x7fa9280badd0 2023-10-14T10:34:14.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.980+0000 7fa92cbd7640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa928154f10 con 0x7fa9280c01a0 2023-10-14T10:34:14.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.980+0000 7fa92cbd7640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92806ce40 con 0x7fa9280c06f0 2023-10-14T10:34:14.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.980+0000 7fa926d9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa9280badd0 0x7fa92815ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47674/0 (socket says 172.21.15.8:47674) 2023-10-14T10:34:14.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.980+0000 7fa926d9d640 1 -- 172.21.15.8:0/1841880759 learned_addr learned my addr 172.21.15.8:0/1841880759 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:14.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.980+0000 7fa92659c640 1 --2- 172.21.15.8:0/1841880759 >> v2:172.21.15.92:3300/0 conn(0x7fa9280c06f0 0x7fa9280c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382792999 0 0) 0x7fa928154c30 con 0x7fa9280badd0 2023-10-14T10:34:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa914003520 con 0x7fa9280badd0 2023-10-14T10:34:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 789387852 0 0) 0x7fa914003520 con 0x7fa9280badd0 2023-10-14T10:34:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 >> v2:172.21.15.92:3300/0 conn(0x7fa9280c06f0 msgr2=0x7fa9280c0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:14.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 --2- 172.21.15.8:0/1841880759 >> v2:172.21.15.92:3300/0 conn(0x7fa9280c06f0 0x7fa9280c0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 >> v1:172.21.15.92:6789/0 conn(0x7fa9280c01a0 legacy=0x7fa9280c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92806d120 con 0x7fa9280badd0 2023-10-14T10:34:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fa920001670 con 0x7fa9280badd0 2023-10-14T10:34:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 >> v1:172.21.15.8:6789/0 conn(0x7fa9280badd0 legacy=0x7fa92815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 --2- 172.21.15.8:0/1841880759 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa9140039c0 0x7fa914003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 --2- 172.21.15.8:0/1841880759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9140047c0 0x7fa914004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 --2- 172.21.15.8:0/1841880759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa914005180 0x7fa91400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92806ce40 con 0x7fa9140047c0 2023-10-14T10:34:14.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91400c080 con 0x7fa914005180 2023-10-14T10:34:14.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91400c240 con 0x7fa9140039c0 2023-10-14T10:34:14.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.981+0000 7fa925d9b640 1 --2- 172.21.15.8:0/1841880759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9140047c0 0x7fa914004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.982+0000 7fa92659c640 1 --2- 172.21.15.8:0/1841880759 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa9140039c0 0x7fa914003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.982+0000 7fa926d9d640 1 --2- 172.21.15.8:0/1841880759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa914005180 0x7fa91400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.982+0000 7fa925d9b640 1 -- 172.21.15.8:0/1841880759 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa9140039c0 msgr2=0x7fa914003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:14.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.982+0000 7fa925d9b640 1 --2- 172.21.15.8:0/1841880759 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa9140039c0 0x7fa914003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.982+0000 7fa925d9b640 1 -- 172.21.15.8:0/1841880759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa914005180 msgr2=0x7fa91400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:14.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.982+0000 7fa925d9b640 1 --2- 172.21.15.8:0/1841880759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa914005180 0x7fa91400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.982+0000 7fa925d9b640 1 -- 172.21.15.8:0/1841880759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914003520 con 0x7fa9140047c0 2023-10-14T10:34:14.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.982+0000 7fa926d9d640 1 -- 172.21.15.8:0/1841880759 reap_dead start 2023-10-14T10:34:14.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.983+0000 7fa925d9b640 1 --2- 172.21.15.8:0/1841880759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9140047c0 0x7fa914004c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa910001750 tx=0x7fa9140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88479bf389830638 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:14.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.983+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9100052d0 con 0x7fa9140047c0 2023-10-14T10:34:14.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.983+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91002e050 con 0x7fa9140047c0 2023-10-14T10:34:14.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.984+0000 7fa92559a640 1 -- 172.21.15.8:0/1841880759 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910003830 con 0x7fa9140047c0 2023-10-14T10:34:14.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.984+0000 7fa92cbd7640 1 -- 172.21.15.8:0/1841880759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9140047c0 msgr2=0x7fa914004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.984+0000 7fa92cbd7640 1 --2- 172.21.15.8:0/1841880759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9140047c0 0x7fa914004c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa910001750 tx=0x7fa9140057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.984+0000 7fa92cbd7640 1 -- 172.21.15.8:0/1841880759 shutdown_connections 2023-10-14T10:34:14.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.984+0000 7fa92cbd7640 1 --2- 172.21.15.8:0/1841880759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9140047c0 0x7fa914004c40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.984+0000 7fa92cbd7640 1 -- 172.21.15.8:0/1841880759 >> 172.21.15.8:0/1841880759 conn(0x7fa928069de0 msgr2=0x7fa92806a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:14.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.984+0000 7fa92cbd7640 1 -- 172.21.15.8:0/1841880759 shutdown_connections 2023-10-14T10:34:14.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.984+0000 7fa92cbd7640 1 -- 172.21.15.8:0/1841880759 wait complete. 2023-10-14T10:34:14.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.986+0000 7fa92cbd7640 1 Processor -- start 2023-10-14T10:34:14.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.986+0000 7fa92cbd7640 1 -- start start 2023-10-14T10:34:14.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.987+0000 7fa92cbd7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9140047c0 0x7fa9280aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.987+0000 7fa92cbd7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa92814b8f0 0x7fa928070880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.987+0000 7fa92cbd7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa928070dc0 0x7fa9280be3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:14.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.987+0000 7fa92cbd7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280a8df0 con 0x7fa928070dc0 2023-10-14T10:34:14.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.987+0000 7fa92cbd7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280bcfb0 con 0x7fa9140047c0 2023-10-14T10:34:14.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.987+0000 7fa92cbd7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280bc820 con 0x7fa92814b8f0 2023-10-14T10:34:14.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.987+0000 7fa926d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa928070dc0 0x7fa9280be3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.987+0000 7fa926d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa928070dc0 0x7fa9280be3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57616/0 (socket says 172.21.15.8:57616) 2023-10-14T10:34:14.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.987+0000 7fa926d9d640 1 -- 172.21.15.8:0/4049485829 learned_addr learned my addr 172.21.15.8:0/4049485829 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:14.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa925d9b640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa92814b8f0 0x7fa928070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa92659c640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9140047c0 0x7fa9280aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:14.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa926d9d640 1 -- 172.21.15.8:0/4049485829 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa92814b8f0 msgr2=0x7fa928070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa926d9d640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa92814b8f0 0x7fa928070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa926d9d640 1 -- 172.21.15.8:0/4049485829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9140047c0 msgr2=0x7fa9280aaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:14.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa926d9d640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9140047c0 0x7fa9280aaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:14.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa926d9d640 1 -- 172.21.15.8:0/4049485829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9280ba750 con 0x7fa928070dc0 2023-10-14T10:34:14.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa925d9b640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa92814b8f0 0x7fa928070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:14.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa92659c640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9140047c0 0x7fa9280aaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:14.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa926d9d640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa928070dc0 0x7fa9280be3f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa928072440 tx=0x7fa92000e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:14.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa91effd640 1 -- 172.21.15.8:0/4049485829 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920010510 con 0x7fa928070dc0 2023-10-14T10:34:14.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa91effd640 1 -- 172.21.15.8:0/4049485829 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa920010690 con 0x7fa928070dc0 2023-10-14T10:34:14.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.988+0000 7fa91effd640 1 -- 172.21.15.8:0/4049485829 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920010a40 con 0x7fa928070dc0 2023-10-14T10:34:14.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.989+0000 7fa92cbd7640 1 -- 172.21.15.8:0/4049485829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9280bca70 con 0x7fa928070dc0 2023-10-14T10:34:14.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.989+0000 7fa92cbd7640 1 -- 172.21.15.8:0/4049485829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9280a8a10 con 0x7fa928070dc0 2023-10-14T10:34:14.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.990+0000 7fa92cbd7640 1 -- 172.21.15.8:0/4049485829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9280bbf80 con 0x7fa928070dc0 2023-10-14T10:34:15.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.991+0000 7fa91effd640 1 -- 172.21.15.8:0/4049485829 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa920010ba0 con 0x7fa928070dc0 2023-10-14T10:34:15.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.992+0000 7fa91effd640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa90806ae70 0x7fa90806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.992+0000 7fa91effd640 1 -- 172.21.15.8:0/4049485829 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa920088c90 con 0x7fa928070dc0 2023-10-14T10:34:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.992+0000 7fa92659c640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa90806ae70 0x7fa90806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.993+0000 7fa92659c640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa90806ae70 0x7fa90806d330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9280639b0 tx=0x7fa91800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:15.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:14.996+0000 7fa91effd640 1 -- 172.21.15.8:0/4049485829 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa920057860 con 0x7fa928070dc0 2023-10-14T10:34:15.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.190+0000 7fa92cbd7640 1 -- 172.21.15.8:0/4049485829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9280a8f30 con 0x7fa928070dc0 2023-10-14T10:34:15.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.190+0000 7fa91effd640 1 -- 172.21.15.8:0/4049485829 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9280a8f30 con 0x7fa928070dc0 2023-10-14T10:34:15.193 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:34:15.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.193+0000 7fa92cbd7640 1 -- 172.21.15.8:0/4049485829 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa90806ae70 msgr2=0x7fa90806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:15.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.193+0000 7fa92cbd7640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa90806ae70 0x7fa90806d330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9280639b0 tx=0x7fa91800b040 comp rx=0 tx=0).stop 2023-10-14T10:34:15.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.193+0000 7fa92cbd7640 1 -- 172.21.15.8:0/4049485829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa928070dc0 msgr2=0x7fa9280be3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:15.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.193+0000 7fa92cbd7640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa928070dc0 0x7fa9280be3f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa928072440 tx=0x7fa92000e960 comp rx=0 tx=0).stop 2023-10-14T10:34:15.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.193+0000 7fa92cbd7640 1 -- 172.21.15.8:0/4049485829 shutdown_connections 2023-10-14T10:34:15.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.193+0000 7fa92cbd7640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa90806ae70 0x7fa90806d330 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.193+0000 7fa92cbd7640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa928070dc0 0x7fa9280be3f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.193+0000 7fa92cbd7640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa92814b8f0 0x7fa928070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.193+0000 7fa92cbd7640 1 --2- 172.21.15.8:0/4049485829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa9140047c0 0x7fa9280aaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.193+0000 7fa92cbd7640 1 -- 172.21.15.8:0/4049485829 >> 172.21.15.8:0/4049485829 conn(0x7fa928069de0 msgr2=0x7fa9280c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:15.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.193+0000 7fa92cbd7640 1 -- 172.21.15.8:0/4049485829 shutdown_connections 2023-10-14T10:34:15.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.193+0000 7fa92cbd7640 1 -- 172.21.15.8:0/4049485829 wait complete. 2023-10-14T10:34:15.215 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T10:34:15.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.428+0000 7f4384f47640 1 Processor -- start 2023-10-14T10:34:15.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.428+0000 7f4384f47640 1 -- start start 2023-10-14T10:34:15.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.430+0000 7f4384f47640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f438006fb10 0x7f43800c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.430+0000 7f4384f47640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f43800c2670 0x7f43800bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.430+0000 7f4384f47640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4380152ac0 con 0x7f438013af90 2023-10-14T10:34:15.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.430+0000 7f4384f47640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4380151eb0 con 0x7f438006fb10 2023-10-14T10:34:15.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.430+0000 7f4384f47640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4380152190 con 0x7f43800c2670 2023-10-14T10:34:15.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.430+0000 7f4377fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f438006fb10 0x7f43800c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:15.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.430+0000 7f4377fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f438006fb10 0x7f43800c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57626/0 (socket says 172.21.15.8:57626) 2023-10-14T10:34:15.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.430+0000 7f4377fff640 1 -- 172.21.15.8:0/1727308540 learned_addr learned my addr 172.21.15.8:0/1727308540 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:15.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.431+0000 7f437ffff640 1 --2- 172.21.15.8:0/1727308540 >> v2:172.21.15.92:3300/0 conn(0x7f43800c2670 0x7f43800bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:15.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.431+0000 7f4377fff640 1 -- 172.21.15.8:0/1727308540 >> v2:172.21.15.92:3300/0 conn(0x7f43800c2670 msgr2=0x7f43800bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:15.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.431+0000 7f4377fff640 1 --2- 172.21.15.8:0/1727308540 >> v2:172.21.15.92:3300/0 conn(0x7f43800c2670 0x7f43800bfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.431+0000 7f4377fff640 1 -- 172.21.15.8:0/1727308540 >> v1:172.21.15.92:6789/0 conn(0x7f438013af90 legacy=0x7f43800a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:15.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.431+0000 7f4377fff640 1 -- 172.21.15.8:0/1727308540 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4380152470 con 0x7f438006fb10 2023-10-14T10:34:15.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.432+0000 7f4377fff640 1 --2- 172.21.15.8:0/1727308540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f438006fb10 0x7f43800c2130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f438006e2b0 tx=0x7f436802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c6333e2d869230 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:15.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.433+0000 7f437effd640 1 -- 172.21.15.8:0/1727308540 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43680317e0 con 0x7f438006fb10 2023-10-14T10:34:15.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.433+0000 7f437effd640 1 -- 172.21.15.8:0/1727308540 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4368031940 con 0x7f438006fb10 2023-10-14T10:34:15.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.433+0000 7f437effd640 1 -- 172.21.15.8:0/1727308540 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368031cd0 con 0x7f438006fb10 2023-10-14T10:34:15.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.433+0000 7f4384f47640 1 -- 172.21.15.8:0/1727308540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f438006fb10 msgr2=0x7f43800c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:15.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.433+0000 7f4384f47640 1 --2- 172.21.15.8:0/1727308540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f438006fb10 0x7f43800c2130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f438006e2b0 tx=0x7f436802b880 comp rx=0 tx=0).stop 2023-10-14T10:34:15.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.434+0000 7f4384f47640 1 -- 172.21.15.8:0/1727308540 shutdown_connections 2023-10-14T10:34:15.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.434+0000 7f4384f47640 1 --2- 172.21.15.8:0/1727308540 >> v2:172.21.15.92:3300/0 conn(0x7f43800c2670 0x7f43800bfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.434+0000 7f4384f47640 1 --2- 172.21.15.8:0/1727308540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f438006fb10 0x7f43800c2130 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.434+0000 7f4384f47640 1 -- 172.21.15.8:0/1727308540 >> 172.21.15.8:0/1727308540 conn(0x7f438006a200 msgr2=0x7f438006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:15.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.434+0000 7f4384f47640 1 -- 172.21.15.8:0/1727308540 shutdown_connections 2023-10-14T10:34:15.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.434+0000 7f4384f47640 1 -- 172.21.15.8:0/1727308540 wait complete. 2023-10-14T10:34:15.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.436+0000 7f4384f47640 1 Processor -- start 2023-10-14T10:34:15.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.436+0000 7f4384f47640 1 -- start start 2023-10-14T10:34:15.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.437+0000 7f4384f47640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438006fb10 0x7f438014ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.437+0000 7f4384f47640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43800c2670 0x7f43801e8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.437+0000 7f4384f47640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f438013af90 0x7f43800ba7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.437+0000 7f4384f47640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43800c3870 con 0x7f43800c2670 2023-10-14T10:34:15.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.437+0000 7f4384f47640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43800c4140 con 0x7f438006fb10 2023-10-14T10:34:15.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.437+0000 7f4384f47640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43800ba230 con 0x7f438013af90 2023-10-14T10:34:15.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.438+0000 7f4377fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43800c2670 0x7f43801e8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:15.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.438+0000 7f4377fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43800c2670 0x7f43801e8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57638/0 (socket says 172.21.15.8:57638) 2023-10-14T10:34:15.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.438+0000 7f4377fff640 1 -- 172.21.15.8:0/1474408643 learned_addr learned my addr 172.21.15.8:0/1474408643 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:15.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.438+0000 7f437f7fe640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438006fb10 0x7f438014ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:15.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.438+0000 7f437ffff640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f438013af90 0x7f43800ba7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:15.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.438+0000 7f4377fff640 1 -- 172.21.15.8:0/1474408643 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f438013af90 msgr2=0x7f43800ba7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:15.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.438+0000 7f4377fff640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f438013af90 0x7f43800ba7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.438+0000 7f4377fff640 1 -- 172.21.15.8:0/1474408643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438006fb10 msgr2=0x7f438014ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.438+0000 7f4377fff640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438006fb10 0x7f438014ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.438+0000 7f4377fff640 1 -- 172.21.15.8:0/1474408643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680094d0 con 0x7f43800c2670 2023-10-14T10:34:15.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.439+0000 7f4377fff640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43800c2670 0x7f43801e8e90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4368000c00 tx=0x7f43680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:15.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.439+0000 7f437cff9640 1 -- 172.21.15.8:0/1474408643 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368032880 con 0x7f43800c2670 2023-10-14T10:34:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.439+0000 7f437cff9640 1 -- 172.21.15.8:0/1474408643 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43680329e0 con 0x7f43800c2670 2023-10-14T10:34:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.439+0000 7f437cff9640 1 -- 172.21.15.8:0/1474408643 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368032d90 con 0x7f43800c2670 2023-10-14T10:34:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.439+0000 7f4384f47640 1 -- 172.21.15.8:0/1474408643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43801e9980 con 0x7f43800c2670 2023-10-14T10:34:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.439+0000 7f4384f47640 1 -- 172.21.15.8:0/1474408643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43800c3d60 con 0x7f43800c2670 2023-10-14T10:34:15.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.441+0000 7f4384f47640 1 -- 172.21.15.8:0/1474408643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43800619f0 con 0x7f43800c2670 2023-10-14T10:34:15.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.442+0000 7f437cff9640 1 -- 172.21.15.8:0/1474408643 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f43680453f0 con 0x7f43800c2670 2023-10-14T10:34:15.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.442+0000 7f437cff9640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f436006ae70 0x7f436006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.443+0000 7f437cff9640 1 -- 172.21.15.8:0/1474408643 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43680ab8b0 con 0x7f43800c2670 2023-10-14T10:34:15.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.443+0000 7f437f7fe640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f436006ae70 0x7f436006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:15.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.444+0000 7f437f7fe640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f436006ae70 0x7f436006d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4370006fd0 tx=0x7f4370008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:15.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.447+0000 7f437cff9640 1 -- 172.21.15.8:0/1474408643 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4368076a70 con 0x7f43800c2670 2023-10-14T10:34:15.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.639+0000 7f4384f47640 1 -- 172.21.15.8:0/1474408643 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f438014f9f0 con 0x7f43800c2670 2023-10-14T10:34:15.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.640+0000 7f437cff9640 1 -- 172.21.15.8:0/1474408643 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f436807a090 con 0x7f43800c2670 2023-10-14T10:34:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T10:34:15.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.643+0000 7f4384f47640 1 -- 172.21.15.8:0/1474408643 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f436006ae70 msgr2=0x7f436006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:15.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.643+0000 7f4384f47640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f436006ae70 0x7f436006d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4370006fd0 tx=0x7f4370008040 comp rx=0 tx=0).stop 2023-10-14T10:34:15.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.643+0000 7f4384f47640 1 -- 172.21.15.8:0/1474408643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43800c2670 msgr2=0x7f43801e8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:15.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.643+0000 7f4384f47640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43800c2670 0x7f43801e8e90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4368000c00 tx=0x7f43680046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.643+0000 7f4384f47640 1 -- 172.21.15.8:0/1474408643 shutdown_connections 2023-10-14T10:34:15.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.643+0000 7f4384f47640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f436006ae70 0x7f436006d330 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.643+0000 7f4384f47640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f438013af90 0x7f43800ba7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.643+0000 7f4384f47640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43800c2670 0x7f43801e8e90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.643+0000 7f4384f47640 1 --2- 172.21.15.8:0/1474408643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f438006fb10 0x7f438014ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.643+0000 7f4384f47640 1 -- 172.21.15.8:0/1474408643 >> 172.21.15.8:0/1474408643 conn(0x7f438006a200 msgr2=0x7f4380139090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:15.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.643+0000 7f4384f47640 1 -- 172.21.15.8:0/1474408643 shutdown_connections 2023-10-14T10:34:15.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.643+0000 7f4384f47640 1 -- 172.21.15.8:0/1474408643 wait complete. 2023-10-14T10:34:15.665 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T10:34:15.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.887+0000 7ffb36b25640 1 Processor -- start 2023-10-14T10:34:15.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.887+0000 7ffb36b25640 1 -- start start 2023-10-14T10:34:15.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.889+0000 7ffb36b25640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ffb3014f3a0 0x7ffb30071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.889+0000 7ffb36b25640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb300bfee0 0x7ffb30152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.889+0000 7ffb36b25640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb300c57a0 con 0x7ffb30155440 2023-10-14T10:34:15.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.889+0000 7ffb36b25640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3006cee0 con 0x7ffb3014f3a0 2023-10-14T10:34:15.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.889+0000 7ffb36b25640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb30151e50 con 0x7ffb300bfee0 2023-10-14T10:34:15.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.889+0000 7ffb2ffff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ffb30155440 0x7ffb3006d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47678/0 (socket says 172.21.15.8:47678) 2023-10-14T10:34:15.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.890+0000 7ffb2ffff640 1 -- 172.21.15.8:0/217094728 learned_addr learned my addr 172.21.15.8:0/217094728 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:15.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.890+0000 7ffb350c2640 1 --2- 172.21.15.8:0/217094728 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb300bfee0 0x7ffb30152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:15.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.890+0000 7ffb348c1640 1 --2- 172.21.15.8:0/217094728 >> v2:172.21.15.8:3300/0 conn(0x7ffb3014f3a0 0x7ffb30071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:15.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.890+0000 7ffb2f7fe640 1 -- 172.21.15.8:0/217094728 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259278268 0 0) 0x7ffb300c57a0 con 0x7ffb30155440 2023-10-14T10:34:15.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.890+0000 7ffb2f7fe640 1 -- 172.21.15.8:0/217094728 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb20003520 con 0x7ffb30155440 2023-10-14T10:34:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.890+0000 7ffb348c1640 1 -- 172.21.15.8:0/217094728 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb300bfee0 msgr2=0x7ffb30152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.890+0000 7ffb348c1640 1 --2- 172.21.15.8:0/217094728 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb300bfee0 0x7ffb30152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.891+0000 7ffb348c1640 1 -- 172.21.15.8:0/217094728 >> v1:172.21.15.8:6789/0 conn(0x7ffb30155440 legacy=0x7ffb3006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:15.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.891+0000 7ffb348c1640 1 -- 172.21.15.8:0/217094728 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb300c59f0 con 0x7ffb3014f3a0 2023-10-14T10:34:15.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.892+0000 7ffb348c1640 1 --2- 172.21.15.8:0/217094728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb3014f3a0 0x7ffb30071f90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009d90 tx=0x7ffb2402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7515d290036323 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:15.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.893+0000 7ffb2f7fe640 1 -- 172.21.15.8:0/217094728 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2402cbc0 con 0x7ffb3014f3a0 2023-10-14T10:34:15.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.893+0000 7ffb2f7fe640 1 -- 172.21.15.8:0/217094728 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2402cd20 con 0x7ffb3014f3a0 2023-10-14T10:34:15.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.893+0000 7ffb2f7fe640 1 -- 172.21.15.8:0/217094728 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24034660 con 0x7ffb3014f3a0 2023-10-14T10:34:15.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.893+0000 7ffb36b25640 1 -- 172.21.15.8:0/217094728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb3014f3a0 msgr2=0x7ffb30071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:15.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.893+0000 7ffb36b25640 1 --2- 172.21.15.8:0/217094728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb3014f3a0 0x7ffb30071f90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009d90 tx=0x7ffb2402be10 comp rx=0 tx=0).stop 2023-10-14T10:34:15.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.893+0000 7ffb36b25640 1 -- 172.21.15.8:0/217094728 shutdown_connections 2023-10-14T10:34:15.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.893+0000 7ffb36b25640 1 --2- 172.21.15.8:0/217094728 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb300bfee0 0x7ffb30152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.893+0000 7ffb36b25640 1 --2- 172.21.15.8:0/217094728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb3014f3a0 0x7ffb30071f90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.893+0000 7ffb36b25640 1 -- 172.21.15.8:0/217094728 >> 172.21.15.8:0/217094728 conn(0x7ffb300a74d0 msgr2=0x7ffb300a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:15.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.894+0000 7ffb36b25640 1 -- 172.21.15.8:0/217094728 shutdown_connections 2023-10-14T10:34:15.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.894+0000 7ffb36b25640 1 -- 172.21.15.8:0/217094728 wait complete. 2023-10-14T10:34:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.895+0000 7ffb36b25640 1 Processor -- start 2023-10-14T10:34:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.895+0000 7ffb36b25640 1 -- start start 2023-10-14T10:34:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.896+0000 7ffb36b25640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb300bfee0 0x7ffb3006d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.896+0000 7ffb36b25640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3014f3a0 0x7ffb301416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.896+0000 7ffb36b25640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb30155440 0x7ffb30141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.896+0000 7ffb36b25640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb301517b0 con 0x7ffb300bfee0 2023-10-14T10:34:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.896+0000 7ffb36b25640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb300aa3a0 con 0x7ffb3014f3a0 2023-10-14T10:34:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.896+0000 7ffb36b25640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb301550f0 con 0x7ffb30155440 2023-10-14T10:34:15.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.897+0000 7ffb348c1640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb300bfee0 0x7ffb3006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.897+0000 7ffb348c1640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb300bfee0 0x7ffb3006d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57660/0 (socket says 172.21.15.8:57660) 2023-10-14T10:34:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.897+0000 7ffb348c1640 1 -- 172.21.15.8:0/2221711380 learned_addr learned my addr 172.21.15.8:0/2221711380 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.897+0000 7ffb348c1640 1 -- 172.21.15.8:0/2221711380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb30155440 msgr2=0x7ffb30141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:15.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.897+0000 7ffb348c1640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb30155440 0x7ffb30141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.897+0000 7ffb348c1640 1 -- 172.21.15.8:0/2221711380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3014f3a0 msgr2=0x7ffb301416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.897+0000 7ffb2ffff640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3014f3a0 0x7ffb301416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.897+0000 7ffb348c1640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3014f3a0 0x7ffb301416b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.897+0000 7ffb348c1640 1 -- 172.21.15.8:0/2221711380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24009a70 con 0x7ffb300bfee0 2023-10-14T10:34:15.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.898+0000 7ffb348c1640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb300bfee0 0x7ffb3006d900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffb24037040 tx=0x7ffb24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:15.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.898+0000 7ffb2d7fa640 1 -- 172.21.15.8:0/2221711380 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24040650 con 0x7ffb300bfee0 2023-10-14T10:34:15.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.898+0000 7ffb2d7fa640 1 -- 172.21.15.8:0/2221711380 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2402ce90 con 0x7ffb300bfee0 2023-10-14T10:34:15.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.898+0000 7ffb2d7fa640 1 -- 172.21.15.8:0/2221711380 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240409f0 con 0x7ffb300bfee0 2023-10-14T10:34:15.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.898+0000 7ffb36b25640 1 -- 172.21.15.8:0/2221711380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb30154330 con 0x7ffb300bfee0 2023-10-14T10:34:15.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.898+0000 7ffb36b25640 1 -- 172.21.15.8:0/2221711380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb301548f0 con 0x7ffb300bfee0 2023-10-14T10:34:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.899+0000 7ffb36b25640 1 -- 172.21.15.8:0/2221711380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3004e9b0 con 0x7ffb300bfee0 2023-10-14T10:34:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.900+0000 7ffb2d7fa640 1 -- 172.21.15.8:0/2221711380 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffb24040b50 con 0x7ffb300bfee0 2023-10-14T10:34:15.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.902+0000 7ffb2d7fa640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ffb1406aea0 0x7ffb1406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:15.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.902+0000 7ffb2d7fa640 1 -- 172.21.15.8:0/2221711380 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb240abf40 con 0x7ffb300bfee0 2023-10-14T10:34:15.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.902+0000 7ffb2ffff640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ffb1406aea0 0x7ffb1406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:15.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.903+0000 7ffb2ffff640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ffb1406aea0 0x7ffb1406d360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffb30152910 tx=0x7ffb1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:15.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:15.907+0000 7ffb2d7fa640 1 -- 172.21.15.8:0/2221711380 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb240770a0 con 0x7ffb300bfee0 2023-10-14T10:34:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.101+0000 7ffb36b25640 1 -- 172.21.15.8:0/2221711380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb300c0db0 con 0x7ffb300bfee0 2023-10-14T10:34:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.102+0000 7ffb2d7fa640 1 -- 172.21.15.8:0/2221711380 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb24009450 con 0x7ffb300bfee0 2023-10-14T10:34:16.106 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T10:34:16.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.105+0000 7ffb36b25640 1 -- 172.21.15.8:0/2221711380 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ffb1406aea0 msgr2=0x7ffb1406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:16.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.105+0000 7ffb36b25640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ffb1406aea0 0x7ffb1406d360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffb30152910 tx=0x7ffb1c009040 comp rx=0 tx=0).stop 2023-10-14T10:34:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.105+0000 7ffb36b25640 1 -- 172.21.15.8:0/2221711380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb300bfee0 msgr2=0x7ffb3006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.105+0000 7ffb36b25640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb300bfee0 0x7ffb3006d900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffb24037040 tx=0x7ffb24004a40 comp rx=0 tx=0).stop 2023-10-14T10:34:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.105+0000 7ffb36b25640 1 -- 172.21.15.8:0/2221711380 shutdown_connections 2023-10-14T10:34:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.105+0000 7ffb36b25640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ffb1406aea0 0x7ffb1406d360 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.105+0000 7ffb36b25640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb30155440 0x7ffb30141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.105+0000 7ffb36b25640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb3014f3a0 0x7ffb301416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.105+0000 7ffb36b25640 1 --2- 172.21.15.8:0/2221711380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb300bfee0 0x7ffb3006d900 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.105+0000 7ffb36b25640 1 -- 172.21.15.8:0/2221711380 >> 172.21.15.8:0/2221711380 conn(0x7ffb300a74d0 msgr2=0x7ffb3006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.105+0000 7ffb36b25640 1 -- 172.21.15.8:0/2221711380 shutdown_connections 2023-10-14T10:34:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.105+0000 7ffb36b25640 1 -- 172.21.15.8:0/2221711380 wait complete. 2023-10-14T10:34:16.128 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.365+0000 7f53f3fb6640 1 Processor -- start 2023-10-14T10:34:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.365+0000 7f53f3fb6640 1 -- start start 2023-10-14T10:34:16.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.367+0000 7f53f3fb6640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53ec06da00 0x7f53ec0c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:16.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.367+0000 7f53f3fb6640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f53ec0c5ce0 0x7f53ec15ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:16.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.367+0000 7f53f3fb6640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ec0c1050 con 0x7f53ec14ac70 2023-10-14T10:34:16.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.367+0000 7f53f3fb6640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ec1540a0 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.367+0000 7f53f3fb6640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec154ee0 con 0x7f53ec06da00 2023-10-14T10:34:16.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.367+0000 7f53f2553640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f53ec0c5ce0 0x7f53ec15ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:16.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.367+0000 7f53f1d52640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f53ec14ac70 0x7f53ec1547d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47688/0 (socket says 172.21.15.8:47688) 2023-10-14T10:34:16.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.367+0000 7f53f1d52640 1 -- 172.21.15.8:0/3588005825 learned_addr learned my addr 172.21.15.8:0/3588005825 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:16.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.368+0000 7f53f1551640 1 --2- 172.21.15.8:0/3588005825 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53ec06da00 0x7f53ec0c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:16.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.368+0000 7f53f2553640 1 -- 172.21.15.8:0/3588005825 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53ec06da00 msgr2=0x7f53ec0c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:16.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.368+0000 7f53f2553640 1 --2- 172.21.15.8:0/3588005825 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53ec06da00 0x7f53ec0c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.368+0000 7f53f2553640 1 -- 172.21.15.8:0/3588005825 >> v1:172.21.15.8:6789/0 conn(0x7f53ec14ac70 legacy=0x7f53ec1547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:16.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.368+0000 7f53f2553640 1 -- 172.21.15.8:0/3588005825 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0c0a90 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.368+0000 7f53f0d50640 1 -- 172.21.15.8:0/3588005825 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277363576 0 0) 0x7f53ec0c1050 con 0x7f53ec14ac70 2023-10-14T10:34:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.370+0000 7f53f2553640 1 --2- 172.21.15.8:0/3588005825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53ec0c5ce0 0x7f53ec15ea20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f53e40097a0 tx=0x7f53e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ba4e6a51fc9b48 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.370+0000 7f53f0d50640 1 -- 172.21.15.8:0/3588005825 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e402e070 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.370+0000 7f53f0d50640 1 -- 172.21.15.8:0/3588005825 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e40315a0 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.370+0000 7f53f0d50640 1 -- 172.21.15.8:0/3588005825 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4031930 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.371+0000 7f53f3fb6640 1 -- 172.21.15.8:0/3588005825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53ec0c5ce0 msgr2=0x7f53ec15ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.371+0000 7f53f3fb6640 1 --2- 172.21.15.8:0/3588005825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53ec0c5ce0 0x7f53ec15ea20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f53e40097a0 tx=0x7f53e402b840 comp rx=0 tx=0).stop 2023-10-14T10:34:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.371+0000 7f53f3fb6640 1 -- 172.21.15.8:0/3588005825 shutdown_connections 2023-10-14T10:34:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.371+0000 7f53f3fb6640 1 --2- 172.21.15.8:0/3588005825 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53ec0c5ce0 0x7f53ec15ea20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.371+0000 7f53f3fb6640 1 --2- 172.21.15.8:0/3588005825 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53ec06da00 0x7f53ec0c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.371+0000 7f53f3fb6640 1 -- 172.21.15.8:0/3588005825 >> 172.21.15.8:0/3588005825 conn(0x7f53ec0a74d0 msgr2=0x7f53ec0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.371+0000 7f53f3fb6640 1 -- 172.21.15.8:0/3588005825 shutdown_connections 2023-10-14T10:34:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.371+0000 7f53f3fb6640 1 -- 172.21.15.8:0/3588005825 wait complete. 2023-10-14T10:34:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.373+0000 7f53f3fb6640 1 Processor -- start 2023-10-14T10:34:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.373+0000 7f53f3fb6640 1 -- start start 2023-10-14T10:34:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.374+0000 7f53f3fb6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53ec06da00 0x7f53ec156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.374+0000 7f53f3fb6640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53ec0c5ce0 0x7f53ec156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.374+0000 7f53f3fb6640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53ec14ac70 0x7f53ec144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.374+0000 7f53f3fb6640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec071f90 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.374+0000 7f53f3fb6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec1ea200 con 0x7f53ec06da00 2023-10-14T10:34:16.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.374+0000 7f53f3fb6640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec1e9c60 con 0x7f53ec14ac70 2023-10-14T10:34:16.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.375+0000 7f53f1551640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53ec0c5ce0 0x7f53ec156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:16.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.375+0000 7f53f1551640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53ec0c5ce0 0x7f53ec156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57672/0 (socket says 172.21.15.8:57672) 2023-10-14T10:34:16.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.375+0000 7f53f1551640 1 -- 172.21.15.8:0/4170162411 learned_addr learned my addr 172.21.15.8:0/4170162411 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:16.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.375+0000 7f53f1551640 1 -- 172.21.15.8:0/4170162411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53ec14ac70 msgr2=0x7f53ec144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:16.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.375+0000 7f53f2553640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53ec14ac70 0x7f53ec144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:16.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.375+0000 7f53f1d52640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53ec06da00 0x7f53ec156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:16.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.375+0000 7f53f1551640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53ec14ac70 0x7f53ec144fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.375+0000 7f53f1551640 1 -- 172.21.15.8:0/4170162411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53ec06da00 msgr2=0x7f53ec156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:16.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.375+0000 7f53f1551640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53ec06da00 0x7f53ec156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.375+0000 7f53f1551640 1 -- 172.21.15.8:0/4170162411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e4009400 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.375+0000 7f53f2553640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53ec14ac70 0x7f53ec144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:16.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.375+0000 7f53f1d52640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53ec06da00 0x7f53ec156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:16.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.376+0000 7f53f1551640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53ec0c5ce0 0x7f53ec156990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00e9b0 tx=0x7f53dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:16.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.376+0000 7f53e27fc640 1 -- 172.21.15.8:0/4170162411 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc009670 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.376+0000 7f53e27fc640 1 -- 172.21.15.8:0/4170162411 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc00c9a0 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.376+0000 7f53f3fb6640 1 -- 172.21.15.8:0/4170162411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ec1e9f20 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.376+0000 7f53e27fc640 1 -- 172.21.15.8:0/4170162411 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00cd50 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.376+0000 7f53f3fb6640 1 -- 172.21.15.8:0/4170162411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ec071cb0 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.378+0000 7f53f3fb6640 1 -- 172.21.15.8:0/4170162411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ec073b50 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.378+0000 7f53e27fc640 1 -- 172.21.15.8:0/4170162411 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f53dc013470 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.380+0000 7f53e27fc640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f53d006ae70 0x7f53d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.380+0000 7f53e27fc640 1 -- 172.21.15.8:0/4170162411 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53dc089820 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.380+0000 7f53f1d52640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f53d006ae70 0x7f53d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:16.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.381+0000 7f53f1d52640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f53d006ae70 0x7f53d006d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f53e8007fd0 tx=0x7f53e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:16.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.384+0000 7f53e27fc640 1 -- 172.21.15.8:0/4170162411 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53dc054960 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.579+0000 7f53f3fb6640 1 -- 172.21.15.8:0/4170162411 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53ec06fdc0 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.582+0000 7f53e27fc640 1 -- 172.21.15.8:0/4170162411 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7f53dc017090 con 0x7f53ec0c5ce0 2023-10-14T10:34:16.585 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:16.585 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:16.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.585+0000 7f53f3fb6640 1 -- 172.21.15.8:0/4170162411 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f53d006ae70 msgr2=0x7f53d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.585+0000 7f53f3fb6640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f53d006ae70 0x7f53d006d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f53e8007fd0 tx=0x7f53e8009040 comp rx=0 tx=0).stop 2023-10-14T10:34:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.585+0000 7f53f3fb6640 1 -- 172.21.15.8:0/4170162411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53ec0c5ce0 msgr2=0x7f53ec156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.585+0000 7f53f3fb6640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53ec0c5ce0 0x7f53ec156990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00e9b0 tx=0x7f53dc00ee70 comp rx=0 tx=0).stop 2023-10-14T10:34:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.585+0000 7f53f3fb6640 1 -- 172.21.15.8:0/4170162411 shutdown_connections 2023-10-14T10:34:16.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.585+0000 7f53f3fb6640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f53d006ae70 0x7f53d006d330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.585+0000 7f53f3fb6640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53ec14ac70 0x7f53ec144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.585+0000 7f53f3fb6640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53ec0c5ce0 0x7f53ec156990 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.585+0000 7f53f3fb6640 1 --2- 172.21.15.8:0/4170162411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53ec06da00 0x7f53ec156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.585+0000 7f53f3fb6640 1 -- 172.21.15.8:0/4170162411 >> 172.21.15.8:0/4170162411 conn(0x7f53ec0a74d0 msgr2=0x7f53ec152960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:16.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.586+0000 7f53f3fb6640 1 -- 172.21.15.8:0/4170162411 shutdown_connections 2023-10-14T10:34:16.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.586+0000 7f53f3fb6640 1 -- 172.21.15.8:0/4170162411 wait complete. 2023-10-14T10:34:16.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T10:33:44.913451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T10:33:46.397320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:34:16.607 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:34:16.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.833+0000 7f88e907c640 1 Processor -- start 2023-10-14T10:34:16.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.833+0000 7f88e907c640 1 -- start start 2023-10-14T10:34:16.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.834+0000 7f88e907c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e4151740 0x7f88e40c4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:16.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.834+0000 7f88e907c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f88e406c0a0 0x7f88e40c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:16.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.834+0000 7f88e907c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e4157680 con 0x7f88e40c78f0 2023-10-14T10:34:16.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.834+0000 7f88e907c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e4151b20 con 0x7f88e406c0a0 2023-10-14T10:34:16.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.834+0000 7f88e907c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e41578f0 con 0x7f88e4151740 2023-10-14T10:34:16.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.835+0000 7f88e359e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f88e406c0a0 0x7f88e40c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:16.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.835+0000 7f88e359e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f88e406c0a0 0x7f88e40c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:36674/0 (socket says 172.21.15.8:36674) 2023-10-14T10:34:16.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.835+0000 7f88e359e640 1 -- 172.21.15.8:0/3456140169 learned_addr learned my addr 172.21.15.8:0/3456140169 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:16.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.835+0000 7f88e2d9d640 1 --2- 172.21.15.8:0/3456140169 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e4151740 0x7f88e40c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:16.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.836+0000 7f88e359e640 1 -- 172.21.15.8:0/3456140169 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e4151740 msgr2=0x7f88e40c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:16.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.836+0000 7f88e359e640 1 --2- 172.21.15.8:0/3456140169 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e4151740 0x7f88e40c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.836+0000 7f88e359e640 1 -- 172.21.15.8:0/3456140169 >> v1:172.21.15.92:6789/0 conn(0x7f88e40c78f0 legacy=0x7f88e406b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:16.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.836+0000 7f88e359e640 1 -- 172.21.15.8:0/3456140169 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e4157bd0 con 0x7f88e406c0a0 2023-10-14T10:34:16.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.837+0000 7f88e359e640 1 --2- 172.21.15.8:0/3456140169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e406c0a0 0x7f88e40c7d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009e50 tx=0x7f88dc02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=566bff0a3ebb77c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:16.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.838+0000 7f88e1d9b640 1 -- 172.21.15.8:0/3456140169 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc02cb00 con 0x7f88e406c0a0 2023-10-14T10:34:16.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.838+0000 7f88e1d9b640 1 -- 172.21.15.8:0/3456140169 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc02cc60 con 0x7f88e406c0a0 2023-10-14T10:34:16.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.838+0000 7f88e1d9b640 1 -- 172.21.15.8:0/3456140169 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0343f0 con 0x7f88e406c0a0 2023-10-14T10:34:16.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.839+0000 7f88e907c640 1 -- 172.21.15.8:0/3456140169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e406c0a0 msgr2=0x7f88e40c7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:16.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.839+0000 7f88e907c640 1 --2- 172.21.15.8:0/3456140169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e406c0a0 0x7f88e40c7d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009e50 tx=0x7f88dc02bf60 comp rx=0 tx=0).stop 2023-10-14T10:34:16.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.839+0000 7f88e907c640 1 -- 172.21.15.8:0/3456140169 shutdown_connections 2023-10-14T10:34:16.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.839+0000 7f88e907c640 1 --2- 172.21.15.8:0/3456140169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e406c0a0 0x7f88e40c7d50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.839+0000 7f88e907c640 1 --2- 172.21.15.8:0/3456140169 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e4151740 0x7f88e40c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.839+0000 7f88e907c640 1 -- 172.21.15.8:0/3456140169 >> 172.21.15.8:0/3456140169 conn(0x7f88e40ab440 msgr2=0x7f88e40ab850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:16.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.839+0000 7f88e907c640 1 -- 172.21.15.8:0/3456140169 shutdown_connections 2023-10-14T10:34:16.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.839+0000 7f88e907c640 1 -- 172.21.15.8:0/3456140169 wait complete. 2023-10-14T10:34:16.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.841+0000 7f88e907c640 1 Processor -- start 2023-10-14T10:34:16.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.842+0000 7f88e907c640 1 -- start start 2023-10-14T10:34:16.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e907c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e406c0a0 0x7f88e41e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:16.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e907c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e40c78f0 0x7f88e40aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:16.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e907c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e4151740 0x7f88e41553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:16.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e907c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40bf6e0 con 0x7f88e406c0a0 2023-10-14T10:34:16.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e907c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e4154e90 con 0x7f88e40c78f0 2023-10-14T10:34:16.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e907c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e41e9b50 con 0x7f88e4151740 2023-10-14T10:34:16.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e2d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e406c0a0 0x7f88e41e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:16.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e2d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e406c0a0 0x7f88e41e9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57684/0 (socket says 172.21.15.8:57684) 2023-10-14T10:34:16.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e2d9d640 1 -- 172.21.15.8:0/1367481177 learned_addr learned my addr 172.21.15.8:0/1367481177 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e2d9d640 1 -- 172.21.15.8:0/1367481177 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e4151740 msgr2=0x7f88e41553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e2d9d640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e4151740 0x7f88e41553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e2d9d640 1 -- 172.21.15.8:0/1367481177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e40c78f0 msgr2=0x7f88e40aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:16.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.843+0000 7f88e259c640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e40c78f0 0x7f88e40aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.844+0000 7f88e2d9d640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e40c78f0 0x7f88e40aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.844+0000 7f88e2d9d640 1 -- 172.21.15.8:0/1367481177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc009b30 con 0x7f88e406c0a0 2023-10-14T10:34:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.844+0000 7f88e259c640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e40c78f0 0x7f88e40aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.844+0000 7f88e2d9d640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e406c0a0 0x7f88e41e9fe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f88d400e8a0 tx=0x7f88d400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:16.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.844+0000 7f88cb7fe640 1 -- 172.21.15.8:0/1367481177 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d40094f0 con 0x7f88e406c0a0 2023-10-14T10:34:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.844+0000 7f88cb7fe640 1 -- 172.21.15.8:0/1367481177 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d400c940 con 0x7f88e406c0a0 2023-10-14T10:34:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.844+0000 7f88cb7fe640 1 -- 172.21.15.8:0/1367481177 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d400ccf0 con 0x7f88e406c0a0 2023-10-14T10:34:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.844+0000 7f88e907c640 1 -- 172.21.15.8:0/1367481177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e40bf100 con 0x7f88e406c0a0 2023-10-14T10:34:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.844+0000 7f88e907c640 1 -- 172.21.15.8:0/1367481177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e41e97e0 con 0x7f88e406c0a0 2023-10-14T10:34:16.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.845+0000 7f88e907c640 1 -- 172.21.15.8:0/1367481177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e40c5700 con 0x7f88e406c0a0 2023-10-14T10:34:16.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.847+0000 7f88cb7fe640 1 -- 172.21.15.8:0/1367481177 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f88d4013470 con 0x7f88e406c0a0 2023-10-14T10:34:16.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.847+0000 7f88cb7fe640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f88d006ae70 0x7f88d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.847+0000 7f88cb7fe640 1 -- 172.21.15.8:0/1367481177 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88d4089720 con 0x7f88e406c0a0 2023-10-14T10:34:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.848+0000 7f88e259c640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f88d006ae70 0x7f88d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:16.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.848+0000 7f88e259c640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f88d006ae70 0x7f88d006d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f88e40af6a0 tx=0x7f88d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:16.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:16.852+0000 7f88cb7fe640 1 -- 172.21.15.8:0/1367481177 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88d40547c0 con 0x7f88e406c0a0 2023-10-14T10:34:17.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.042+0000 7f88e907c640 1 -- 172.21.15.8:0/1367481177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88e4073b50 con 0x7f88e406c0a0 2023-10-14T10:34:17.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.044+0000 7f88cb7fe640 1 -- 172.21.15.8:0/1367481177 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88d4057de0 con 0x7f88e406c0a0 2023-10-14T10:34:17.046 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:34:17.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.046+0000 7f88e907c640 1 -- 172.21.15.8:0/1367481177 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f88d006ae70 msgr2=0x7f88d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.046+0000 7f88e907c640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f88d006ae70 0x7f88d006d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f88e40af6a0 tx=0x7f88d8009040 comp rx=0 tx=0).stop 2023-10-14T10:34:17.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.046+0000 7f88e907c640 1 -- 172.21.15.8:0/1367481177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e406c0a0 msgr2=0x7f88e41e9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.046+0000 7f88e907c640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e406c0a0 0x7f88e41e9fe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f88d400e8a0 tx=0x7f88d400ed60 comp rx=0 tx=0).stop 2023-10-14T10:34:17.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.046+0000 7f88e907c640 1 -- 172.21.15.8:0/1367481177 shutdown_connections 2023-10-14T10:34:17.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.046+0000 7f88e907c640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f88d006ae70 0x7f88d006d330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.046+0000 7f88e907c640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88e4151740 0x7f88e41553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.046+0000 7f88e907c640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88e40c78f0 0x7f88e40aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.046+0000 7f88e907c640 1 --2- 172.21.15.8:0/1367481177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88e406c0a0 0x7f88e41e9fe0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.046+0000 7f88e907c640 1 -- 172.21.15.8:0/1367481177 >> 172.21.15.8:0/1367481177 conn(0x7f88e40ab440 msgr2=0x7f88e40c4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:17.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.047+0000 7f88e907c640 1 -- 172.21.15.8:0/1367481177 shutdown_connections 2023-10-14T10:34:17.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.047+0000 7f88e907c640 1 -- 172.21.15.8:0/1367481177 wait complete. 2023-10-14T10:34:17.070 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T10:34:17.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.286+0000 7fd52ab43640 1 Processor -- start 2023-10-14T10:34:17.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.286+0000 7fd52ab43640 1 -- start start 2023-10-14T10:34:17.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.287+0000 7fd52ab43640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd52413af90 0x7fd5240a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:17.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.287+0000 7fd52ab43640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd524152ac0 con 0x7fd52406fb10 2023-10-14T10:34:17.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.287+0000 7fd52ab43640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd524151eb0 con 0x7fd5240bfc10 2023-10-14T10:34:17.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.287+0000 7fd52ab43640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd524152190 con 0x7fd52413af90 2023-10-14T10:34:17.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.288+0000 7fd529340640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd52406fb10 0x7fd5240c2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44252/0 (socket says 172.21.15.8:44252) 2023-10-14T10:34:17.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.288+0000 7fd529340640 1 -- 172.21.15.8:0/2484434489 learned_addr learned my addr 172.21.15.8:0/2484434489 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:17.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.288+0000 7fd529b41640 1 --2- 172.21.15.8:0/2484434489 >> v2:172.21.15.8:3300/0 conn(0x7fd52413af90 0x7fd5240a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:17.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.288+0000 7fd528b3f640 1 -- 172.21.15.8:0/2484434489 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224332768 0 0) 0x7fd524152ac0 con 0x7fd52406fb10 2023-10-14T10:34:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.288+0000 7fd528b3f640 1 -- 172.21.15.8:0/2484434489 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd510003520 con 0x7fd52406fb10 2023-10-14T10:34:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.288+0000 7fd529b41640 1 -- 172.21.15.8:0/2484434489 >> v1:172.21.15.92:6789/0 conn(0x7fd5240bfc10 legacy=0x7fd5240c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.288+0000 7fd529b41640 1 -- 172.21.15.8:0/2484434489 >> v1:172.21.15.8:6789/0 conn(0x7fd52406fb10 legacy=0x7fd5240c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.288+0000 7fd529b41640 1 -- 172.21.15.8:0/2484434489 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd524152470 con 0x7fd52413af90 2023-10-14T10:34:17.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.290+0000 7fd529b41640 1 --2- 172.21.15.8:0/2484434489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd52413af90 0x7fd5240a81e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd5200097a0 tx=0x7fd52002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fcb846b95d13df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:17.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.290+0000 7fd528b3f640 1 -- 172.21.15.8:0/2484434489 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520031830 con 0x7fd52413af90 2023-10-14T10:34:17.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.290+0000 7fd528b3f640 1 -- 172.21.15.8:0/2484434489 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd520031990 con 0x7fd52413af90 2023-10-14T10:34:17.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.290+0000 7fd528b3f640 1 -- 172.21.15.8:0/2484434489 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520031d20 con 0x7fd52413af90 2023-10-14T10:34:17.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.290+0000 7fd52ab43640 1 -- 172.21.15.8:0/2484434489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd52413af90 msgr2=0x7fd5240a81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.291+0000 7fd52ab43640 1 --2- 172.21.15.8:0/2484434489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd52413af90 0x7fd5240a81e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd5200097a0 tx=0x7fd52002b8d0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.291+0000 7fd52ab43640 1 -- 172.21.15.8:0/2484434489 shutdown_connections 2023-10-14T10:34:17.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.291+0000 7fd52ab43640 1 --2- 172.21.15.8:0/2484434489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd52413af90 0x7fd5240a81e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.291+0000 7fd52ab43640 1 -- 172.21.15.8:0/2484434489 >> 172.21.15.8:0/2484434489 conn(0x7fd52406a200 msgr2=0x7fd52406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:17.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.291+0000 7fd52ab43640 1 -- 172.21.15.8:0/2484434489 shutdown_connections 2023-10-14T10:34:17.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.291+0000 7fd52ab43640 1 -- 172.21.15.8:0/2484434489 wait complete. 2023-10-14T10:34:17.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.292+0000 7fd52ab43640 1 Processor -- start 2023-10-14T10:34:17.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.293+0000 7fd52ab43640 1 -- start start 2023-10-14T10:34:17.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.293+0000 7fd52ab43640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd52406fb10 0x7fd5241ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:17.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.293+0000 7fd52ab43640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd5240bfc10 0x7fd524136040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:17.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.293+0000 7fd52ab43640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd52413af90 0x7fd52414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:17.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.293+0000 7fd52ab43640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5241ed820 con 0x7fd52406fb10 2023-10-14T10:34:17.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.294+0000 7fd52ab43640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240ba4a0 con 0x7fd52413af90 2023-10-14T10:34:17.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.294+0000 7fd52ab43640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240ba150 con 0x7fd5240bfc10 2023-10-14T10:34:17.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.294+0000 7fd529b41640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd52406fb10 0x7fd5241ed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:17.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.294+0000 7fd529b41640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd52406fb10 0x7fd5241ed2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42160/0 (socket says 172.21.15.8:42160) 2023-10-14T10:34:17.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.294+0000 7fd529b41640 1 -- 172.21.15.8:0/1233926483 learned_addr learned my addr 172.21.15.8:0/1233926483 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:17.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.294+0000 7fd529b41640 1 -- 172.21.15.8:0/1233926483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd5240bfc10 msgr2=0x7fd524136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.294+0000 7fd529b41640 1 --2- 172.21.15.8:0/1233926483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd5240bfc10 0x7fd524136040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.294+0000 7fd529b41640 1 -- 172.21.15.8:0/1233926483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd52413af90 msgr2=0x7fd52414ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.294+0000 7fd529b41640 1 --2- 172.21.15.8:0/1233926483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd52413af90 0x7fd52414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.294+0000 7fd529b41640 1 -- 172.21.15.8:0/1233926483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd520009400 con 0x7fd52406fb10 2023-10-14T10:34:17.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.295+0000 7fd529b41640 1 --2- 172.21.15.8:0/1233926483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd52406fb10 0x7fd5241ed2e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd52002bee0 tx=0x7fd5200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:17.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.295+0000 7fd51a7fc640 1 -- 172.21.15.8:0/1233926483 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52003a6f0 con 0x7fd52406fb10 2023-10-14T10:34:17.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.295+0000 7fd51a7fc640 1 -- 172.21.15.8:0/1233926483 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52003a870 con 0x7fd52406fb10 2023-10-14T10:34:17.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.295+0000 7fd51a7fc640 1 -- 172.21.15.8:0/1233926483 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52003ac20 con 0x7fd52406fb10 2023-10-14T10:34:17.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.295+0000 7fd52ab43640 1 -- 172.21.15.8:0/1233926483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5240c3560 con 0x7fd52406fb10 2023-10-14T10:34:17.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.295+0000 7fd52ab43640 1 -- 172.21.15.8:0/1233926483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5240c3b20 con 0x7fd52406fb10 2023-10-14T10:34:17.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.296+0000 7fd52ab43640 1 -- 172.21.15.8:0/1233926483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5240a86d0 con 0x7fd52406fb10 2023-10-14T10:34:17.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.297+0000 7fd51a7fc640 1 -- 172.21.15.8:0/1233926483 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd52004c3b0 con 0x7fd52406fb10 2023-10-14T10:34:17.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.298+0000 7fd51a7fc640 1 --2- 172.21.15.8:0/1233926483 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd50806ae70 0x7fd50806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:17.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.298+0000 7fd51a7fc640 1 -- 172.21.15.8:0/1233926483 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5200ab270 con 0x7fd52406fb10 2023-10-14T10:34:17.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.299+0000 7fd529340640 1 --2- 172.21.15.8:0/1233926483 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd50806ae70 0x7fd50806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:17.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.299+0000 7fd529340640 1 --2- 172.21.15.8:0/1233926483 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd50806ae70 0x7fd50806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd524156450 tx=0x7fd514007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:17.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.302+0000 7fd51a7fc640 1 -- 172.21.15.8:0/1233926483 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd5200763b0 con 0x7fd52406fb10 2023-10-14T10:34:17.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.500+0000 7fd52ab43640 1 -- 172.21.15.8:0/1233926483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5240619f0 con 0x7fd52406fb10 2023-10-14T10:34:17.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.501+0000 7fd51a7fc640 1 -- 172.21.15.8:0/1233926483 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd5200799d0 con 0x7fd52406fb10 2023-10-14T10:34:17.503 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T10:34:17.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.503+0000 7fd52ab43640 1 -- 172.21.15.8:0/1233926483 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd50806ae70 msgr2=0x7fd50806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.503+0000 7fd52ab43640 1 --2- 172.21.15.8:0/1233926483 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd50806ae70 0x7fd50806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd524156450 tx=0x7fd514007930 comp rx=0 tx=0).stop 2023-10-14T10:34:17.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.503+0000 7fd52ab43640 1 -- 172.21.15.8:0/1233926483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd52406fb10 msgr2=0x7fd5241ed2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.503+0000 7fd52ab43640 1 --2- 172.21.15.8:0/1233926483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd52406fb10 0x7fd5241ed2e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd52002bee0 tx=0x7fd5200046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.504+0000 7fd52ab43640 1 -- 172.21.15.8:0/1233926483 shutdown_connections 2023-10-14T10:34:17.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.504+0000 7fd52ab43640 1 --2- 172.21.15.8:0/1233926483 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd50806ae70 0x7fd50806d330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.504+0000 7fd52ab43640 1 --2- 172.21.15.8:0/1233926483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd52413af90 0x7fd52414ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.504+0000 7fd52ab43640 1 --2- 172.21.15.8:0/1233926483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd5240bfc10 0x7fd524136040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.504+0000 7fd52ab43640 1 --2- 172.21.15.8:0/1233926483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd52406fb10 0x7fd5241ed2e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.504+0000 7fd52ab43640 1 -- 172.21.15.8:0/1233926483 >> 172.21.15.8:0/1233926483 conn(0x7fd52406a200 msgr2=0x7fd5241386b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:17.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.504+0000 7fd52ab43640 1 -- 172.21.15.8:0/1233926483 shutdown_connections 2023-10-14T10:34:17.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.504+0000 7fd52ab43640 1 -- 172.21.15.8:0/1233926483 wait complete. 2023-10-14T10:34:17.524 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T10:34:17.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.749+0000 7f4734943640 1 Processor -- start 2023-10-14T10:34:17.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.749+0000 7f4734943640 1 -- start start 2023-10-14T10:34:17.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.750+0000 7f4734943640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4730151640 0x7f4730157470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:17.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.750+0000 7f4734943640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f47300c3170 0x7f47301579b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:17.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.751+0000 7f4734943640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47300c2330 con 0x7f4730065cd0 2023-10-14T10:34:17.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.751+0000 7f4734943640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4730151a20 con 0x7f47300c3170 2023-10-14T10:34:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.751+0000 7f4734943640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47300c0de0 con 0x7f4730151640 2023-10-14T10:34:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.751+0000 7f472ffff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4730065cd0 0x7f473006a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44254/0 (socket says 172.21.15.8:44254) 2023-10-14T10:34:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.751+0000 7f472ffff640 1 -- 172.21.15.8:0/597610333 learned_addr learned my addr 172.21.15.8:0/597610333 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:17.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.751+0000 7f4726ffd640 1 --2- 172.21.15.8:0/597610333 >> v2:172.21.15.8:3300/0 conn(0x7f47300c3170 0x7f47301579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:17.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.751+0000 7f472f7fe640 1 --2- 172.21.15.8:0/597610333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4730151640 0x7f4730157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:17.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.752+0000 7f4726ffd640 1 -- 172.21.15.8:0/597610333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4730151640 msgr2=0x7f4730157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:17.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.752+0000 7f4726ffd640 1 --2- 172.21.15.8:0/597610333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4730151640 0x7f4730157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.752+0000 7f4726ffd640 1 -- 172.21.15.8:0/597610333 >> v1:172.21.15.8:6789/0 conn(0x7f4730065cd0 legacy=0x7f473006a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.752+0000 7f4726ffd640 1 -- 172.21.15.8:0/597610333 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300c59e0 con 0x7f47300c3170 2023-10-14T10:34:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.752+0000 7f472effd640 1 -- 172.21.15.8:0/597610333 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999948023 0 0) 0x7f47300c2330 con 0x7f4730065cd0 2023-10-14T10:34:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.753+0000 7f4726ffd640 1 --2- 172.21.15.8:0/597610333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47300c3170 0x7f47301579b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f47180097d0 tx=0x7f471802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f331289d7402219e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.753+0000 7f472effd640 1 -- 172.21.15.8:0/597610333 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47180316f0 con 0x7f47300c3170 2023-10-14T10:34:17.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.753+0000 7f472effd640 1 -- 172.21.15.8:0/597610333 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4718031850 con 0x7f47300c3170 2023-10-14T10:34:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.753+0000 7f472effd640 1 -- 172.21.15.8:0/597610333 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718031be0 con 0x7f47300c3170 2023-10-14T10:34:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.754+0000 7f4734943640 1 -- 172.21.15.8:0/597610333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47300c3170 msgr2=0x7f47301579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.754+0000 7f4734943640 1 --2- 172.21.15.8:0/597610333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47300c3170 0x7f47301579b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f47180097d0 tx=0x7f471802b790 comp rx=0 tx=0).stop 2023-10-14T10:34:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.754+0000 7f4734943640 1 -- 172.21.15.8:0/597610333 shutdown_connections 2023-10-14T10:34:17.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.754+0000 7f4734943640 1 --2- 172.21.15.8:0/597610333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47300c3170 0x7f47301579b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.754+0000 7f4734943640 1 --2- 172.21.15.8:0/597610333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4730151640 0x7f4730157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.754+0000 7f4734943640 1 -- 172.21.15.8:0/597610333 >> 172.21.15.8:0/597610333 conn(0x7f47300c2650 msgr2=0x7f47300c2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.754+0000 7f4734943640 1 -- 172.21.15.8:0/597610333 shutdown_connections 2023-10-14T10:34:17.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.754+0000 7f4734943640 1 -- 172.21.15.8:0/597610333 wait complete. 2023-10-14T10:34:17.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.756+0000 7f4734943640 1 Processor -- start 2023-10-14T10:34:17.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.756+0000 7f4734943640 1 -- start start 2023-10-14T10:34:17.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f4734943640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4730065cd0 0x7f4730071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:17.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f4734943640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47300c3170 0x7f47300a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:17.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f4734943640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4730151640 0x7f4730153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:17.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f4734943640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473009ce80 con 0x7f4730065cd0 2023-10-14T10:34:17.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f4734943640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300bfb90 con 0x7f47300c3170 2023-10-14T10:34:17.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f4734943640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47301e9910 con 0x7f4730151640 2023-10-14T10:34:17.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f472f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4730065cd0 0x7f4730071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:17.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f472f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4730065cd0 0x7f4730071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42180/0 (socket says 172.21.15.8:42180) 2023-10-14T10:34:17.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f472f7fe640 1 -- 172.21.15.8:0/1411955213 learned_addr learned my addr 172.21.15.8:0/1411955213 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:17.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f472f7fe640 1 -- 172.21.15.8:0/1411955213 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4730151640 msgr2=0x7f4730153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f472f7fe640 1 --2- 172.21.15.8:0/1411955213 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4730151640 0x7f4730153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f472f7fe640 1 -- 172.21.15.8:0/1411955213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47300c3170 msgr2=0x7f47300a6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f472f7fe640 1 --2- 172.21.15.8:0/1411955213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47300c3170 0x7f47300a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.757+0000 7f472f7fe640 1 -- 172.21.15.8:0/1411955213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718009400 con 0x7f4730065cd0 2023-10-14T10:34:17.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.758+0000 7f472f7fe640 1 --2- 172.21.15.8:0/1411955213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4730065cd0 0x7f4730071ac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f472000d5d0 tx=0x7f472000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:17.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.758+0000 7f472cff9640 1 -- 172.21.15.8:0/1411955213 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47200125f0 con 0x7f4730065cd0 2023-10-14T10:34:17.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.758+0000 7f472cff9640 1 -- 172.21.15.8:0/1411955213 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4720012770 con 0x7f4730065cd0 2023-10-14T10:34:17.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.758+0000 7f472cff9640 1 -- 172.21.15.8:0/1411955213 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720012b20 con 0x7f4730065cd0 2023-10-14T10:34:17.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.758+0000 7f4734943640 1 -- 172.21.15.8:0/1411955213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47301e9bf0 con 0x7f4730065cd0 2023-10-14T10:34:17.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.758+0000 7f4734943640 1 -- 172.21.15.8:0/1411955213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4730072000 con 0x7f4730065cd0 2023-10-14T10:34:17.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.759+0000 7f4734943640 1 -- 172.21.15.8:0/1411955213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47300619f0 con 0x7f4730065cd0 2023-10-14T10:34:17.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.760+0000 7f472cff9640 1 -- 172.21.15.8:0/1411955213 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4720012c80 con 0x7f4730065cd0 2023-10-14T10:34:17.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.761+0000 7f472cff9640 1 --2- 172.21.15.8:0/1411955213 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f471006ae70 0x7f471006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:17.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.761+0000 7f472cff9640 1 -- 172.21.15.8:0/1411955213 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4720089ba0 con 0x7f4730065cd0 2023-10-14T10:34:17.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.761+0000 7f4726ffd640 1 --2- 172.21.15.8:0/1411955213 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f471006ae70 0x7f471006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:17.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.762+0000 7f4726ffd640 1 --2- 172.21.15.8:0/1411955213 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f471006ae70 0x7f471006d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4718036000 tx=0x7f4718030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:17.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.766+0000 7f472cff9640 1 -- 172.21.15.8:0/1411955213 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4720054c40 con 0x7f4730065cd0 2023-10-14T10:34:17.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.959+0000 7f4734943640 1 -- 172.21.15.8:0/1411955213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47300723d0 con 0x7f4730065cd0 2023-10-14T10:34:17.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.960+0000 7f472cff9640 1 -- 172.21.15.8:0/1411955213 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4720058260 con 0x7f4730065cd0 2023-10-14T10:34:17.962 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T10:34:17.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.962+0000 7f4734943640 1 -- 172.21.15.8:0/1411955213 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f471006ae70 msgr2=0x7f471006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.962+0000 7f4734943640 1 --2- 172.21.15.8:0/1411955213 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f471006ae70 0x7f471006d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4718036000 tx=0x7f4718030000 comp rx=0 tx=0).stop 2023-10-14T10:34:17.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.962+0000 7f4734943640 1 -- 172.21.15.8:0/1411955213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4730065cd0 msgr2=0x7f4730071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:17.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.962+0000 7f4734943640 1 --2- 172.21.15.8:0/1411955213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4730065cd0 0x7f4730071ac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f472000d5d0 tx=0x7f472000da90 comp rx=0 tx=0).stop 2023-10-14T10:34:17.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.962+0000 7f4734943640 1 -- 172.21.15.8:0/1411955213 shutdown_connections 2023-10-14T10:34:17.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.962+0000 7f4734943640 1 --2- 172.21.15.8:0/1411955213 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f471006ae70 0x7f471006d330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.962+0000 7f4734943640 1 --2- 172.21.15.8:0/1411955213 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4730151640 0x7f4730153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.962+0000 7f4734943640 1 --2- 172.21.15.8:0/1411955213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47300c3170 0x7f47300a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.962+0000 7f4734943640 1 --2- 172.21.15.8:0/1411955213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4730065cd0 0x7f4730071ac0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:17.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.962+0000 7f4734943640 1 -- 172.21.15.8:0/1411955213 >> 172.21.15.8:0/1411955213 conn(0x7f47300c2650 msgr2=0x7f4730150a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:17.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.962+0000 7f4734943640 1 -- 172.21.15.8:0/1411955213 shutdown_connections 2023-10-14T10:34:17.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:17.963+0000 7f4734943640 1 -- 172.21.15.8:0/1411955213 wait complete. 2023-10-14T10:34:17.983 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:18.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.201+0000 7f972f610640 1 Processor -- start 2023-10-14T10:34:18.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.201+0000 7f972f610640 1 -- start start 2023-10-14T10:34:18.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.203+0000 7f972f610640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9728071ff0 0x7f97280c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:18.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.203+0000 7f972f610640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9728152960 0x7f972806d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:18.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.203+0000 7f972f610640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9728151ea0 con 0x7f972813b260 2023-10-14T10:34:18.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.203+0000 7f972f610640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9728152540 con 0x7f9728071ff0 2023-10-14T10:34:18.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.203+0000 7f972f610640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97280c5d80 con 0x7f9728152960 2023-10-14T10:34:18.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.203+0000 7f972cbab640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9728071ff0 0x7f97280c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:18.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.203+0000 7f972cbab640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9728071ff0 0x7f97280c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42182/0 (socket says 172.21.15.8:42182) 2023-10-14T10:34:18.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.203+0000 7f972cbab640 1 -- 172.21.15.8:0/3648870619 learned_addr learned my addr 172.21.15.8:0/3648870619 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:18.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.204+0000 7f972dbad640 1 --2- 172.21.15.8:0/3648870619 >> v2:172.21.15.92:3300/0 conn(0x7f9728152960 0x7f972806d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:18.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.204+0000 7f972cbab640 1 -- 172.21.15.8:0/3648870619 >> v2:172.21.15.92:3300/0 conn(0x7f9728152960 msgr2=0x7f972806d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:18.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.204+0000 7f972cbab640 1 --2- 172.21.15.8:0/3648870619 >> v2:172.21.15.92:3300/0 conn(0x7f9728152960 0x7f972806d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.204+0000 7f972cbab640 1 -- 172.21.15.8:0/3648870619 >> v1:172.21.15.92:6789/0 conn(0x7f972813b260 legacy=0x7f97280c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:18.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.204+0000 7f972cbab640 1 -- 172.21.15.8:0/3648870619 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97280c6060 con 0x7f9728071ff0 2023-10-14T10:34:18.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.205+0000 7f972cbab640 1 --2- 172.21.15.8:0/3648870619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9728071ff0 0x7f97280c57a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f972814c530 tx=0x7f971802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56718bb497511ef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:18.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.205+0000 7f971ffff640 1 -- 172.21.15.8:0/3648870619 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97180317e0 con 0x7f9728071ff0 2023-10-14T10:34:18.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.206+0000 7f971ffff640 1 -- 172.21.15.8:0/3648870619 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9718031940 con 0x7f9728071ff0 2023-10-14T10:34:18.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.206+0000 7f971ffff640 1 -- 172.21.15.8:0/3648870619 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718031cd0 con 0x7f9728071ff0 2023-10-14T10:34:18.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.206+0000 7f972f610640 1 -- 172.21.15.8:0/3648870619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9728071ff0 msgr2=0x7f97280c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:18.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.206+0000 7f972f610640 1 --2- 172.21.15.8:0/3648870619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9728071ff0 0x7f97280c57a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f972814c530 tx=0x7f971802b880 comp rx=0 tx=0).stop 2023-10-14T10:34:18.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.206+0000 7f972f610640 1 -- 172.21.15.8:0/3648870619 shutdown_connections 2023-10-14T10:34:18.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.206+0000 7f972f610640 1 --2- 172.21.15.8:0/3648870619 >> v2:172.21.15.92:3300/0 conn(0x7f9728152960 0x7f972806d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.206+0000 7f972f610640 1 --2- 172.21.15.8:0/3648870619 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9728071ff0 0x7f97280c57a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.206+0000 7f972f610640 1 -- 172.21.15.8:0/3648870619 >> 172.21.15.8:0/3648870619 conn(0x7f97280a74d0 msgr2=0x7f97280a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:18.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.206+0000 7f972f610640 1 -- 172.21.15.8:0/3648870619 shutdown_connections 2023-10-14T10:34:18.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.206+0000 7f972f610640 1 -- 172.21.15.8:0/3648870619 wait complete. 2023-10-14T10:34:18.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.208+0000 7f972f610640 1 Processor -- start 2023-10-14T10:34:18.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.208+0000 7f972f610640 1 -- start start 2023-10-14T10:34:18.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.209+0000 7f972f610640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9728071ff0 0x7f9728150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:18.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.209+0000 7f972f610640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f972813b260 0x7f972814ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:18.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.209+0000 7f972f610640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9728152960 0x7f972814ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:18.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.209+0000 7f972f610640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9728135a60 con 0x7f9728071ff0 2023-10-14T10:34:18.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.209+0000 7f972f610640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9728156290 con 0x7f972813b260 2023-10-14T10:34:18.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.209+0000 7f972f610640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97281559a0 con 0x7f9728152960 2023-10-14T10:34:18.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.209+0000 7f972d3ac640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9728071ff0 0x7f9728150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.209+0000 7f972d3ac640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9728071ff0 0x7f9728150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42186/0 (socket says 172.21.15.8:42186) 2023-10-14T10:34:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.209+0000 7f972d3ac640 1 -- 172.21.15.8:0/919655744 learned_addr learned my addr 172.21.15.8:0/919655744 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.210+0000 7f972cbab640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f972813b260 0x7f972814ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.210+0000 7f972dbad640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9728152960 0x7f972814ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:18.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.210+0000 7f972d3ac640 1 -- 172.21.15.8:0/919655744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9728152960 msgr2=0x7f972814ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.210+0000 7f972d3ac640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9728152960 0x7f972814ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.210+0000 7f972d3ac640 1 -- 172.21.15.8:0/919655744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f972813b260 msgr2=0x7f972814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.210+0000 7f972d3ac640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f972813b260 0x7f972814ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.210+0000 7f972d3ac640 1 -- 172.21.15.8:0/919655744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97180094d0 con 0x7f9728071ff0 2023-10-14T10:34:18.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.210+0000 7f972d3ac640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9728071ff0 0x7f9728150fb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f972400c460 tx=0x7f972400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:18.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.210+0000 7f971dffb640 1 -- 172.21.15.8:0/919655744 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724012830 con 0x7f9728071ff0 2023-10-14T10:34:18.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.211+0000 7f971dffb640 1 -- 172.21.15.8:0/919655744 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97240129d0 con 0x7f9728071ff0 2023-10-14T10:34:18.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.211+0000 7f971dffb640 1 -- 172.21.15.8:0/919655744 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724012d80 con 0x7f9728071ff0 2023-10-14T10:34:18.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.211+0000 7f972f610640 1 -- 172.21.15.8:0/919655744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9728154950 con 0x7f9728071ff0 2023-10-14T10:34:18.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.211+0000 7f972f610640 1 -- 172.21.15.8:0/919655744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97281e9da0 con 0x7f9728071ff0 2023-10-14T10:34:18.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.212+0000 7f972f610640 1 -- 172.21.15.8:0/919655744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972804e160 con 0x7f9728071ff0 2023-10-14T10:34:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.213+0000 7f971dffb640 1 -- 172.21.15.8:0/919655744 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f972401b400 con 0x7f9728071ff0 2023-10-14T10:34:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.214+0000 7f971dffb640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f970c06aec0 0x7f970c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.214+0000 7f971dffb640 1 -- 172.21.15.8:0/919655744 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9724089410 con 0x7f9728071ff0 2023-10-14T10:34:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.214+0000 7f972cbab640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f970c06aec0 0x7f970c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:18.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.215+0000 7f972cbab640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f970c06aec0 0x7f970c06d380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9718036000 tx=0x7f971803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:18.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.218+0000 7f971dffb640 1 -- 172.21.15.8:0/919655744 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9724054630 con 0x7f9728071ff0 2023-10-14T10:34:18.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.415+0000 7f972f610640 1 -- 172.21.15.8:0/919655744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9728073b50 con 0x7f9728071ff0 2023-10-14T10:34:18.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.417+0000 7f971dffb640 1 -- 172.21.15.8:0/919655744 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7f9724057c50 con 0x7f9728071ff0 2023-10-14T10:34:18.420 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:18.420 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:18.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.420+0000 7f972f610640 1 -- 172.21.15.8:0/919655744 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f970c06aec0 msgr2=0x7f970c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:18.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.420+0000 7f972f610640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f970c06aec0 0x7f970c06d380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9718036000 tx=0x7f971803d040 comp rx=0 tx=0).stop 2023-10-14T10:34:18.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.420+0000 7f972f610640 1 -- 172.21.15.8:0/919655744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9728071ff0 msgr2=0x7f9728150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:18.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.420+0000 7f972f610640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9728071ff0 0x7f9728150fb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f972400c460 tx=0x7f972400c920 comp rx=0 tx=0).stop 2023-10-14T10:34:18.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.420+0000 7f972f610640 1 -- 172.21.15.8:0/919655744 shutdown_connections 2023-10-14T10:34:18.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.420+0000 7f972f610640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f970c06aec0 0x7f970c06d380 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.420+0000 7f972f610640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9728152960 0x7f972814ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.420+0000 7f972f610640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f972813b260 0x7f972814ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.420+0000 7f972f610640 1 --2- 172.21.15.8:0/919655744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9728071ff0 0x7f9728150fb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.420+0000 7f972f610640 1 -- 172.21.15.8:0/919655744 >> 172.21.15.8:0/919655744 conn(0x7f97280a74d0 msgr2=0x7f97280c0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:18.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.420+0000 7f972f610640 1 -- 172.21.15.8:0/919655744 shutdown_connections 2023-10-14T10:34:18.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.421+0000 7f972f610640 1 -- 172.21.15.8:0/919655744 wait complete. 2023-10-14T10:34:18.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T10:33:44.913451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T10:33:46.397320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:34:18.443 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:34:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.663+0000 7f1eaa10c640 1 Processor -- start 2023-10-14T10:34:18.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.663+0000 7f1eaa10c640 1 -- start start 2023-10-14T10:34:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.665+0000 7f1eaa10c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1ea40c1290 0x7f1ea4150d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.665+0000 7f1eaa10c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea4071580 con 0x7f1ea413a2d0 2023-10-14T10:34:18.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.665+0000 7f1eaa10c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea4071860 con 0x7f1ea40c0080 2023-10-14T10:34:18.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.665+0000 7f1eaa10c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea413a6b0 con 0x7f1ea40c1290 2023-10-14T10:34:18.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.665+0000 7f1ea37fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1ea413a2d0 0x7f1ea40c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44264/0 (socket says 172.21.15.8:44264) 2023-10-14T10:34:18.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.665+0000 7f1ea37fe640 1 -- 172.21.15.8:0/2890756057 learned_addr learned my addr 172.21.15.8:0/2890756057 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:18.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.665+0000 7f1ea2ffd640 1 --2- 172.21.15.8:0/2890756057 >> v2:172.21.15.8:3300/0 conn(0x7f1ea40c1290 0x7f1ea4150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:18.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.666+0000 7f1ea27fc640 1 -- 172.21.15.8:0/2890756057 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128084642 0 0) 0x7f1ea4071580 con 0x7f1ea413a2d0 2023-10-14T10:34:18.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.666+0000 7f1ea27fc640 1 -- 172.21.15.8:0/2890756057 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e8c003520 con 0x7f1ea413a2d0 2023-10-14T10:34:18.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.666+0000 7f1ea2ffd640 1 -- 172.21.15.8:0/2890756057 >> v1:172.21.15.92:6789/0 conn(0x7f1ea40c0080 legacy=0x7f1ea40c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:18.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.666+0000 7f1ea2ffd640 1 -- 172.21.15.8:0/2890756057 >> v1:172.21.15.8:6789/0 conn(0x7f1ea413a2d0 legacy=0x7f1ea40c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:18.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.666+0000 7f1ea2ffd640 1 -- 172.21.15.8:0/2890756057 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea4071b40 con 0x7f1ea40c1290 2023-10-14T10:34:18.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.667+0000 7f1ea2ffd640 1 --2- 172.21.15.8:0/2890756057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ea40c1290 0x7f1ea4150d30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1e980097a0 tx=0x7f1e9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53402d1667a0e7ff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:18.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.667+0000 7f1ea27fc640 1 -- 172.21.15.8:0/2890756057 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98031830 con 0x7f1ea40c1290 2023-10-14T10:34:18.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.667+0000 7f1ea27fc640 1 -- 172.21.15.8:0/2890756057 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e98031990 con 0x7f1ea40c1290 2023-10-14T10:34:18.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.667+0000 7f1ea27fc640 1 -- 172.21.15.8:0/2890756057 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98031d20 con 0x7f1ea40c1290 2023-10-14T10:34:18.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.668+0000 7f1eaa10c640 1 -- 172.21.15.8:0/2890756057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ea40c1290 msgr2=0x7f1ea4150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:18.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.668+0000 7f1eaa10c640 1 --2- 172.21.15.8:0/2890756057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ea40c1290 0x7f1ea4150d30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1e980097a0 tx=0x7f1e9802b8d0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.668+0000 7f1eaa10c640 1 -- 172.21.15.8:0/2890756057 shutdown_connections 2023-10-14T10:34:18.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.668+0000 7f1eaa10c640 1 --2- 172.21.15.8:0/2890756057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ea40c1290 0x7f1ea4150d30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.668+0000 7f1eaa10c640 1 -- 172.21.15.8:0/2890756057 >> 172.21.15.8:0/2890756057 conn(0x7f1ea4069de0 msgr2=0x7f1ea406a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:18.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.668+0000 7f1eaa10c640 1 -- 172.21.15.8:0/2890756057 shutdown_connections 2023-10-14T10:34:18.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.668+0000 7f1eaa10c640 1 -- 172.21.15.8:0/2890756057 wait complete. 2023-10-14T10:34:18.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.670+0000 7f1eaa10c640 1 Processor -- start 2023-10-14T10:34:18.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.670+0000 7f1eaa10c640 1 -- start start 2023-10-14T10:34:18.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.671+0000 7f1eaa10c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea40c0080 0x7f1ea41ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:18.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.671+0000 7f1eaa10c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea40c1290 0x7f1ea41eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:18.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.671+0000 7f1eaa10c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ea413a2d0 0x7f1ea41e8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:18.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.671+0000 7f1eaa10c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea41eb460 con 0x7f1ea413a2d0 2023-10-14T10:34:18.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.671+0000 7f1eaa10c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea4151c40 con 0x7f1ea40c0080 2023-10-14T10:34:18.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.671+0000 7f1eaa10c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea41eb920 con 0x7f1ea40c1290 2023-10-14T10:34:18.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.671+0000 7f1ea3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ea413a2d0 0x7f1ea41e8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.671+0000 7f1ea3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ea413a2d0 0x7f1ea41e8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42208/0 (socket says 172.21.15.8:42208) 2023-10-14T10:34:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.671+0000 7f1ea3fff640 1 -- 172.21.15.8:0/3323212872 learned_addr learned my addr 172.21.15.8:0/3323212872 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.671+0000 7f1ea37fe640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea40c0080 0x7f1ea41ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.671+0000 7f1ea2ffd640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea40c1290 0x7f1ea41eaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:18.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.672+0000 7f1ea3fff640 1 -- 172.21.15.8:0/3323212872 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea40c1290 msgr2=0x7f1ea41eaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:18.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.672+0000 7f1ea3fff640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea40c1290 0x7f1ea41eaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.672+0000 7f1ea3fff640 1 -- 172.21.15.8:0/3323212872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea40c0080 msgr2=0x7f1ea41ea9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:18.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.672+0000 7f1ea3fff640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea40c0080 0x7f1ea41ea9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.672+0000 7f1ea3fff640 1 -- 172.21.15.8:0/3323212872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e98009400 con 0x7f1ea413a2d0 2023-10-14T10:34:18.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.672+0000 7f1ea2ffd640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea40c1290 0x7f1ea41eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.672+0000 7f1ea3fff640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ea413a2d0 0x7f1ea41e8990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00c7b0 tx=0x7f1e9c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.672+0000 7f1e8bfff640 1 -- 172.21.15.8:0/3323212872 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c004b60 con 0x7f1ea413a2d0 2023-10-14T10:34:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.672+0000 7f1e8bfff640 1 -- 172.21.15.8:0/3323212872 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c004cc0 con 0x7f1ea413a2d0 2023-10-14T10:34:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.672+0000 7f1e8bfff640 1 -- 172.21.15.8:0/3323212872 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00aa90 con 0x7f1ea413a2d0 2023-10-14T10:34:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.672+0000 7f1eaa10c640 1 -- 172.21.15.8:0/3323212872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea4139a20 con 0x7f1ea413a2d0 2023-10-14T10:34:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.672+0000 7f1eaa10c640 1 -- 172.21.15.8:0/3323212872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea41eb640 con 0x7f1ea413a2d0 2023-10-14T10:34:18.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.673+0000 7f1eaa10c640 1 -- 172.21.15.8:0/3323212872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea40c2560 con 0x7f1ea413a2d0 2023-10-14T10:34:18.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.674+0000 7f1e8bfff640 1 -- 172.21.15.8:0/3323212872 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1e9c00abf0 con 0x7f1ea413a2d0 2023-10-14T10:34:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.675+0000 7f1e8bfff640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f1e9006ae70 0x7f1e9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.675+0000 7f1e8bfff640 1 -- 172.21.15.8:0/3323212872 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e9c089760 con 0x7f1ea413a2d0 2023-10-14T10:34:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.676+0000 7f1ea37fe640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f1e9006ae70 0x7f1e9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.676+0000 7f1ea37fe640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f1e9006ae70 0x7f1e9006d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e940011e0 tx=0x7f1e94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:18.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.680+0000 7f1e8bfff640 1 -- 172.21.15.8:0/3323212872 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e9c054800 con 0x7f1ea413a2d0 2023-10-14T10:34:18.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.871+0000 7f1eaa10c640 1 -- 172.21.15.8:0/3323212872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ea4073b50 con 0x7f1ea413a2d0 2023-10-14T10:34:18.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.872+0000 7f1e8bfff640 1 -- 172.21.15.8:0/3323212872 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e9c057e20 con 0x7f1ea413a2d0 2023-10-14T10:34:18.874 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:34:18.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.875+0000 7f1eaa10c640 1 -- 172.21.15.8:0/3323212872 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f1e9006ae70 msgr2=0x7f1e9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:18.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.875+0000 7f1eaa10c640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f1e9006ae70 0x7f1e9006d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e940011e0 tx=0x7f1e94009040 comp rx=0 tx=0).stop 2023-10-14T10:34:18.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.875+0000 7f1eaa10c640 1 -- 172.21.15.8:0/3323212872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ea413a2d0 msgr2=0x7f1ea41e8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:18.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.875+0000 7f1eaa10c640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ea413a2d0 0x7f1ea41e8990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00c7b0 tx=0x7f1e9c00cc70 comp rx=0 tx=0).stop 2023-10-14T10:34:18.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.875+0000 7f1eaa10c640 1 -- 172.21.15.8:0/3323212872 shutdown_connections 2023-10-14T10:34:18.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.875+0000 7f1eaa10c640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f1e9006ae70 0x7f1e9006d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.875+0000 7f1eaa10c640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ea413a2d0 0x7f1ea41e8990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.875+0000 7f1eaa10c640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea40c1290 0x7f1ea41eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.875+0000 7f1eaa10c640 1 --2- 172.21.15.8:0/3323212872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea40c0080 0x7f1ea41ea9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:18.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.875+0000 7f1eaa10c640 1 -- 172.21.15.8:0/3323212872 >> 172.21.15.8:0/3323212872 conn(0x7f1ea4069de0 msgr2=0x7f1ea40c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:18.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.875+0000 7f1eaa10c640 1 -- 172.21.15.8:0/3323212872 shutdown_connections 2023-10-14T10:34:18.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:18.875+0000 7f1eaa10c640 1 -- 172.21.15.8:0/3323212872 wait complete. 2023-10-14T10:34:18.896 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T10:34:19.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.124+0000 7fe0ee98e640 1 Processor -- start 2023-10-14T10:34:19.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.124+0000 7fe0ee98e640 1 -- start start 2023-10-14T10:34:19.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.125+0000 7fe0ee98e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0e80c4450 0x7fe0e80c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.125+0000 7fe0ee98e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0e806ae00 0x7fe0e8157420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.125+0000 7fe0ee98e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e8158330 con 0x7fe0e8151640 2023-10-14T10:34:19.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.125+0000 7fe0ee98e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e80c5e30 con 0x7fe0e80c4450 2023-10-14T10:34:19.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.125+0000 7fe0ee98e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80c4a40 con 0x7fe0e806ae00 2023-10-14T10:34:19.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.126+0000 7fe0ed18b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0e80c4450 0x7fe0e80c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.126+0000 7fe0ed18b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0e80c4450 0x7fe0e80c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42222/0 (socket says 172.21.15.8:42222) 2023-10-14T10:34:19.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.126+0000 7fe0ed18b640 1 -- 172.21.15.8:0/500785442 learned_addr learned my addr 172.21.15.8:0/500785442 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:19.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.126+0000 7fe0ee18d640 1 --2- 172.21.15.8:0/500785442 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0e806ae00 0x7fe0e8157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.126+0000 7fe0ed18b640 1 -- 172.21.15.8:0/500785442 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0e806ae00 msgr2=0x7fe0e8157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:19.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.126+0000 7fe0ed18b640 1 --2- 172.21.15.8:0/500785442 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0e806ae00 0x7fe0e8157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.126+0000 7fe0ed18b640 1 -- 172.21.15.8:0/500785442 >> v1:172.21.15.92:6789/0 conn(0x7fe0e8151640 legacy=0x7fe0e806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:19.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.126+0000 7fe0ed18b640 1 -- 172.21.15.8:0/500785442 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80c4d20 con 0x7fe0e80c4450 2023-10-14T10:34:19.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.127+0000 7fe0ed18b640 1 --2- 172.21.15.8:0/500785442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e80c4450 0x7fe0e80c75b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009870 tx=0x7fe0d802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98ac19c43322a50 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:19.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.128+0000 7fe0ec98a640 1 -- 172.21.15.8:0/500785442 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8031740 con 0x7fe0e80c4450 2023-10-14T10:34:19.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.128+0000 7fe0ec98a640 1 -- 172.21.15.8:0/500785442 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d80318a0 con 0x7fe0e80c4450 2023-10-14T10:34:19.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.128+0000 7fe0ec98a640 1 -- 172.21.15.8:0/500785442 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8031c30 con 0x7fe0e80c4450 2023-10-14T10:34:19.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.128+0000 7fe0ee98e640 1 -- 172.21.15.8:0/500785442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e80c4450 msgr2=0x7fe0e80c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:19.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.128+0000 7fe0ee98e640 1 --2- 172.21.15.8:0/500785442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e80c4450 0x7fe0e80c75b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009870 tx=0x7fe0d802b7e0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.128+0000 7fe0ee98e640 1 -- 172.21.15.8:0/500785442 shutdown_connections 2023-10-14T10:34:19.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.128+0000 7fe0ee98e640 1 --2- 172.21.15.8:0/500785442 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0e806ae00 0x7fe0e8157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.128+0000 7fe0ee98e640 1 --2- 172.21.15.8:0/500785442 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e80c4450 0x7fe0e80c75b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.128+0000 7fe0ee98e640 1 -- 172.21.15.8:0/500785442 >> 172.21.15.8:0/500785442 conn(0x7fe0e80c96b0 msgr2=0x7fe0e80c9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:19.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.129+0000 7fe0ee98e640 1 -- 172.21.15.8:0/500785442 shutdown_connections 2023-10-14T10:34:19.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.129+0000 7fe0ee98e640 1 -- 172.21.15.8:0/500785442 wait complete. 2023-10-14T10:34:19.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.130+0000 7fe0ee98e640 1 Processor -- start 2023-10-14T10:34:19.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.130+0000 7fe0ee98e640 1 -- start start 2023-10-14T10:34:19.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.131+0000 7fe0ee98e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0e806ae00 0x7fe0e8145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.131+0000 7fe0ee98e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e80c4450 0x7fe0e81569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.131+0000 7fe0ee98e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e8151640 0x7fe0e8146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.131+0000 7fe0ee98e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e814e860 con 0x7fe0e8151640 2023-10-14T10:34:19.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.131+0000 7fe0ee98e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80c8a30 con 0x7fe0e80c4450 2023-10-14T10:34:19.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.131+0000 7fe0ee98e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e81e9a50 con 0x7fe0e806ae00 2023-10-14T10:34:19.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.132+0000 7fe0ee18d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e8151640 0x7fe0e8146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.132+0000 7fe0ee18d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e8151640 0x7fe0e8146e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42224/0 (socket says 172.21.15.8:42224) 2023-10-14T10:34:19.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.132+0000 7fe0ee18d640 1 -- 172.21.15.8:0/3644148559 learned_addr learned my addr 172.21.15.8:0/3644148559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:19.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.132+0000 7fe0ed18b640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e80c4450 0x7fe0e81569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.132+0000 7fe0ed98c640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0e806ae00 0x7fe0e8145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.132+0000 7fe0ee18d640 1 -- 172.21.15.8:0/3644148559 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0e806ae00 msgr2=0x7fe0e8145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.132+0000 7fe0ee18d640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0e806ae00 0x7fe0e8145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.132+0000 7fe0ee18d640 1 -- 172.21.15.8:0/3644148559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e80c4450 msgr2=0x7fe0e81569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.132+0000 7fe0ee18d640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e80c4450 0x7fe0e81569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.132+0000 7fe0ee18d640 1 -- 172.21.15.8:0/3644148559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80094d0 con 0x7fe0e8151640 2023-10-14T10:34:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.133+0000 7fe0ee18d640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e8151640 0x7fe0e8146e50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000cda0 tx=0x7fe0e000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.133+0000 7fe0de7fc640 1 -- 172.21.15.8:0/3644148559 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0003b90 con 0x7fe0e8151640 2023-10-14T10:34:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.133+0000 7fe0de7fc640 1 -- 172.21.15.8:0/3644148559 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e0003cf0 con 0x7fe0e8151640 2023-10-14T10:34:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.133+0000 7fe0de7fc640 1 -- 172.21.15.8:0/3644148559 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0004240 con 0x7fe0e8151640 2023-10-14T10:34:19.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.133+0000 7fe0ee98e640 1 -- 172.21.15.8:0/3644148559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e81e8e40 con 0x7fe0e8151640 2023-10-14T10:34:19.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.133+0000 7fe0ee98e640 1 -- 172.21.15.8:0/3644148559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e81e9400 con 0x7fe0e8151640 2023-10-14T10:34:19.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.134+0000 7fe0ee98e640 1 -- 172.21.15.8:0/3644148559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e80c7af0 con 0x7fe0e8151640 2023-10-14T10:34:19.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.135+0000 7fe0de7fc640 1 -- 172.21.15.8:0/3644148559 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe0e00043a0 con 0x7fe0e8151640 2023-10-14T10:34:19.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.136+0000 7fe0de7fc640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe0cc06aea0 0x7fe0cc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.136+0000 7fe0de7fc640 1 -- 172.21.15.8:0/3644148559 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0e0012070 con 0x7fe0e8151640 2023-10-14T10:34:19.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.136+0000 7fe0ed98c640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe0cc06aea0 0x7fe0cc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.137+0000 7fe0ed98c640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe0cc06aea0 0x7fe0cc06d360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4006fd0 tx=0x7fe0e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:19.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.140+0000 7fe0de7fc640 1 -- 172.21.15.8:0/3644148559 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0e0055080 con 0x7fe0e8151640 2023-10-14T10:34:19.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.332+0000 7fe0ee98e640 1 -- 172.21.15.8:0/3644148559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0e80619f0 con 0x7fe0e8151640 2023-10-14T10:34:19.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.333+0000 7fe0de7fc640 1 -- 172.21.15.8:0/3644148559 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0e00586a0 con 0x7fe0e8151640 2023-10-14T10:34:19.336 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T10:34:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.336+0000 7fe0ee98e640 1 -- 172.21.15.8:0/3644148559 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe0cc06aea0 msgr2=0x7fe0cc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.336+0000 7fe0ee98e640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe0cc06aea0 0x7fe0cc06d360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4006fd0 tx=0x7fe0e4008040 comp rx=0 tx=0).stop 2023-10-14T10:34:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.336+0000 7fe0ee98e640 1 -- 172.21.15.8:0/3644148559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e8151640 msgr2=0x7fe0e8146e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.336+0000 7fe0ee98e640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e8151640 0x7fe0e8146e50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000cda0 tx=0x7fe0e000a660 comp rx=0 tx=0).stop 2023-10-14T10:34:19.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.337+0000 7fe0ee98e640 1 -- 172.21.15.8:0/3644148559 shutdown_connections 2023-10-14T10:34:19.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.337+0000 7fe0ee98e640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe0cc06aea0 0x7fe0cc06d360 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.337+0000 7fe0ee98e640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0e8151640 0x7fe0e8146e50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.337+0000 7fe0ee98e640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0e80c4450 0x7fe0e81569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.337+0000 7fe0ee98e640 1 --2- 172.21.15.8:0/3644148559 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0e806ae00 0x7fe0e8145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.337+0000 7fe0ee98e640 1 -- 172.21.15.8:0/3644148559 >> 172.21.15.8:0/3644148559 conn(0x7fe0e80c96b0 msgr2=0x7fe0e814f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:19.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.337+0000 7fe0ee98e640 1 -- 172.21.15.8:0/3644148559 shutdown_connections 2023-10-14T10:34:19.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.337+0000 7fe0ee98e640 1 -- 172.21.15.8:0/3644148559 wait complete. 2023-10-14T10:34:19.358 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T10:34:19.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.584+0000 7ff8f1303640 1 Processor -- start 2023-10-14T10:34:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.585+0000 7ff8f1303640 1 -- start start 2023-10-14T10:34:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.586+0000 7ff8f1303640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8ec13af90 0x7ff8ec0a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.586+0000 7ff8f1303640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff8ec0bfc10 0x7ff8ec0c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.586+0000 7ff8f1303640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec152ac0 con 0x7ff8ec06fb10 2023-10-14T10:34:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.586+0000 7ff8f1303640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec151eb0 con 0x7ff8ec0bfc10 2023-10-14T10:34:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.586+0000 7ff8f1303640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec152190 con 0x7ff8ec13af90 2023-10-14T10:34:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.587+0000 7ff8eb7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff8ec06fb10 0x7ff8ec0c2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44278/0 (socket says 172.21.15.8:44278) 2023-10-14T10:34:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.587+0000 7ff8eb7fe640 1 -- 172.21.15.8:0/4260064336 learned_addr learned my addr 172.21.15.8:0/4260064336 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.587+0000 7ff8f0b02640 1 --2- 172.21.15.8:0/4260064336 >> v2:172.21.15.92:3300/0 conn(0x7ff8ec0bfc10 0x7ff8ec0c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.587+0000 7ff8ebfff640 1 --2- 172.21.15.8:0/4260064336 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8ec13af90 0x7ff8ec0a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.587+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409624724 0 0) 0x7ff8ec152ac0 con 0x7ff8ec06fb10 2023-10-14T10:34:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.587+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d8003520 con 0x7ff8ec06fb10 2023-10-14T10:34:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4037102252 0 0) 0x7ff8d8003520 con 0x7ff8ec06fb10 2023-10-14T10:34:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8ec13af90 msgr2=0x7ff8ec0a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 --2- 172.21.15.8:0/4260064336 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8ec13af90 0x7ff8ec0a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 >> v2:172.21.15.92:3300/0 conn(0x7ff8ec0bfc10 msgr2=0x7ff8ec0c00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 --2- 172.21.15.8:0/4260064336 >> v2:172.21.15.92:3300/0 conn(0x7ff8ec0bfc10 0x7ff8ec0c00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec152470 con 0x7ff8ec06fb10 2023-10-14T10:34:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7ff8d4001670 con 0x7ff8ec06fb10 2023-10-14T10:34:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 >> v1:172.21.15.8:6789/0 conn(0x7ff8ec06fb10 legacy=0x7ff8ec0c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 --2- 172.21.15.8:0/4260064336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8d8003970 0x7ff8d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 --2- 172.21.15.8:0/4260064336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d80047c0 0x7ff8d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 --2- 172.21.15.8:0/4260064336 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8ec13af90 0x7ff8d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec151eb0 con 0x7ff8d80047c0 2023-10-14T10:34:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec152190 con 0x7ff8d8003970 2023-10-14T10:34:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d800b9d0 con 0x7ff8ec13af90 2023-10-14T10:34:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8eb7fe640 1 --2- 172.21.15.8:0/4260064336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d80047c0 0x7ff8d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8ebfff640 1 --2- 172.21.15.8:0/4260064336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8d8003970 0x7ff8d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.588+0000 7ff8f0b02640 1 --2- 172.21.15.8:0/4260064336 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8ec13af90 0x7ff8d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.589+0000 7ff8eb7fe640 1 -- 172.21.15.8:0/4260064336 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8ec13af90 msgr2=0x7ff8d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.589+0000 7ff8eb7fe640 1 --2- 172.21.15.8:0/4260064336 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8ec13af90 0x7ff8d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.589+0000 7ff8eb7fe640 1 -- 172.21.15.8:0/4260064336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8d8003970 msgr2=0x7ff8d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.589+0000 7ff8eb7fe640 1 --2- 172.21.15.8:0/4260064336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8d8003970 0x7ff8d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.589+0000 7ff8eb7fe640 1 -- 172.21.15.8:0/4260064336 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d8003520 con 0x7ff8d80047c0 2023-10-14T10:34:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.590+0000 7ff8eb7fe640 1 --2- 172.21.15.8:0/4260064336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d80047c0 0x7ff8d8004c40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400c0e0 tx=0x7ff8d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7290f959cd82dfc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.590+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4005ad0 con 0x7ff8d80047c0 2023-10-14T10:34:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.591+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d4005c30 con 0x7ff8d80047c0 2023-10-14T10:34:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.591+0000 7ff8eaffd640 1 -- 172.21.15.8:0/4260064336 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d402c7c0 con 0x7ff8d80047c0 2023-10-14T10:34:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.591+0000 7ff8f1303640 1 -- 172.21.15.8:0/4260064336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d80047c0 msgr2=0x7ff8d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.591+0000 7ff8f1303640 1 --2- 172.21.15.8:0/4260064336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d80047c0 0x7ff8d8004c40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400c0e0 tx=0x7ff8d80057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.591+0000 7ff8f0b02640 1 -- 172.21.15.8:0/4260064336 reap_dead start 2023-10-14T10:34:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.591+0000 7ff8f1303640 1 -- 172.21.15.8:0/4260064336 shutdown_connections 2023-10-14T10:34:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.591+0000 7ff8f1303640 1 -- 172.21.15.8:0/4260064336 >> 172.21.15.8:0/4260064336 conn(0x7ff8ec06a200 msgr2=0x7ff8ec06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.591+0000 7ff8f1303640 1 -- 172.21.15.8:0/4260064336 shutdown_connections 2023-10-14T10:34:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.591+0000 7ff8f1303640 1 -- 172.21.15.8:0/4260064336 wait complete. 2023-10-14T10:34:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.593+0000 7ff8f1303640 1 Processor -- start 2023-10-14T10:34:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.593+0000 7ff8f1303640 1 -- start start 2023-10-14T10:34:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.594+0000 7ff8f1303640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8d80047c0 0x7ff8ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.594+0000 7ff8f1303640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8ec136df0 0x7ff8ec137270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.594+0000 7ff8f1303640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8ec1377b0 0x7ff8ec0c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.594+0000 7ff8f1303640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec136170 con 0x7ff8ec1377b0 2023-10-14T10:34:19.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.594+0000 7ff8f1303640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec0bca10 con 0x7ff8ec136df0 2023-10-14T10:34:19.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.594+0000 7ff8f1303640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec1ed820 con 0x7ff8d80047c0 2023-10-14T10:34:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.594+0000 7ff8f0b02640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8ec1377b0 0x7ff8ec0c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.594+0000 7ff8f0b02640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8ec1377b0 0x7ff8ec0c2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42240/0 (socket says 172.21.15.8:42240) 2023-10-14T10:34:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.594+0000 7ff8f0b02640 1 -- 172.21.15.8:0/4049323162 learned_addr learned my addr 172.21.15.8:0/4049323162 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.595+0000 7ff8eb7fe640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8ec136df0 0x7ff8ec137270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.595+0000 7ff8ebfff640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8d80047c0 0x7ff8ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.595+0000 7ff8f0b02640 1 -- 172.21.15.8:0/4049323162 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8d80047c0 msgr2=0x7ff8ec06d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.595+0000 7ff8f0b02640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8d80047c0 0x7ff8ec06d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.595+0000 7ff8f0b02640 1 -- 172.21.15.8:0/4049323162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8ec136df0 msgr2=0x7ff8ec137270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.595+0000 7ff8f0b02640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8ec136df0 0x7ff8ec137270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.595+0000 7ff8f0b02640 1 -- 172.21.15.8:0/4049323162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec0bc730 con 0x7ff8ec1377b0 2023-10-14T10:34:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.595+0000 7ff8f0b02640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8ec1377b0 0x7ff8ec0c2e60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009e90 tx=0x7ff8e40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.595+0000 7ff8e8ff9640 1 -- 172.21.15.8:0/4049323162 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e400e070 con 0x7ff8ec1377b0 2023-10-14T10:34:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.596+0000 7ff8e8ff9640 1 -- 172.21.15.8:0/4049323162 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4011e80 con 0x7ff8ec1377b0 2023-10-14T10:34:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.596+0000 7ff8e8ff9640 1 -- 172.21.15.8:0/4049323162 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4003990 con 0x7ff8ec1377b0 2023-10-14T10:34:19.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.596+0000 7ff8f1303640 1 -- 172.21.15.8:0/4049323162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ec1ed4b0 con 0x7ff8ec1377b0 2023-10-14T10:34:19.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.596+0000 7ff8f1303640 1 -- 172.21.15.8:0/4049323162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ec135da0 con 0x7ff8ec1377b0 2023-10-14T10:34:19.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.597+0000 7ff8f1303640 1 -- 172.21.15.8:0/4049323162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ec1ed310 con 0x7ff8ec1377b0 2023-10-14T10:34:19.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.598+0000 7ff8e8ff9640 1 -- 172.21.15.8:0/4049323162 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff8e4003af0 con 0x7ff8ec1377b0 2023-10-14T10:34:19.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.599+0000 7ff8e8ff9640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff8cc06aea0 0x7ff8cc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:19.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.599+0000 7ff8e8ff9640 1 -- 172.21.15.8:0/4049323162 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8e4089cd0 con 0x7ff8ec1377b0 2023-10-14T10:34:19.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.599+0000 7ff8ebfff640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff8cc06aea0 0x7ff8cc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:19.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.600+0000 7ff8ebfff640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff8cc06aea0 0x7ff8cc06d360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec06dac0 tx=0x7ff8dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:19.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.604+0000 7ff8e8ff9640 1 -- 172.21.15.8:0/4049323162 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8ec1ed310 con 0x7ff8ec1377b0 2023-10-14T10:34:19.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.796+0000 7ff8f1303640 1 -- 172.21.15.8:0/4049323162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8ec1ed310 con 0x7ff8ec1377b0 2023-10-14T10:34:19.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.797+0000 7ff8e8ff9640 1 -- 172.21.15.8:0/4049323162 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff8ec1ed310 con 0x7ff8ec1377b0 2023-10-14T10:34:19.799 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T10:34:19.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.799+0000 7ff8f1303640 1 -- 172.21.15.8:0/4049323162 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff8cc06aea0 msgr2=0x7ff8cc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:19.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.799+0000 7ff8f1303640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff8cc06aea0 0x7ff8cc06d360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec06dac0 tx=0x7ff8dc008040 comp rx=0 tx=0).stop 2023-10-14T10:34:19.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.799+0000 7ff8f1303640 1 -- 172.21.15.8:0/4049323162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8ec1377b0 msgr2=0x7ff8ec0c2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:19.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.799+0000 7ff8f1303640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8ec1377b0 0x7ff8ec0c2e60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009e90 tx=0x7ff8e40115a0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.799+0000 7ff8f1303640 1 -- 172.21.15.8:0/4049323162 shutdown_connections 2023-10-14T10:34:19.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.799+0000 7ff8f1303640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff8cc06aea0 0x7ff8cc06d360 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.799+0000 7ff8f1303640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8ec1377b0 0x7ff8ec0c2e60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.799+0000 7ff8f1303640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8ec136df0 0x7ff8ec137270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.799+0000 7ff8f1303640 1 --2- 172.21.15.8:0/4049323162 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8d80047c0 0x7ff8ec06d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:19.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.799+0000 7ff8f1303640 1 -- 172.21.15.8:0/4049323162 >> 172.21.15.8:0/4049323162 conn(0x7ff8ec06a200 msgr2=0x7ff8ec138710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:19.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.800+0000 7ff8f1303640 1 -- 172.21.15.8:0/4049323162 shutdown_connections 2023-10-14T10:34:19.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:19.800+0000 7ff8f1303640 1 -- 172.21.15.8:0/4049323162 wait complete. 2023-10-14T10:34:19.822 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:20.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.047+0000 7f9c4ffff640 1 Processor -- start 2023-10-14T10:34:20.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.047+0000 7f9c4ffff640 1 -- start start 2023-10-14T10:34:20.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.049+0000 7f9c4ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9c500a9610 0x7f9c50151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.049+0000 7f9c4ffff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c50071650 con 0x7f9c5006faf0 2023-10-14T10:34:20.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.049+0000 7f9c4ffff640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c500aa6f0 con 0x7f9c5014abb0 2023-10-14T10:34:20.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.049+0000 7f9c4ffff640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c500a9280 con 0x7f9c500a9610 2023-10-14T10:34:20.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.049+0000 7f9c467fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9c500a9610 0x7f9c50151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.049+0000 7f9c4f7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9c5006faf0 0x7f9c5006ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44284/0 (socket says 172.21.15.8:44284) 2023-10-14T10:34:20.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.049+0000 7f9c4f7fe640 1 -- 172.21.15.8:0/277223320 learned_addr learned my addr 172.21.15.8:0/277223320 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:20.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.050+0000 7f9c467fc640 1 -- 172.21.15.8:0/277223320 >> v1:172.21.15.92:6789/0 conn(0x7f9c5014abb0 legacy=0x7f9c500c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.050+0000 7f9c467fc640 1 -- 172.21.15.8:0/277223320 >> v1:172.21.15.8:6789/0 conn(0x7f9c5006faf0 legacy=0x7f9c5006ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.050+0000 7f9c467fc640 1 -- 172.21.15.8:0/277223320 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c50070670 con 0x7f9c500a9610 2023-10-14T10:34:20.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.050+0000 7f9c4e7fc640 1 -- 172.21.15.8:0/277223320 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904577281 0 0) 0x7f9c50071650 con 0x7f9c5006faf0 2023-10-14T10:34:20.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.051+0000 7f9c467fc640 1 --2- 172.21.15.8:0/277223320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c500a9610 0x7f9c50151470 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9c380097a0 tx=0x7f9c3802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2a69893844f153 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:20.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.051+0000 7f9c4e7fc640 1 -- 172.21.15.8:0/277223320 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38030610 con 0x7f9c500a9610 2023-10-14T10:34:20.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.052+0000 7f9c4e7fc640 1 -- 172.21.15.8:0/277223320 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c38030770 con 0x7f9c500a9610 2023-10-14T10:34:20.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.052+0000 7f9c4e7fc640 1 -- 172.21.15.8:0/277223320 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38030b00 con 0x7f9c500a9610 2023-10-14T10:34:20.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.052+0000 7f9c4ffff640 1 -- 172.21.15.8:0/277223320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c500a9610 msgr2=0x7f9c50151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.052+0000 7f9c4ffff640 1 --2- 172.21.15.8:0/277223320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c500a9610 0x7f9c50151470 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9c380097a0 tx=0x7f9c3802b960 comp rx=0 tx=0).stop 2023-10-14T10:34:20.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.052+0000 7f9c4ffff640 1 -- 172.21.15.8:0/277223320 shutdown_connections 2023-10-14T10:34:20.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.052+0000 7f9c4ffff640 1 --2- 172.21.15.8:0/277223320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c500a9610 0x7f9c50151470 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.052+0000 7f9c4ffff640 1 -- 172.21.15.8:0/277223320 >> 172.21.15.8:0/277223320 conn(0x7f9c5006a200 msgr2=0x7f9c5006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:20.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.052+0000 7f9c4ffff640 1 -- 172.21.15.8:0/277223320 shutdown_connections 2023-10-14T10:34:20.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.052+0000 7f9c4ffff640 1 -- 172.21.15.8:0/277223320 wait complete. 2023-10-14T10:34:20.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.054+0000 7f9c4ffff640 1 Processor -- start 2023-10-14T10:34:20.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.054+0000 7f9c4ffff640 1 -- start start 2023-10-14T10:34:20.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.055+0000 7f9c4ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5006faf0 0x7f9c50147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.055+0000 7f9c4ffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c500a9610 0x7f9c5014c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.055+0000 7f9c4ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c5014abb0 0x7f9c50146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.055+0000 7f9c4ffff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5014f570 con 0x7f9c5006faf0 2023-10-14T10:34:20.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.055+0000 7f9c4ffff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5014b150 con 0x7f9c5014abb0 2023-10-14T10:34:20.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.055+0000 7f9c4ffff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c501da050 con 0x7f9c500a9610 2023-10-14T10:34:20.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.055+0000 7f9c4effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5006faf0 0x7f9c50147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.055+0000 7f9c4effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5006faf0 0x7f9c50147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42260/0 (socket says 172.21.15.8:42260) 2023-10-14T10:34:20.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.055+0000 7f9c4effd640 1 -- 172.21.15.8:0/1014736655 learned_addr learned my addr 172.21.15.8:0/1014736655 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:20.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.056+0000 7f9c467fc640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c500a9610 0x7f9c5014c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.056+0000 7f9c4effd640 1 -- 172.21.15.8:0/1014736655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c500a9610 msgr2=0x7f9c5014c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.056+0000 7f9c4effd640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c500a9610 0x7f9c5014c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.056+0000 7f9c4effd640 1 -- 172.21.15.8:0/1014736655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c5014abb0 msgr2=0x7f9c50146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.056+0000 7f9c4effd640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c5014abb0 0x7f9c50146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.056+0000 7f9c4effd640 1 -- 172.21.15.8:0/1014736655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c38009400 con 0x7f9c5006faf0 2023-10-14T10:34:20.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.056+0000 7f9c4effd640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5006faf0 0x7f9c50147ec0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000c400 tx=0x7f9c4000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:20.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.056+0000 7f9c47fff640 1 -- 172.21.15.8:0/1014736655 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c400052d0 con 0x7f9c5006faf0 2023-10-14T10:34:20.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.056+0000 7f9c47fff640 1 -- 172.21.15.8:0/1014736655 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c40005430 con 0x7f9c5006faf0 2023-10-14T10:34:20.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.056+0000 7f9c47fff640 1 -- 172.21.15.8:0/1014736655 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c40003830 con 0x7f9c5006faf0 2023-10-14T10:34:20.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.056+0000 7f9c4ffff640 1 -- 172.21.15.8:0/1014736655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5014d550 con 0x7f9c5006faf0 2023-10-14T10:34:20.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.057+0000 7f9c4ffff640 1 -- 172.21.15.8:0/1014736655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5014d7a0 con 0x7f9c5006faf0 2023-10-14T10:34:20.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.058+0000 7f9c4ffff640 1 -- 172.21.15.8:0/1014736655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5004e9b0 con 0x7f9c5006faf0 2023-10-14T10:34:20.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.059+0000 7f9c47fff640 1 -- 172.21.15.8:0/1014736655 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9c40003990 con 0x7f9c5006faf0 2023-10-14T10:34:20.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.060+0000 7f9c47fff640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9c3006ae70 0x7f9c3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.060+0000 7f9c47fff640 1 -- 172.21.15.8:0/1014736655 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c40088c20 con 0x7f9c5006faf0 2023-10-14T10:34:20.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.060+0000 7f9c467fc640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9c3006ae70 0x7f9c3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.061+0000 7f9c467fc640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9c3006ae70 0x7f9c3006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9c38036000 tx=0x7f9c38008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:20.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.064+0000 7f9c47fff640 1 -- 172.21.15.8:0/1014736655 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c40053c40 con 0x7f9c5006faf0 2023-10-14T10:34:20.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.261+0000 7f9c4ffff640 1 -- 172.21.15.8:0/1014736655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c500720a0 con 0x7f9c5006faf0 2023-10-14T10:34:20.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.262+0000 7f9c47fff640 1 -- 172.21.15.8:0/1014736655 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7f9c40074e60 con 0x7f9c5006faf0 2023-10-14T10:34:20.265 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:20.265 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.265+0000 7f9c4ffff640 1 -- 172.21.15.8:0/1014736655 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9c3006ae70 msgr2=0x7f9c3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.265+0000 7f9c4ffff640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9c3006ae70 0x7f9c3006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9c38036000 tx=0x7f9c38008030 comp rx=0 tx=0).stop 2023-10-14T10:34:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.265+0000 7f9c4ffff640 1 -- 172.21.15.8:0/1014736655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5006faf0 msgr2=0x7f9c50147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.265+0000 7f9c4ffff640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5006faf0 0x7f9c50147ec0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000c400 tx=0x7f9c4000c8c0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.265+0000 7f9c4ffff640 1 -- 172.21.15.8:0/1014736655 shutdown_connections 2023-10-14T10:34:20.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.265+0000 7f9c4ffff640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9c3006ae70 0x7f9c3006d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.265+0000 7f9c4ffff640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c5014abb0 0x7f9c50146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.265+0000 7f9c4ffff640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c500a9610 0x7f9c5014c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.265+0000 7f9c4ffff640 1 --2- 172.21.15.8:0/1014736655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c5006faf0 0x7f9c50147ec0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.265+0000 7f9c4ffff640 1 -- 172.21.15.8:0/1014736655 >> 172.21.15.8:0/1014736655 conn(0x7f9c5006a200 msgr2=0x7f9c5006ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:20.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.266+0000 7f9c4ffff640 1 -- 172.21.15.8:0/1014736655 shutdown_connections 2023-10-14T10:34:20.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.266+0000 7f9c4ffff640 1 -- 172.21.15.8:0/1014736655 wait complete. 2023-10-14T10:34:20.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T10:33:44.913451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T10:33:46.397320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:34:20.286 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:34:20.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.513+0000 7f0ca17e9640 1 Processor -- start 2023-10-14T10:34:20.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.514+0000 7f0ca17e9640 1 -- start start 2023-10-14T10:34:20.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.515+0000 7f0ca17e9640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0c9c151700 0x7f0c9c0c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.516+0000 7f0ca17e9640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c0c5950 con 0x7f0c9c0c4430 2023-10-14T10:34:20.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.516+0000 7f0ca17e9640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c0c5e60 con 0x7f0c9c154bf0 2023-10-14T10:34:20.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.516+0000 7f0ca17e9640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c154760 con 0x7f0c9c151700 2023-10-14T10:34:20.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.516+0000 7f0ca0fe8640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0c9c0c4430 0x7f0c9c0c7570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44292/0 (socket says 172.21.15.8:44292) 2023-10-14T10:34:20.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.516+0000 7f0ca0fe8640 1 -- 172.21.15.8:0/2293065331 learned_addr learned my addr 172.21.15.8:0/2293065331 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:20.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.516+0000 7f0c9bfff640 1 --2- 172.21.15.8:0/2293065331 >> v2:172.21.15.92:3300/0 conn(0x7f0c9c151700 0x7f0c9c0c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.517+0000 7f0c9bfff640 1 -- 172.21.15.8:0/2293065331 >> v1:172.21.15.92:6789/0 conn(0x7f0c9c154bf0 legacy=0x7f0c9c0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.517+0000 7f0c9bfff640 1 -- 172.21.15.8:0/2293065331 >> v1:172.21.15.8:6789/0 conn(0x7f0c9c0c4430 legacy=0x7f0c9c0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.517+0000 7f0c9bfff640 1 -- 172.21.15.8:0/2293065331 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c0c5b80 con 0x7f0c9c151700 2023-10-14T10:34:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.518+0000 7f0c9bfff640 1 --2- 172.21.15.8:0/2293065331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c9c151700 0x7f0c9c0c5410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0097a0 tx=0x7f0c8c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36f778aa8648dc77 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:20.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.524+0000 7f0c9affd640 1 -- 172.21.15.8:0/2293065331 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c030610 con 0x7f0c9c151700 2023-10-14T10:34:20.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.524+0000 7f0c9affd640 1 -- 172.21.15.8:0/2293065331 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c030770 con 0x7f0c9c151700 2023-10-14T10:34:20.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.524+0000 7f0c9affd640 1 -- 172.21.15.8:0/2293065331 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c030b00 con 0x7f0c9c151700 2023-10-14T10:34:20.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.525+0000 7f0ca17e9640 1 -- 172.21.15.8:0/2293065331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c9c151700 msgr2=0x7f0c9c0c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.525+0000 7f0ca17e9640 1 --2- 172.21.15.8:0/2293065331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c9c151700 0x7f0c9c0c5410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0097a0 tx=0x7f0c8c02b960 comp rx=0 tx=0).stop 2023-10-14T10:34:20.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.525+0000 7f0ca17e9640 1 -- 172.21.15.8:0/2293065331 shutdown_connections 2023-10-14T10:34:20.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.525+0000 7f0ca17e9640 1 --2- 172.21.15.8:0/2293065331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c9c151700 0x7f0c9c0c5410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.525+0000 7f0ca17e9640 1 -- 172.21.15.8:0/2293065331 >> 172.21.15.8:0/2293065331 conn(0x7f0c9c0c9670 msgr2=0x7f0c9c0c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:20.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.525+0000 7f0ca17e9640 1 -- 172.21.15.8:0/2293065331 shutdown_connections 2023-10-14T10:34:20.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.525+0000 7f0ca17e9640 1 -- 172.21.15.8:0/2293065331 wait complete. 2023-10-14T10:34:20.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.527+0000 7f0ca17e9640 1 Processor -- start 2023-10-14T10:34:20.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.527+0000 7f0ca17e9640 1 -- start start 2023-10-14T10:34:20.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0ca17e9640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c9c0c4430 0x7f0c9c146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0ca17e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c9c151700 0x7f0c9c14c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0ca17e9640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c9c154bf0 0x7f0c9c14cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0ca17e9640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c151ae0 con 0x7f0c9c0c4430 2023-10-14T10:34:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0ca17e9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c14c270 con 0x7f0c9c151700 2023-10-14T10:34:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0ca17e9640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c1464d0 con 0x7f0c9c154bf0 2023-10-14T10:34:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0c9bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c9c0c4430 0x7f0c9c146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0c9bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c9c0c4430 0x7f0c9c146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42266/0 (socket says 172.21.15.8:42266) 2023-10-14T10:34:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0c9bfff640 1 -- 172.21.15.8:0/4198928092 learned_addr learned my addr 172.21.15.8:0/4198928092 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0c9b7fe640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c9c151700 0x7f0c9c14c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0ca0fe8640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c9c154bf0 0x7f0c9c14cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0c9bfff640 1 -- 172.21.15.8:0/4198928092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c9c154bf0 msgr2=0x7f0c9c14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0c9bfff640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c9c154bf0 0x7f0c9c14cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0c9bfff640 1 -- 172.21.15.8:0/4198928092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c9c151700 msgr2=0x7f0c9c14c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0c9bfff640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c9c151700 0x7f0c9c14c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.528+0000 7f0c9bfff640 1 -- 172.21.15.8:0/4198928092 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c009400 con 0x7f0c9c0c4430 2023-10-14T10:34:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.529+0000 7f0c9b7fe640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c9c151700 0x7f0c9c14c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:20.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.529+0000 7f0ca0fe8640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c9c154bf0 0x7f0c9c14cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:20.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.529+0000 7f0c9bfff640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c9c0c4430 0x7f0c9c146ed0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c039700 tx=0x7f0c8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:20.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.529+0000 7f0c98ff9640 1 -- 172.21.15.8:0/4198928092 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c03e040 con 0x7f0c9c0c4430 2023-10-14T10:34:20.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.529+0000 7f0c98ff9640 1 -- 172.21.15.8:0/4198928092 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c039d10 con 0x7f0c9c0c4430 2023-10-14T10:34:20.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.529+0000 7f0c98ff9640 1 -- 172.21.15.8:0/4198928092 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c043680 con 0x7f0c9c0c4430 2023-10-14T10:34:20.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.529+0000 7f0ca17e9640 1 -- 172.21.15.8:0/4198928092 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c144f90 con 0x7f0c9c0c4430 2023-10-14T10:34:20.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.529+0000 7f0ca17e9640 1 -- 172.21.15.8:0/4198928092 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c145550 con 0x7f0c9c0c4430 2023-10-14T10:34:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.531+0000 7f0ca17e9640 1 -- 172.21.15.8:0/4198928092 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c1543d0 con 0x7f0c9c0c4430 2023-10-14T10:34:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.531+0000 7f0c98ff9640 1 -- 172.21.15.8:0/4198928092 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0c8c0423e0 con 0x7f0c9c0c4430 2023-10-14T10:34:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.532+0000 7f0c98ff9640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0c8406ae70 0x7f0c8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.532+0000 7f0c98ff9640 1 -- 172.21.15.8:0/4198928092 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c8c0ab6a0 con 0x7f0c9c0c4430 2023-10-14T10:34:20.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.533+0000 7f0c9b7fe640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0c8406ae70 0x7f0c8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.533+0000 7f0c9b7fe640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0c8406ae70 0x7f0c8406d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0af6f0 tx=0x7f0c88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:20.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.540+0000 7f0c98ff9640 1 -- 172.21.15.8:0/4198928092 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c9c1543d0 con 0x7f0c9c0c4430 2023-10-14T10:34:20.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.731+0000 7f0ca17e9640 1 -- 172.21.15.8:0/4198928092 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c9c1543d0 con 0x7f0c9c0c4430 2023-10-14T10:34:20.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.732+0000 7f0c98ff9640 1 -- 172.21.15.8:0/4198928092 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c9c1543d0 con 0x7f0c9c0c4430 2023-10-14T10:34:20.734 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:34:20.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.734+0000 7f0ca17e9640 1 -- 172.21.15.8:0/4198928092 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0c8406ae70 msgr2=0x7f0c8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.734+0000 7f0ca17e9640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0c8406ae70 0x7f0c8406d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0af6f0 tx=0x7f0c88009040 comp rx=0 tx=0).stop 2023-10-14T10:34:20.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.735+0000 7f0ca17e9640 1 -- 172.21.15.8:0/4198928092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c9c0c4430 msgr2=0x7f0c9c146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.735+0000 7f0ca17e9640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c9c0c4430 0x7f0c9c146ed0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c039700 tx=0x7f0c8c004730 comp rx=0 tx=0).stop 2023-10-14T10:34:20.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.735+0000 7f0ca17e9640 1 -- 172.21.15.8:0/4198928092 shutdown_connections 2023-10-14T10:34:20.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.735+0000 7f0ca17e9640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0c8406ae70 0x7f0c8406d330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.735+0000 7f0ca17e9640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c9c154bf0 0x7f0c9c14cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.735+0000 7f0ca17e9640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c9c151700 0x7f0c9c14c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.735+0000 7f0ca17e9640 1 --2- 172.21.15.8:0/4198928092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c9c0c4430 0x7f0c9c146ed0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.735+0000 7f0ca17e9640 1 -- 172.21.15.8:0/4198928092 >> 172.21.15.8:0/4198928092 conn(0x7f0c9c0c9670 msgr2=0x7f0c9c0aa510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.735+0000 7f0ca17e9640 1 -- 172.21.15.8:0/4198928092 shutdown_connections 2023-10-14T10:34:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.735+0000 7f0ca17e9640 1 -- 172.21.15.8:0/4198928092 wait complete. 2023-10-14T10:34:20.757 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T10:34:20.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.982+0000 7f2ef494c640 1 Processor -- start 2023-10-14T10:34:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.982+0000 7f2ef494c640 1 -- start start 2023-10-14T10:34:20.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.984+0000 7f2ef494c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2ef00c4290 0x7f2ef0154d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.984+0000 7f2ef494c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef00c7810 0x7f2ef00c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.984+0000 7f2ef494c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef00c4ac0 con 0x7f2ef00c4670 2023-10-14T10:34:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.984+0000 7f2ef494c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef006bf80 con 0x7f2ef00c4290 2023-10-14T10:34:20.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.984+0000 7f2ef494c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef013cf00 con 0x7f2ef00c7810 2023-10-14T10:34:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.985+0000 7f2eee59c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2ef00c4290 0x7f2ef0154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.985+0000 7f2ee5d9b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef00c7810 0x7f2ef00c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.985+0000 7f2eee59c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2ef00c4290 0x7f2ef0154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:44266/0 (socket says 172.21.15.8:44266) 2023-10-14T10:34:20.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.985+0000 7f2eee59c640 1 -- 172.21.15.8:0/1958189028 learned_addr learned my addr 172.21.15.8:0/1958189028 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:20.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.986+0000 7f2eedd9b640 1 -- 172.21.15.8:0/1958189028 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804307257 0 0) 0x7f2ef00c4ac0 con 0x7f2ef00c4670 2023-10-14T10:34:20.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.986+0000 7f2eedd9b640 1 -- 172.21.15.8:0/1958189028 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2edc003520 con 0x7f2ef00c4670 2023-10-14T10:34:20.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.986+0000 7f2eee59c640 1 -- 172.21.15.8:0/1958189028 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef00c7810 msgr2=0x7f2ef00c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.986+0000 7f2eee59c640 1 --2- 172.21.15.8:0/1958189028 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef00c7810 0x7f2ef00c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.986+0000 7f2eee59c640 1 -- 172.21.15.8:0/1958189028 >> v1:172.21.15.92:6789/0 conn(0x7f2ef00c4670 legacy=0x7f2ef0157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.986+0000 7f2eee59c640 1 -- 172.21.15.8:0/1958189028 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef00c7030 con 0x7f2ef00c4290 2023-10-14T10:34:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.986+0000 7f2ee5d9b640 1 --2- 172.21.15.8:0/1958189028 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef00c7810 0x7f2ef00c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:34:20.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.988+0000 7f2eee59c640 1 --2- 172.21.15.8:0/1958189028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef00c4290 0x7f2ef0154d70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009870 tx=0x7f2ee002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=429f0262a0322e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:20.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.988+0000 7f2eedd9b640 1 -- 172.21.15.8:0/1958189028 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee00317c0 con 0x7f2ef00c4290 2023-10-14T10:34:20.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.988+0000 7f2eedd9b640 1 -- 172.21.15.8:0/1958189028 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee0031920 con 0x7f2ef00c4290 2023-10-14T10:34:20.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.988+0000 7f2eedd9b640 1 -- 172.21.15.8:0/1958189028 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0031cb0 con 0x7f2ef00c4290 2023-10-14T10:34:20.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.989+0000 7f2ef494c640 1 -- 172.21.15.8:0/1958189028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef00c4290 msgr2=0x7f2ef0154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:20.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.989+0000 7f2ef494c640 1 --2- 172.21.15.8:0/1958189028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef00c4290 0x7f2ef0154d70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009870 tx=0x7f2ee002b860 comp rx=0 tx=0).stop 2023-10-14T10:34:20.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.989+0000 7f2ef494c640 1 -- 172.21.15.8:0/1958189028 shutdown_connections 2023-10-14T10:34:20.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.989+0000 7f2ef494c640 1 --2- 172.21.15.8:0/1958189028 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef00c7810 0x7f2ef00c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.989+0000 7f2ef494c640 1 --2- 172.21.15.8:0/1958189028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef00c4290 0x7f2ef0154d70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:20.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.989+0000 7f2ef494c640 1 -- 172.21.15.8:0/1958189028 >> 172.21.15.8:0/1958189028 conn(0x7f2ef0065c90 msgr2=0x7f2ef00660a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:20.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.989+0000 7f2ef494c640 1 -- 172.21.15.8:0/1958189028 shutdown_connections 2023-10-14T10:34:20.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.989+0000 7f2ef494c640 1 -- 172.21.15.8:0/1958189028 wait complete. 2023-10-14T10:34:20.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.991+0000 7f2ef494c640 1 Processor -- start 2023-10-14T10:34:20.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.991+0000 7f2ef494c640 1 -- start start 2023-10-14T10:34:20.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.992+0000 7f2ef494c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef00c4290 0x7f2ef00c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.992+0000 7f2ef494c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef00c4670 0x7f2ef00a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.992+0000 7f2ef494c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ef00c7810 0x7f2ef00a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.992+0000 7f2ef494c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00c0760 con 0x7f2ef00c7810 2023-10-14T10:34:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.992+0000 7f2ef494c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00af8f0 con 0x7f2ef00c4290 2023-10-14T10:34:20.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.992+0000 7f2ef494c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef01391f0 con 0x7f2ef00c4670 2023-10-14T10:34:20.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.992+0000 7f2eeed9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ef00c7810 0x7f2ef00a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.992+0000 7f2eeed9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ef00c7810 0x7f2ef00a9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42280/0 (socket says 172.21.15.8:42280) 2023-10-14T10:34:20.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.992+0000 7f2eeed9d640 1 -- 172.21.15.8:0/4100637845 learned_addr learned my addr 172.21.15.8:0/4100637845 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:20.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.992+0000 7f2eee59c640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef00c4290 0x7f2ef00c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:20.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.992+0000 7f2ee5d9b640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef00c4670 0x7f2ef00a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.993+0000 7f2eeed9d640 1 -- 172.21.15.8:0/4100637845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef00c4670 msgr2=0x7f2ef00a96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.993+0000 7f2eeed9d640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef00c4670 0x7f2ef00a96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.993+0000 7f2eeed9d640 1 -- 172.21.15.8:0/4100637845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef00c4290 msgr2=0x7f2ef00c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.993+0000 7f2eeed9d640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef00c4290 0x7f2ef00c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.993+0000 7f2eeed9d640 1 -- 172.21.15.8:0/4100637845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed8009400 con 0x7f2ef00c7810 2023-10-14T10:34:21.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.993+0000 7f2ee5d9b640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef00c4670 0x7f2ef00a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:21.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.993+0000 7f2eeed9d640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ef00c7810 0x7f2ef00a9bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c700 tx=0x7f2ee800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:21.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.993+0000 7f2ee77fe640 1 -- 172.21.15.8:0/4100637845 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8003b70 con 0x7f2ef00c7810 2023-10-14T10:34:21.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.993+0000 7f2ee77fe640 1 -- 172.21.15.8:0/4100637845 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee8003cd0 con 0x7f2ef00c7810 2023-10-14T10:34:21.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.993+0000 7f2ee77fe640 1 -- 172.21.15.8:0/4100637845 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80052d0 con 0x7f2ef00c7810 2023-10-14T10:34:21.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.993+0000 7f2ef494c640 1 -- 172.21.15.8:0/4100637845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee00094d0 con 0x7f2ef00c7810 2023-10-14T10:34:21.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.994+0000 7f2ef494c640 1 -- 172.21.15.8:0/4100637845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef00af580 con 0x7f2ef00c7810 2023-10-14T10:34:21.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.995+0000 7f2ef494c640 1 -- 172.21.15.8:0/4100637845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef00af740 con 0x7f2ef00c7810 2023-10-14T10:34:21.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.996+0000 7f2ee77fe640 1 -- 172.21.15.8:0/4100637845 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2ee8005430 con 0x7f2ef00c7810 2023-10-14T10:34:21.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.997+0000 7f2ee77fe640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ed006aea0 0x7f2ed006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.997+0000 7f2ee77fe640 1 -- 172.21.15.8:0/4100637845 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ee8089330 con 0x7f2ef00c7810 2023-10-14T10:34:21.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.998+0000 7f2eee59c640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ed006aea0 0x7f2ed006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:20.998+0000 7f2eee59c640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ed006aea0 0x7f2ed006d360 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0036000 tx=0x7f2ee003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:21.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.004+0000 7f2ee77fe640 1 -- 172.21.15.8:0/4100637845 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ee8054340 con 0x7f2ef00c7810 2023-10-14T10:34:21.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.199+0000 7f2ef494c640 1 -- 172.21.15.8:0/4100637845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ef00a93d0 con 0x7f2ef00c7810 2023-10-14T10:34:21.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.200+0000 7f2ee77fe640 1 -- 172.21.15.8:0/4100637845 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ee8057960 con 0x7f2ef00c7810 2023-10-14T10:34:21.202 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T10:34:21.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.203+0000 7f2ef494c640 1 -- 172.21.15.8:0/4100637845 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ed006aea0 msgr2=0x7f2ed006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.203+0000 7f2ef494c640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ed006aea0 0x7f2ed006d360 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0036000 tx=0x7f2ee003d040 comp rx=0 tx=0).stop 2023-10-14T10:34:21.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.203+0000 7f2ef494c640 1 -- 172.21.15.8:0/4100637845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ef00c7810 msgr2=0x7f2ef00a9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.203+0000 7f2ef494c640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ef00c7810 0x7f2ef00a9bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c700 tx=0x7f2ee800cbc0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.203+0000 7f2ef494c640 1 -- 172.21.15.8:0/4100637845 shutdown_connections 2023-10-14T10:34:21.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.203+0000 7f2ef494c640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ed006aea0 0x7f2ed006d360 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.203+0000 7f2ef494c640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ef00c7810 0x7f2ef00a9bf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.203+0000 7f2ef494c640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef00c4670 0x7f2ef00a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.203+0000 7f2ef494c640 1 --2- 172.21.15.8:0/4100637845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef00c4290 0x7f2ef00c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.203+0000 7f2ef494c640 1 -- 172.21.15.8:0/4100637845 >> 172.21.15.8:0/4100637845 conn(0x7f2ef0065c90 msgr2=0x7f2ef0154bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.203+0000 7f2ef494c640 1 -- 172.21.15.8:0/4100637845 shutdown_connections 2023-10-14T10:34:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.203+0000 7f2ef494c640 1 -- 172.21.15.8:0/4100637845 wait complete. 2023-10-14T10:34:21.224 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T10:34:21.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.454+0000 7fde39175640 1 Processor -- start 2023-10-14T10:34:21.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.454+0000 7fde39175640 1 -- start start 2023-10-14T10:34:21.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.456+0000 7fde39175640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde3413af90 0x7fde340a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.456+0000 7fde39175640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fde340bfc10 0x7fde340c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.456+0000 7fde39175640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde34152ac0 con 0x7fde3406fb10 2023-10-14T10:34:21.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.456+0000 7fde39175640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde34151eb0 con 0x7fde340bfc10 2023-10-14T10:34:21.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.456+0000 7fde39175640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde34152190 con 0x7fde3413af90 2023-10-14T10:34:21.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.456+0000 7fde2bfff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fde3406fb10 0x7fde340c2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44302/0 (socket says 172.21.15.8:44302) 2023-10-14T10:34:21.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.456+0000 7fde2bfff640 1 -- 172.21.15.8:0/3073169390 learned_addr learned my addr 172.21.15.8:0/3073169390 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:21.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.457+0000 7fde38974640 1 --2- 172.21.15.8:0/3073169390 >> v2:172.21.15.8:3300/0 conn(0x7fde340bfc10 0x7fde340c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.457+0000 7fde33fff640 1 --2- 172.21.15.8:0/3073169390 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde3413af90 0x7fde340a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.457+0000 7fde337fe640 1 -- 172.21.15.8:0/3073169390 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975838376 0 0) 0x7fde34152ac0 con 0x7fde3406fb10 2023-10-14T10:34:21.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.457+0000 7fde337fe640 1 -- 172.21.15.8:0/3073169390 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde20003520 con 0x7fde3406fb10 2023-10-14T10:34:21.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.457+0000 7fde38974640 1 -- 172.21.15.8:0/3073169390 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde3413af90 msgr2=0x7fde340a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:21.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.457+0000 7fde38974640 1 --2- 172.21.15.8:0/3073169390 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde3413af90 0x7fde340a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.457+0000 7fde38974640 1 -- 172.21.15.8:0/3073169390 >> v1:172.21.15.8:6789/0 conn(0x7fde3406fb10 legacy=0x7fde340c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.457+0000 7fde38974640 1 -- 172.21.15.8:0/3073169390 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde34152470 con 0x7fde340bfc10 2023-10-14T10:34:21.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.458+0000 7fde38974640 1 --2- 172.21.15.8:0/3073169390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde340bfc10 0x7fde340c00c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009dc0 tx=0x7fde2c02bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bf0c9de0b14957 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:21.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.459+0000 7fde337fe640 1 -- 172.21.15.8:0/3073169390 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c02cba0 con 0x7fde340bfc10 2023-10-14T10:34:21.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.459+0000 7fde337fe640 1 -- 172.21.15.8:0/3073169390 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c02cd00 con 0x7fde340bfc10 2023-10-14T10:34:21.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.459+0000 7fde337fe640 1 -- 172.21.15.8:0/3073169390 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c034660 con 0x7fde340bfc10 2023-10-14T10:34:21.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.459+0000 7fde39175640 1 -- 172.21.15.8:0/3073169390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde340bfc10 msgr2=0x7fde340c00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.459+0000 7fde39175640 1 --2- 172.21.15.8:0/3073169390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde340bfc10 0x7fde340c00c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009dc0 tx=0x7fde2c02bdf0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.459+0000 7fde39175640 1 -- 172.21.15.8:0/3073169390 shutdown_connections 2023-10-14T10:34:21.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.459+0000 7fde39175640 1 --2- 172.21.15.8:0/3073169390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde340bfc10 0x7fde340c00c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.459+0000 7fde39175640 1 --2- 172.21.15.8:0/3073169390 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde3413af90 0x7fde340a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.459+0000 7fde39175640 1 -- 172.21.15.8:0/3073169390 >> 172.21.15.8:0/3073169390 conn(0x7fde3406a200 msgr2=0x7fde3406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:21.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.460+0000 7fde39175640 1 -- 172.21.15.8:0/3073169390 shutdown_connections 2023-10-14T10:34:21.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.460+0000 7fde39175640 1 -- 172.21.15.8:0/3073169390 wait complete. 2023-10-14T10:34:21.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.461+0000 7fde39175640 1 Processor -- start 2023-10-14T10:34:21.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.462+0000 7fde39175640 1 -- start start 2023-10-14T10:34:21.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.462+0000 7fde39175640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3406fb10 0x7fde34151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.462+0000 7fde39175640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde340bfc10 0x7fde341e9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde39175640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde3413af90 0x7fde341e9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde39175640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde340c3330 con 0x7fde340bfc10 2023-10-14T10:34:21.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde39175640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde340c2fe0 con 0x7fde3406fb10 2023-10-14T10:34:21.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde39175640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde341ed2c0 con 0x7fde3413af90 2023-10-14T10:34:21.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde2bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde340bfc10 0x7fde341e9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde2bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde340bfc10 0x7fde341e9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42294/0 (socket says 172.21.15.8:42294) 2023-10-14T10:34:21.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde2bfff640 1 -- 172.21.15.8:0/3772664680 learned_addr learned my addr 172.21.15.8:0/3772664680 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:21.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde38974640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde3413af90 0x7fde341e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde2bfff640 1 -- 172.21.15.8:0/3772664680 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde3413af90 msgr2=0x7fde341e9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde2bfff640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde3413af90 0x7fde341e9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde2bfff640 1 -- 172.21.15.8:0/3772664680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3406fb10 msgr2=0x7fde34151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde33fff640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3406fb10 0x7fde34151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde2bfff640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3406fb10 0x7fde34151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.463+0000 7fde2bfff640 1 -- 172.21.15.8:0/3772664680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c009a70 con 0x7fde340bfc10 2023-10-14T10:34:21.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.464+0000 7fde2bfff640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde340bfc10 0x7fde341e9340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00c4d0 tx=0x7fde1c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:21.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.464+0000 7fde317fa640 1 -- 172.21.15.8:0/3772664680 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c005ce0 con 0x7fde340bfc10 2023-10-14T10:34:21.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.464+0000 7fde317fa640 1 -- 172.21.15.8:0/3772664680 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c005e40 con 0x7fde340bfc10 2023-10-14T10:34:21.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.464+0000 7fde317fa640 1 -- 172.21.15.8:0/3772664680 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c007270 con 0x7fde340bfc10 2023-10-14T10:34:21.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.464+0000 7fde39175640 1 -- 172.21.15.8:0/3772664680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde341ed5a0 con 0x7fde340bfc10 2023-10-14T10:34:21.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.464+0000 7fde39175640 1 -- 172.21.15.8:0/3772664680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde341517b0 con 0x7fde340bfc10 2023-10-14T10:34:21.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.465+0000 7fde39175640 1 -- 172.21.15.8:0/3772664680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde340619f0 con 0x7fde340bfc10 2023-10-14T10:34:21.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.466+0000 7fde317fa640 1 -- 172.21.15.8:0/3772664680 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde1c007490 con 0x7fde340bfc10 2023-10-14T10:34:21.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.467+0000 7fde317fa640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fde1406ae70 0x7fde1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.467+0000 7fde317fa640 1 -- 172.21.15.8:0/3772664680 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde1c088b90 con 0x7fde340bfc10 2023-10-14T10:34:21.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.467+0000 7fde33fff640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fde1406ae70 0x7fde1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.468+0000 7fde33fff640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fde1406ae70 0x7fde1406d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fde24009970 tx=0x7fde24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:21.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.471+0000 7fde317fa640 1 -- 172.21.15.8:0/3772664680 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde1c053c50 con 0x7fde340bfc10 2023-10-14T10:34:21.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.667+0000 7fde39175640 1 -- 172.21.15.8:0/3772664680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde34139770 con 0x7fde340bfc10 2023-10-14T10:34:21.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.668+0000 7fde317fa640 1 -- 172.21.15.8:0/3772664680 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde1c017020 con 0x7fde340bfc10 2023-10-14T10:34:21.670 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T10:34:21.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.671+0000 7fde39175640 1 -- 172.21.15.8:0/3772664680 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fde1406ae70 msgr2=0x7fde1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.671+0000 7fde39175640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fde1406ae70 0x7fde1406d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fde24009970 tx=0x7fde24008040 comp rx=0 tx=0).stop 2023-10-14T10:34:21.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.671+0000 7fde39175640 1 -- 172.21.15.8:0/3772664680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde340bfc10 msgr2=0x7fde341e9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.671+0000 7fde39175640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde340bfc10 0x7fde341e9340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00c4d0 tx=0x7fde1c00c990 comp rx=0 tx=0).stop 2023-10-14T10:34:21.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.671+0000 7fde39175640 1 -- 172.21.15.8:0/3772664680 shutdown_connections 2023-10-14T10:34:21.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.671+0000 7fde39175640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fde1406ae70 0x7fde1406d330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.671+0000 7fde39175640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde3413af90 0x7fde341e9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.671+0000 7fde39175640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde340bfc10 0x7fde341e9340 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.671+0000 7fde39175640 1 --2- 172.21.15.8:0/3772664680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde3406fb10 0x7fde34151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.671+0000 7fde39175640 1 -- 172.21.15.8:0/3772664680 >> 172.21.15.8:0/3772664680 conn(0x7fde3406a200 msgr2=0x7fde34138320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:21.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.671+0000 7fde39175640 1 -- 172.21.15.8:0/3772664680 shutdown_connections 2023-10-14T10:34:21.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.671+0000 7fde39175640 1 -- 172.21.15.8:0/3772664680 wait complete. 2023-10-14T10:34:21.712 INFO:tasks.cephfs_test_runner:Starting test: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) That unsetting mds_join_fs will not cause failover if no high-affinity standby exists. 2023-10-14T10:34:21.713 INFO:tasks.cephfs_test_runner:test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) 2023-10-14T10:34:21.713 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:21.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.938+0000 7faf71226640 1 Processor -- start 2023-10-14T10:34:21.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.938+0000 7faf71226640 1 -- start start 2023-10-14T10:34:21.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.940+0000 7faf71226640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c151590 0x7faf6c155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.940+0000 7faf71226640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7faf6c154a00 0x7faf6c157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.940+0000 7faf71226640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6c0ca6c0 con 0x7faf6c0c4210 2023-10-14T10:34:21.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.940+0000 7faf71226640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6c0c4f70 con 0x7faf6c154a00 2023-10-14T10:34:21.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.940+0000 7faf71226640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c157a10 con 0x7faf6c151590 2023-10-14T10:34:21.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.940+0000 7faf6b59e640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7faf6c0c4210 0x7faf6c0c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44308/0 (socket says 172.21.15.8:44308) 2023-10-14T10:34:21.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.940+0000 7faf6b59e640 1 -- 172.21.15.8:0/3579442801 learned_addr learned my addr 172.21.15.8:0/3579442801 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:21.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf6ad9d640 1 --2- 172.21.15.8:0/3579442801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c151590 0x7faf6c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf63fff640 1 --2- 172.21.15.8:0/3579442801 >> v2:172.21.15.92:3300/0 conn(0x7faf6c154a00 0x7faf6c157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451082581 0 0) 0x7faf6c0ca6c0 con 0x7faf6c0c4210 2023-10-14T10:34:21.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf58003520 con 0x7faf6c0c4210 2023-10-14T10:34:21.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3480958533 0 0) 0x7faf58003520 con 0x7faf6c0c4210 2023-10-14T10:34:21.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c151590 msgr2=0x7faf6c155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:21.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf6a59c640 1 --2- 172.21.15.8:0/3579442801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c151590 0x7faf6c155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 >> v2:172.21.15.92:3300/0 conn(0x7faf6c154a00 msgr2=0x7faf6c157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:21.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf6a59c640 1 --2- 172.21.15.8:0/3579442801 >> v2:172.21.15.92:3300/0 conn(0x7faf6c154a00 0x7faf6c157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c06c8f0 con 0x7faf6c0c4210 2023-10-14T10:34:21.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7faf640019f0 con 0x7faf6c0c4210 2023-10-14T10:34:21.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 >> v1:172.21.15.8:6789/0 conn(0x7faf6c0c4210 legacy=0x7faf6c0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.941+0000 7faf6a59c640 1 --2- 172.21.15.8:0/3579442801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf58003970 0x7faf58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf6a59c640 1 --2- 172.21.15.8:0/3579442801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf580047c0 0x7faf58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf6a59c640 1 --2- 172.21.15.8:0/3579442801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c151590 0x7faf58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c157a10 con 0x7faf580047c0 2023-10-14T10:34:21.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5800b980 con 0x7faf58003970 2023-10-14T10:34:21.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5800bb40 con 0x7faf6c151590 2023-10-14T10:34:21.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf63fff640 1 --2- 172.21.15.8:0/3579442801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf580047c0 0x7faf58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf6b59e640 1 --2- 172.21.15.8:0/3579442801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c151590 0x7faf58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf6ad9d640 1 --2- 172.21.15.8:0/3579442801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf58003970 0x7faf58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf63fff640 1 -- 172.21.15.8:0/3579442801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c151590 msgr2=0x7faf58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:21.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf63fff640 1 --2- 172.21.15.8:0/3579442801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c151590 0x7faf58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf63fff640 1 -- 172.21.15.8:0/3579442801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf58003970 msgr2=0x7faf58003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:21.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf63fff640 1 --2- 172.21.15.8:0/3579442801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf58003970 0x7faf58003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.942+0000 7faf63fff640 1 -- 172.21.15.8:0/3579442801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf58003520 con 0x7faf580047c0 2023-10-14T10:34:21.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.944+0000 7faf63fff640 1 --2- 172.21.15.8:0/3579442801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf580047c0 0x7faf58004c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf54009ac0 tx=0x7faf580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c16cf790af7f54 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:21.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.944+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5402c710 con 0x7faf580047c0 2023-10-14T10:34:21.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.944+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5402c870 con 0x7faf580047c0 2023-10-14T10:34:21.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.944+0000 7faf6a59c640 1 -- 172.21.15.8:0/3579442801 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5402cc00 con 0x7faf580047c0 2023-10-14T10:34:21.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.944+0000 7faf71226640 1 -- 172.21.15.8:0/3579442801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf580047c0 msgr2=0x7faf58004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.944+0000 7faf71226640 1 --2- 172.21.15.8:0/3579442801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf580047c0 0x7faf58004c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf54009ac0 tx=0x7faf580057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.945+0000 7faf6b59e640 1 -- 172.21.15.8:0/3579442801 reap_dead start 2023-10-14T10:34:21.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.945+0000 7faf71226640 1 -- 172.21.15.8:0/3579442801 shutdown_connections 2023-10-14T10:34:21.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.945+0000 7faf71226640 1 -- 172.21.15.8:0/3579442801 >> 172.21.15.8:0/3579442801 conn(0x7faf6c065ed0 msgr2=0x7faf6c0662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:21.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.945+0000 7faf71226640 1 -- 172.21.15.8:0/3579442801 shutdown_connections 2023-10-14T10:34:21.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.945+0000 7faf71226640 1 -- 172.21.15.8:0/3579442801 wait complete. 2023-10-14T10:34:21.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.946+0000 7faf71226640 1 Processor -- start 2023-10-14T10:34:21.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.947+0000 7faf71226640 1 -- start start 2023-10-14T10:34:21.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.947+0000 7faf71226640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf580047c0 0x7faf6c0aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.947+0000 7faf71226640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c1483f0 0x7faf6c0be030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.947+0000 7faf71226640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf6c147980 0x7faf6c147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.947+0000 7faf71226640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0c0c20 con 0x7faf580047c0 2023-10-14T10:34:21.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.947+0000 7faf71226640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0ac2a0 con 0x7faf6c147980 2023-10-14T10:34:21.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.947+0000 7faf71226640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0c3320 con 0x7faf6c1483f0 2023-10-14T10:34:21.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.948+0000 7faf6ad9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf580047c0 0x7faf6c0aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.948+0000 7faf6ad9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf580047c0 0x7faf6c0aa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42318/0 (socket says 172.21.15.8:42318) 2023-10-14T10:34:21.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.948+0000 7faf6ad9d640 1 -- 172.21.15.8:0/4092837362 learned_addr learned my addr 172.21.15.8:0/4092837362 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:21.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.948+0000 7faf63fff640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c1483f0 0x7faf6c0be030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.948+0000 7faf6ad9d640 1 -- 172.21.15.8:0/4092837362 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c1483f0 msgr2=0x7faf6c0be030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.948+0000 7faf6ad9d640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c1483f0 0x7faf6c0be030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.948+0000 7faf6ad9d640 1 -- 172.21.15.8:0/4092837362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf6c147980 msgr2=0x7faf6c147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:21.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.948+0000 7faf6b59e640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf6c147980 0x7faf6c147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.948+0000 7faf6ad9d640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf6c147980 0x7faf6c147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:21.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.948+0000 7faf6ad9d640 1 -- 172.21.15.8:0/4092837362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c1e9960 con 0x7faf580047c0 2023-10-14T10:34:21.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.948+0000 7faf6ad9d640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf580047c0 0x7faf6c0aa2d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faf5c011600 tx=0x7faf5c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:21.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.949+0000 7faf637fe640 1 -- 172.21.15.8:0/4092837362 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00f920 con 0x7faf580047c0 2023-10-14T10:34:21.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.949+0000 7faf637fe640 1 -- 172.21.15.8:0/4092837362 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c00fa80 con 0x7faf580047c0 2023-10-14T10:34:21.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.949+0000 7faf637fe640 1 -- 172.21.15.8:0/4092837362 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00fdf0 con 0x7faf580047c0 2023-10-14T10:34:21.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.949+0000 7faf71226640 1 -- 172.21.15.8:0/4092837362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6c1e9c40 con 0x7faf580047c0 2023-10-14T10:34:21.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.949+0000 7faf71226640 1 -- 172.21.15.8:0/4092837362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c0c3af0 con 0x7faf580047c0 2023-10-14T10:34:21.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.950+0000 7faf71226640 1 -- 172.21.15.8:0/4092837362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6c0c05d0 con 0x7faf580047c0 2023-10-14T10:34:21.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.951+0000 7faf637fe640 1 -- 172.21.15.8:0/4092837362 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf5c015460 con 0x7faf580047c0 2023-10-14T10:34:21.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.952+0000 7faf637fe640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7faf4c06ae70 0x7faf4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:21.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.952+0000 7faf637fe640 1 -- 172.21.15.8:0/4092837362 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf5c089980 con 0x7faf580047c0 2023-10-14T10:34:21.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.953+0000 7faf63fff640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7faf4c06ae70 0x7faf4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:21.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.953+0000 7faf63fff640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7faf4c06ae70 0x7faf4c06d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faf54036000 tx=0x7faf54030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:21.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:21.957+0000 7faf637fe640 1 -- 172.21.15.8:0/4092837362 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf5c054ac0 con 0x7faf580047c0 2023-10-14T10:34:22.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.152+0000 7faf71226640 1 -- 172.21.15.8:0/4092837362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf6c0c0e90 con 0x7faf580047c0 2023-10-14T10:34:22.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.154+0000 7faf637fe640 1 -- 172.21.15.8:0/4092837362 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7faf5c081e60 con 0x7faf580047c0 2023-10-14T10:34:22.156 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:22.157 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:22.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.157+0000 7faf71226640 1 -- 172.21.15.8:0/4092837362 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7faf4c06ae70 msgr2=0x7faf4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:22.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.157+0000 7faf71226640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7faf4c06ae70 0x7faf4c06d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faf54036000 tx=0x7faf54030000 comp rx=0 tx=0).stop 2023-10-14T10:34:22.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.157+0000 7faf71226640 1 -- 172.21.15.8:0/4092837362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf580047c0 msgr2=0x7faf6c0aa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:22.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.157+0000 7faf71226640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf580047c0 0x7faf6c0aa2d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faf5c011600 tx=0x7faf5c011ac0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.157+0000 7faf71226640 1 -- 172.21.15.8:0/4092837362 shutdown_connections 2023-10-14T10:34:22.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.157+0000 7faf71226640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7faf4c06ae70 0x7faf4c06d330 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.157+0000 7faf71226640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf6c147980 0x7faf6c147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.157+0000 7faf71226640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faf6c1483f0 0x7faf6c0be030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.157+0000 7faf71226640 1 --2- 172.21.15.8:0/4092837362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf580047c0 0x7faf6c0aa2d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.157+0000 7faf71226640 1 -- 172.21.15.8:0/4092837362 >> 172.21.15.8:0/4092837362 conn(0x7faf6c065ed0 msgr2=0x7faf6c156400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:22.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.158+0000 7faf71226640 1 -- 172.21.15.8:0/4092837362 shutdown_connections 2023-10-14T10:34:22.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.158+0000 7faf71226640 1 -- 172.21.15.8:0/4092837362 wait complete. 2023-10-14T10:34:22.180 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T10:33:44.913451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T10:33:46.397320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:34:22.181 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:34:22.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.413+0000 7fe6d276e640 1 Processor -- start 2023-10-14T10:34:22.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.413+0000 7fe6d276e640 1 -- start start 2023-10-14T10:34:22.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.414+0000 7fe6d276e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe6cc0c4720 0x7fe6cc06b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:22.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.415+0000 7fe6d276e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe6cc0bcd60 0x7fe6cc06b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:22.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.415+0000 7fe6d276e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc0c66f0 con 0x7fe6cc151400 2023-10-14T10:34:22.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.415+0000 7fe6d276e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6cc0c4d20 con 0x7fe6cc0bcd60 2023-10-14T10:34:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.415+0000 7fe6d276e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6cc1517e0 con 0x7fe6cc0c4720 2023-10-14T10:34:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.415+0000 7fe6d176c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe6cc151400 0x7fe6cc0c4010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44324/0 (socket says 172.21.15.8:44324) 2023-10-14T10:34:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.415+0000 7fe6d176c640 1 -- 172.21.15.8:0/672279951 learned_addr learned my addr 172.21.15.8:0/672279951 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.415+0000 7fe6d1f6d640 1 --2- 172.21.15.8:0/672279951 >> v2:172.21.15.8:3300/0 conn(0x7fe6cc0bcd60 0x7fe6cc06b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.415+0000 7fe6d0f6b640 1 --2- 172.21.15.8:0/672279951 >> v2:172.21.15.92:3300/0 conn(0x7fe6cc0c4720 0x7fe6cc06b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.415+0000 7fe6c3fff640 1 -- 172.21.15.8:0/672279951 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169421290 0 0) 0x7fe6cc0c66f0 con 0x7fe6cc151400 2023-10-14T10:34:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.416+0000 7fe6c3fff640 1 -- 172.21.15.8:0/672279951 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b8003520 con 0x7fe6cc151400 2023-10-14T10:34:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.416+0000 7fe6d1f6d640 1 -- 172.21.15.8:0/672279951 >> v2:172.21.15.92:3300/0 conn(0x7fe6cc0c4720 msgr2=0x7fe6cc06b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.416+0000 7fe6d1f6d640 1 --2- 172.21.15.8:0/672279951 >> v2:172.21.15.92:3300/0 conn(0x7fe6cc0c4720 0x7fe6cc06b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.416+0000 7fe6d1f6d640 1 -- 172.21.15.8:0/672279951 >> v1:172.21.15.8:6789/0 conn(0x7fe6cc151400 legacy=0x7fe6cc0c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.416+0000 7fe6d1f6d640 1 -- 172.21.15.8:0/672279951 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc1548d0 con 0x7fe6cc0bcd60 2023-10-14T10:34:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.416+0000 7fe6d0f6b640 1 --2- 172.21.15.8:0/672279951 >> v2:172.21.15.92:3300/0 conn(0x7fe6cc0c4720 0x7fe6cc06b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.417+0000 7fe6d1f6d640 1 --2- 172.21.15.8:0/672279951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6cc0bcd60 0x7fe6cc06b780 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0c0660 tx=0x7fe6c402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f191d75375ca08 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.417+0000 7fe6c3fff640 1 -- 172.21.15.8:0/672279951 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4031520 con 0x7fe6cc0bcd60 2023-10-14T10:34:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.417+0000 7fe6c3fff640 1 -- 172.21.15.8:0/672279951 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c4031680 con 0x7fe6cc0bcd60 2023-10-14T10:34:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.417+0000 7fe6c3fff640 1 -- 172.21.15.8:0/672279951 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4031a10 con 0x7fe6cc0bcd60 2023-10-14T10:34:22.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.418+0000 7fe6d276e640 1 -- 172.21.15.8:0/672279951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6cc0bcd60 msgr2=0x7fe6cc06b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:22.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.418+0000 7fe6d276e640 1 --2- 172.21.15.8:0/672279951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6cc0bcd60 0x7fe6cc06b780 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0c0660 tx=0x7fe6c402b7c0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.418+0000 7fe6d276e640 1 -- 172.21.15.8:0/672279951 shutdown_connections 2023-10-14T10:34:22.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.418+0000 7fe6d276e640 1 --2- 172.21.15.8:0/672279951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6cc0bcd60 0x7fe6cc06b780 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.418+0000 7fe6d276e640 1 --2- 172.21.15.8:0/672279951 >> v2:172.21.15.92:3300/0 conn(0x7fe6cc0c4720 0x7fe6cc06b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.418+0000 7fe6d276e640 1 -- 172.21.15.8:0/672279951 >> 172.21.15.8:0/672279951 conn(0x7fe6cc0ab280 msgr2=0x7fe6cc0ab690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:22.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.418+0000 7fe6d276e640 1 -- 172.21.15.8:0/672279951 shutdown_connections 2023-10-14T10:34:22.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.418+0000 7fe6d276e640 1 -- 172.21.15.8:0/672279951 wait complete. 2023-10-14T10:34:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.420+0000 7fe6d276e640 1 Processor -- start 2023-10-14T10:34:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.420+0000 7fe6d276e640 1 -- start start 2023-10-14T10:34:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.421+0000 7fe6d276e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6cc0bcd60 0x7fe6cc1ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.421+0000 7fe6d276e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6cc0c4720 0x7fe6cc1487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.421+0000 7fe6d276e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6cc151400 0x7fe6cc1e8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.421+0000 7fe6d276e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc151cb0 con 0x7fe6cc0c4720 2023-10-14T10:34:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.421+0000 7fe6d276e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc1ec550 con 0x7fe6cc151400 2023-10-14T10:34:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.421+0000 7fe6d276e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc145da0 con 0x7fe6cc0bcd60 2023-10-14T10:34:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.421+0000 7fe6d0f6b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6cc0c4720 0x7fe6cc1487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.421+0000 7fe6d0f6b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6cc0c4720 0x7fe6cc1487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42338/0 (socket says 172.21.15.8:42338) 2023-10-14T10:34:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.421+0000 7fe6d0f6b640 1 -- 172.21.15.8:0/3572460984 learned_addr learned my addr 172.21.15.8:0/3572460984 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.421+0000 7fe6d1f6d640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6cc151400 0x7fe6cc1e8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.421+0000 7fe6d176c640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6cc0bcd60 0x7fe6cc1ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:22.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.422+0000 7fe6d0f6b640 1 -- 172.21.15.8:0/3572460984 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6cc0bcd60 msgr2=0x7fe6cc1ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.422+0000 7fe6d0f6b640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6cc0bcd60 0x7fe6cc1ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.422+0000 7fe6d0f6b640 1 -- 172.21.15.8:0/3572460984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6cc151400 msgr2=0x7fe6cc1e8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.422+0000 7fe6d0f6b640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6cc151400 0x7fe6cc1e8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.422+0000 7fe6d0f6b640 1 -- 172.21.15.8:0/3572460984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c4009400 con 0x7fe6cc0c4720 2023-10-14T10:34:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.422+0000 7fe6d1f6d640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6cc151400 0x7fe6cc1e8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:22.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.422+0000 7fe6d0f6b640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6cc0c4720 0x7fe6cc1487f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00e7e0 tx=0x7fe6bc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:22.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.422+0000 7fe6c1ffb640 1 -- 172.21.15.8:0/3572460984 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00c6d0 con 0x7fe6cc0c4720 2023-10-14T10:34:22.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.422+0000 7fe6c1ffb640 1 -- 172.21.15.8:0/3572460984 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc00c830 con 0x7fe6cc0c4720 2023-10-14T10:34:22.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.422+0000 7fe6d276e640 1 -- 172.21.15.8:0/3572460984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6cc146080 con 0x7fe6cc0c4720 2023-10-14T10:34:22.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.422+0000 7fe6c1ffb640 1 -- 172.21.15.8:0/3572460984 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00cbe0 con 0x7fe6cc0c4720 2023-10-14T10:34:22.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.422+0000 7fe6d276e640 1 -- 172.21.15.8:0/3572460984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6cc1ec7a0 con 0x7fe6cc0c4720 2023-10-14T10:34:22.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.423+0000 7fe6d276e640 1 -- 172.21.15.8:0/3572460984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6cc0c6020 con 0x7fe6cc0c4720 2023-10-14T10:34:22.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.424+0000 7fe6c1ffb640 1 -- 172.21.15.8:0/3572460984 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe6bc00cd40 con 0x7fe6cc0c4720 2023-10-14T10:34:22.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.425+0000 7fe6c1ffb640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe6b006ae70 0x7fe6b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:22.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.426+0000 7fe6c1ffb640 1 -- 172.21.15.8:0/3572460984 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6bc089750 con 0x7fe6cc0c4720 2023-10-14T10:34:22.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.426+0000 7fe6d176c640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe6b006ae70 0x7fe6b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:22.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.426+0000 7fe6d176c640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe6b006ae70 0x7fe6b006d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8001560 tx=0x7fe6c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:22.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.430+0000 7fe6c1ffb640 1 -- 172.21.15.8:0/3572460984 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe6bc0547f0 con 0x7fe6cc0c4720 2023-10-14T10:34:22.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.623+0000 7fe6d276e640 1 -- 172.21.15.8:0/3572460984 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6cc04e9b0 con 0x7fe6cc0c4720 2023-10-14T10:34:22.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.624+0000 7fe6c1ffb640 1 -- 172.21.15.8:0/3572460984 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6bc057e10 con 0x7fe6cc0c4720 2023-10-14T10:34:22.627 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:34:22.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.627+0000 7fe6d276e640 1 -- 172.21.15.8:0/3572460984 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe6b006ae70 msgr2=0x7fe6b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:22.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.627+0000 7fe6d276e640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe6b006ae70 0x7fe6b006d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8001560 tx=0x7fe6c8009040 comp rx=0 tx=0).stop 2023-10-14T10:34:22.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.627+0000 7fe6d276e640 1 -- 172.21.15.8:0/3572460984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6cc0c4720 msgr2=0x7fe6cc1487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:22.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.627+0000 7fe6d276e640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6cc0c4720 0x7fe6cc1487f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00e7e0 tx=0x7fe6bc00eca0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.627+0000 7fe6d276e640 1 -- 172.21.15.8:0/3572460984 shutdown_connections 2023-10-14T10:34:22.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.627+0000 7fe6d276e640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe6b006ae70 0x7fe6b006d330 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.627+0000 7fe6d276e640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6cc151400 0x7fe6cc1e8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.627+0000 7fe6d276e640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6cc0c4720 0x7fe6cc1487f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.627+0000 7fe6d276e640 1 --2- 172.21.15.8:0/3572460984 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6cc0bcd60 0x7fe6cc1ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.627+0000 7fe6d276e640 1 -- 172.21.15.8:0/3572460984 >> 172.21.15.8:0/3572460984 conn(0x7fe6cc0ab280 msgr2=0x7fe6cc14aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:22.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.628+0000 7fe6d276e640 1 -- 172.21.15.8:0/3572460984 shutdown_connections 2023-10-14T10:34:22.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.628+0000 7fe6d276e640 1 -- 172.21.15.8:0/3572460984 wait complete. 2023-10-14T10:34:22.649 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T10:34:22.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.872+0000 7f814d075640 1 Processor -- start 2023-10-14T10:34:22.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.872+0000 7f814d075640 1 -- start start 2023-10-14T10:34:22.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.873+0000 7f814d075640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f814814f4f0 0x7f8148152950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:22.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.873+0000 7f814d075640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f81480c6ef0 0x7f81480c5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:22.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.873+0000 7f814d075640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814806fbd0 con 0x7f81480a6c70 2023-10-14T10:34:22.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.873+0000 7f814d075640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81480ad4a0 con 0x7f81480c6ef0 2023-10-14T10:34:22.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.873+0000 7f814d075640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81480c6470 con 0x7f814814f4f0 2023-10-14T10:34:22.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.874+0000 7f814759e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f81480c6ef0 0x7f81480c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:22.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.874+0000 7f814659c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f81480a6c70 0x7f814806e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44336/0 (socket says 172.21.15.8:44336) 2023-10-14T10:34:22.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.874+0000 7f814659c640 1 -- 172.21.15.8:0/1666629469 learned_addr learned my addr 172.21.15.8:0/1666629469 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:22.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.874+0000 7f8146d9d640 1 --2- 172.21.15.8:0/1666629469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f814814f4f0 0x7f8148152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:22.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.874+0000 7f814759e640 1 -- 172.21.15.8:0/1666629469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f814814f4f0 msgr2=0x7f8148152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:22.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.874+0000 7f814759e640 1 --2- 172.21.15.8:0/1666629469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f814814f4f0 0x7f8148152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.874+0000 7f814759e640 1 -- 172.21.15.8:0/1666629469 >> v1:172.21.15.8:6789/0 conn(0x7f81480a6c70 legacy=0x7f814806e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:22.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.874+0000 7f814759e640 1 -- 172.21.15.8:0/1666629469 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81480c24c0 con 0x7f81480c6ef0 2023-10-14T10:34:22.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.874+0000 7f8146d9d640 1 --2- 172.21.15.8:0/1666629469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f814814f4f0 0x7f8148152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:22.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.874+0000 7f8145d9b640 1 -- 172.21.15.8:0/1666629469 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286015672 0 0) 0x7f814806fbd0 con 0x7f81480a6c70 2023-10-14T10:34:22.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.876+0000 7f814759e640 1 --2- 172.21.15.8:0/1666629469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480c6ef0 0x7f81480c5570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f81400097a0 tx=0x7f814002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d65327ee8184793 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:22.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.876+0000 7f8145d9b640 1 -- 172.21.15.8:0/1666629469 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814002d040 con 0x7f81480c6ef0 2023-10-14T10:34:22.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.876+0000 7f8145d9b640 1 -- 172.21.15.8:0/1666629469 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8140031810 con 0x7f81480c6ef0 2023-10-14T10:34:22.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.876+0000 7f8145d9b640 1 -- 172.21.15.8:0/1666629469 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140031ba0 con 0x7f81480c6ef0 2023-10-14T10:34:22.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.876+0000 7f814d075640 1 -- 172.21.15.8:0/1666629469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480c6ef0 msgr2=0x7f81480c5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:22.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.876+0000 7f814d075640 1 --2- 172.21.15.8:0/1666629469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480c6ef0 0x7f81480c5570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f81400097a0 tx=0x7f814002b8b0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.877+0000 7f814d075640 1 -- 172.21.15.8:0/1666629469 shutdown_connections 2023-10-14T10:34:22.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.877+0000 7f814d075640 1 --2- 172.21.15.8:0/1666629469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81480c6ef0 0x7f81480c5570 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.877+0000 7f814d075640 1 --2- 172.21.15.8:0/1666629469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f814814f4f0 0x7f8148152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.877+0000 7f814d075640 1 -- 172.21.15.8:0/1666629469 >> 172.21.15.8:0/1666629469 conn(0x7f81480c7670 msgr2=0x7f81480c7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:22.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.877+0000 7f814d075640 1 -- 172.21.15.8:0/1666629469 shutdown_connections 2023-10-14T10:34:22.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.877+0000 7f814d075640 1 -- 172.21.15.8:0/1666629469 wait complete. 2023-10-14T10:34:22.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.878+0000 7f814d075640 1 Processor -- start 2023-10-14T10:34:22.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.879+0000 7f814d075640 1 -- start start 2023-10-14T10:34:22.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.879+0000 7f814d075640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81480a6c70 0x7f81481ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.879+0000 7f814d075640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81480c6ef0 0x7f81480c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.879+0000 7f814d075640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f814814f4f0 0x7f81480a72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.879+0000 7f814d075640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81480a8d80 con 0x7f814814f4f0 2023-10-14T10:34:22.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.879+0000 7f814d075640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81481ed670 con 0x7f81480a6c70 2023-10-14T10:34:22.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.880+0000 7f814d075640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8148156360 con 0x7f81480c6ef0 2023-10-14T10:34:22.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.880+0000 7f814759e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f814814f4f0 0x7f81480a72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:22.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.880+0000 7f814759e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f814814f4f0 0x7f81480a72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42362/0 (socket says 172.21.15.8:42362) 2023-10-14T10:34:22.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.880+0000 7f814759e640 1 -- 172.21.15.8:0/842396637 learned_addr learned my addr 172.21.15.8:0/842396637 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:22.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.880+0000 7f814759e640 1 -- 172.21.15.8:0/842396637 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81480c6ef0 msgr2=0x7f81480c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:22.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.880+0000 7f814759e640 1 --2- 172.21.15.8:0/842396637 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81480c6ef0 0x7f81480c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.880+0000 7f814759e640 1 -- 172.21.15.8:0/842396637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81480a6c70 msgr2=0x7f81481ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.880+0000 7f814759e640 1 --2- 172.21.15.8:0/842396637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81480a6c70 0x7f81481ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.880+0000 7f814759e640 1 -- 172.21.15.8:0/842396637 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8140009400 con 0x7f814814f4f0 2023-10-14T10:34:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.881+0000 7f814759e640 1 --2- 172.21.15.8:0/842396637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f814814f4f0 0x7f81480a72b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f814002b8f0 tx=0x7f81400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:22.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.881+0000 7f812f7fe640 1 -- 172.21.15.8:0/842396637 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814003ace0 con 0x7f814814f4f0 2023-10-14T10:34:22.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.881+0000 7f812f7fe640 1 -- 172.21.15.8:0/842396637 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814003ae60 con 0x7f814814f4f0 2023-10-14T10:34:22.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.881+0000 7f812f7fe640 1 -- 172.21.15.8:0/842396637 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140044630 con 0x7f814814f4f0 2023-10-14T10:34:22.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.881+0000 7f814d075640 1 -- 172.21.15.8:0/842396637 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81481e91b0 con 0x7f814814f4f0 2023-10-14T10:34:22.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.881+0000 7f814d075640 1 -- 172.21.15.8:0/842396637 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81481e9470 con 0x7f814814f4f0 2023-10-14T10:34:22.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.882+0000 7f814d075640 1 -- 172.21.15.8:0/842396637 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814804e9b0 con 0x7f814814f4f0 2023-10-14T10:34:22.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.883+0000 7f812f7fe640 1 -- 172.21.15.8:0/842396637 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8140044790 con 0x7f814814f4f0 2023-10-14T10:34:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.884+0000 7f812f7fe640 1 --2- 172.21.15.8:0/842396637 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f813406aea0 0x7f813406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.884+0000 7f812f7fe640 1 -- 172.21.15.8:0/842396637 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81400ab8e0 con 0x7f814814f4f0 2023-10-14T10:34:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.885+0000 7f8146d9d640 1 --2- 172.21.15.8:0/842396637 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f813406aea0 0x7f813406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.885+0000 7f8146d9d640 1 --2- 172.21.15.8:0/842396637 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f813406aea0 0x7f813406d360 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f81380094c0 tx=0x7f8138009570 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:22.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:22.889+0000 7f812f7fe640 1 -- 172.21.15.8:0/842396637 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8140076980 con 0x7f814814f4f0 2023-10-14T10:34:23.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.086+0000 7f814d075640 1 -- 172.21.15.8:0/842396637 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81480c6cd0 con 0x7f814814f4f0 2023-10-14T10:34:23.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.087+0000 7f812f7fe640 1 -- 172.21.15.8:0/842396637 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8140035020 con 0x7f814814f4f0 2023-10-14T10:34:23.089 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T10:34:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.089+0000 7f814d075640 1 -- 172.21.15.8:0/842396637 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f813406aea0 msgr2=0x7f813406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.089+0000 7f814d075640 1 --2- 172.21.15.8:0/842396637 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f813406aea0 0x7f813406d360 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f81380094c0 tx=0x7f8138009570 comp rx=0 tx=0).stop 2023-10-14T10:34:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.089+0000 7f814d075640 1 -- 172.21.15.8:0/842396637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f814814f4f0 msgr2=0x7f81480a72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.089+0000 7f814d075640 1 --2- 172.21.15.8:0/842396637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f814814f4f0 0x7f81480a72b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f814002b8f0 tx=0x7f81400046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.090+0000 7f814d075640 1 -- 172.21.15.8:0/842396637 shutdown_connections 2023-10-14T10:34:23.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.090+0000 7f814d075640 1 --2- 172.21.15.8:0/842396637 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f813406aea0 0x7f813406d360 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.090+0000 7f814d075640 1 --2- 172.21.15.8:0/842396637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f814814f4f0 0x7f81480a72b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.090+0000 7f814d075640 1 --2- 172.21.15.8:0/842396637 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81480c6ef0 0x7f81480c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.090+0000 7f814d075640 1 --2- 172.21.15.8:0/842396637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81480a6c70 0x7f81481ed130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.090+0000 7f814d075640 1 -- 172.21.15.8:0/842396637 >> 172.21.15.8:0/842396637 conn(0x7f81480c7670 msgr2=0x7f814814e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:23.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.090+0000 7f814d075640 1 -- 172.21.15.8:0/842396637 shutdown_connections 2023-10-14T10:34:23.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.090+0000 7f814d075640 1 -- 172.21.15.8:0/842396637 wait complete. 2023-10-14T10:34:23.111 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T10:34:23.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.339+0000 7f988d232640 1 Processor -- start 2023-10-14T10:34:23.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.340+0000 7f988d232640 1 -- start start 2023-10-14T10:34:23.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.341+0000 7f988d232640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f988814e4b0 0x7f9888154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:23.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.341+0000 7f988d232640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9888150ea0 0x7f9888151330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:23.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.341+0000 7f988d232640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98881552e0 con 0x7f98880a8a30 2023-10-14T10:34:23.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.341+0000 7f988d232640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98880c0b70 con 0x7f9888150ea0 2023-10-14T10:34:23.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.341+0000 7f988d232640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98880c1670 con 0x7f988814e4b0 2023-10-14T10:34:23.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.342+0000 7f987e59c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f98880a8a30 0x7f98880c57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44342/0 (socket says 172.21.15.8:44342) 2023-10-14T10:34:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.342+0000 7f987e59c640 1 -- 172.21.15.8:0/2064600880 learned_addr learned my addr 172.21.15.8:0/2064600880 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.342+0000 7f988759e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9888150ea0 0x7f9888151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.342+0000 7f9886d9d640 1 --2- 172.21.15.8:0/2064600880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f988814e4b0 0x7f9888154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.342+0000 7f988659c640 1 -- 172.21.15.8:0/2064600880 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752518050 0 0) 0x7f9870001490 con 0x7f98880a8a30 2023-10-14T10:34:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.342+0000 7f988659c640 1 -- 172.21.15.8:0/2064600880 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9874005730 con 0x7f98880a8a30 2023-10-14T10:34:23.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.342+0000 7f988759e640 1 -- 172.21.15.8:0/2064600880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f988814e4b0 msgr2=0x7f9888154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:23.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.342+0000 7f988759e640 1 --2- 172.21.15.8:0/2064600880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f988814e4b0 0x7f9888154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.342+0000 7f988759e640 1 -- 172.21.15.8:0/2064600880 >> v1:172.21.15.8:6789/0 conn(0x7f98880a8a30 legacy=0x7f98880c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.342+0000 7f988759e640 1 -- 172.21.15.8:0/2064600880 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98880c0540 con 0x7f9888150ea0 2023-10-14T10:34:23.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.342+0000 7f9886d9d640 1 --2- 172.21.15.8:0/2064600880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f988814e4b0 0x7f9888154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:23.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.344+0000 7f988759e640 1 --2- 172.21.15.8:0/2064600880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9888150ea0 0x7f9888151330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98800097a0 tx=0x7f988002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4363679f58f8705 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:23.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.344+0000 7f988659c640 1 -- 172.21.15.8:0/2064600880 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880031780 con 0x7f9888150ea0 2023-10-14T10:34:23.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.344+0000 7f988659c640 1 -- 172.21.15.8:0/2064600880 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98800318e0 con 0x7f9888150ea0 2023-10-14T10:34:23.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.344+0000 7f988659c640 1 -- 172.21.15.8:0/2064600880 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880031c70 con 0x7f9888150ea0 2023-10-14T10:34:23.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.344+0000 7f988d232640 1 -- 172.21.15.8:0/2064600880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9888150ea0 msgr2=0x7f9888151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.344+0000 7f988d232640 1 --2- 172.21.15.8:0/2064600880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9888150ea0 0x7f9888151330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98800097a0 tx=0x7f988002b820 comp rx=0 tx=0).stop 2023-10-14T10:34:23.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.345+0000 7f988d232640 1 -- 172.21.15.8:0/2064600880 shutdown_connections 2023-10-14T10:34:23.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.345+0000 7f988d232640 1 --2- 172.21.15.8:0/2064600880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9888150ea0 0x7f9888151330 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.345+0000 7f988d232640 1 --2- 172.21.15.8:0/2064600880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f988814e4b0 0x7f9888154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.345+0000 7f988d232640 1 -- 172.21.15.8:0/2064600880 >> 172.21.15.8:0/2064600880 conn(0x7f98880a74d0 msgr2=0x7f98880a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:23.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.345+0000 7f988d232640 1 -- 172.21.15.8:0/2064600880 shutdown_connections 2023-10-14T10:34:23.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.345+0000 7f988d232640 1 -- 172.21.15.8:0/2064600880 wait complete. 2023-10-14T10:34:23.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.346+0000 7f988d232640 1 Processor -- start 2023-10-14T10:34:23.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.347+0000 7f988d232640 1 -- start start 2023-10-14T10:34:23.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.347+0000 7f988d232640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98880a8a30 0x7f988814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:23.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.347+0000 7f988d232640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f988814e4b0 0x7f9888154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:23.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.347+0000 7f988d232640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9888150ea0 0x7f9888148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:23.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.347+0000 7f988d232640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98881e8ce0 con 0x7f988814e4b0 2023-10-14T10:34:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.347+0000 7f988d232640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98881e8ef0 con 0x7f98880a8a30 2023-10-14T10:34:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.347+0000 7f988d232640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98881e91d0 con 0x7f9888150ea0 2023-10-14T10:34:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.348+0000 7f987e59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f988814e4b0 0x7f9888154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.348+0000 7f987e59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f988814e4b0 0x7f9888154920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42378/0 (socket says 172.21.15.8:42378) 2023-10-14T10:34:23.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.348+0000 7f987e59c640 1 -- 172.21.15.8:0/1342904178 learned_addr learned my addr 172.21.15.8:0/1342904178 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:23.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.348+0000 7f988759e640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9888150ea0 0x7f9888148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:23.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.348+0000 7f987e59c640 1 -- 172.21.15.8:0/1342904178 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9888150ea0 msgr2=0x7f9888148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.348+0000 7f987e59c640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9888150ea0 0x7f9888148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.348+0000 7f987e59c640 1 -- 172.21.15.8:0/1342904178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98880a8a30 msgr2=0x7f988814b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.348+0000 7f987e59c640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98880a8a30 0x7f988814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.348+0000 7f987e59c640 1 -- 172.21.15.8:0/1342904178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9880009400 con 0x7f988814e4b0 2023-10-14T10:34:23.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.348+0000 7f988759e640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9888150ea0 0x7f9888148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:23.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.349+0000 7f987e59c640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f988814e4b0 0x7f9888154920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f987000cbb0 tx=0x7f987000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:23.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.349+0000 7f987ffff640 1 -- 172.21.15.8:0/1342904178 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987000ad40 con 0x7f988814e4b0 2023-10-14T10:34:23.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.349+0000 7f987ffff640 1 -- 172.21.15.8:0/1342904178 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9870012400 con 0x7f988814e4b0 2023-10-14T10:34:23.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.349+0000 7f987ffff640 1 -- 172.21.15.8:0/1342904178 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987000aea0 con 0x7f988814e4b0 2023-10-14T10:34:23.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.349+0000 7f988d232640 1 -- 172.21.15.8:0/1342904178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98881e94b0 con 0x7f988814e4b0 2023-10-14T10:34:23.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.349+0000 7f988d232640 1 -- 172.21.15.8:0/1342904178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98881e9a70 con 0x7f988814e4b0 2023-10-14T10:34:23.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.350+0000 7f988d232640 1 -- 172.21.15.8:0/1342904178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988804e9b0 con 0x7f988814e4b0 2023-10-14T10:34:23.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.351+0000 7f987ffff640 1 -- 172.21.15.8:0/1342904178 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f98700127d0 con 0x7f988814e4b0 2023-10-14T10:34:23.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.352+0000 7f987ffff640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f986806ae70 0x7f986806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:23.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.352+0000 7f987ffff640 1 -- 172.21.15.8:0/1342904178 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98700894f0 con 0x7f988814e4b0 2023-10-14T10:34:23.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.352+0000 7f9886d9d640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f986806ae70 0x7f986806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:23.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.353+0000 7f9886d9d640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f986806ae70 0x7f986806d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9878006fd0 tx=0x7f9878008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:23.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.357+0000 7f987ffff640 1 -- 172.21.15.8:0/1342904178 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9870058020 con 0x7f988814e4b0 2023-10-14T10:34:23.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.551+0000 7f988d232640 1 -- 172.21.15.8:0/1342904178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98881552e0 con 0x7f988814e4b0 2023-10-14T10:34:23.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.552+0000 7f987ffff640 1 -- 172.21.15.8:0/1342904178 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f98881552e0 con 0x7f988814e4b0 2023-10-14T10:34:23.554 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T10:34:23.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.554+0000 7f988d232640 1 -- 172.21.15.8:0/1342904178 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f986806ae70 msgr2=0x7f986806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.554+0000 7f988d232640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f986806ae70 0x7f986806d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9878006fd0 tx=0x7f9878008040 comp rx=0 tx=0).stop 2023-10-14T10:34:23.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.554+0000 7f988d232640 1 -- 172.21.15.8:0/1342904178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f988814e4b0 msgr2=0x7f9888154920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.554+0000 7f988d232640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f988814e4b0 0x7f9888154920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f987000cbb0 tx=0x7f987000a430 comp rx=0 tx=0).stop 2023-10-14T10:34:23.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.555+0000 7f988d232640 1 -- 172.21.15.8:0/1342904178 shutdown_connections 2023-10-14T10:34:23.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.555+0000 7f988d232640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f986806ae70 0x7f986806d330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.555+0000 7f988d232640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9888150ea0 0x7f9888148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.555+0000 7f988d232640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f988814e4b0 0x7f9888154920 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.555+0000 7f988d232640 1 --2- 172.21.15.8:0/1342904178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98880a8a30 0x7f988814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.555+0000 7f988d232640 1 -- 172.21.15.8:0/1342904178 >> 172.21.15.8:0/1342904178 conn(0x7f98880a74d0 msgr2=0x7f98880704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:23.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.555+0000 7f988d232640 1 -- 172.21.15.8:0/1342904178 shutdown_connections 2023-10-14T10:34:23.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.555+0000 7f988d232640 1 -- 172.21.15.8:0/1342904178 wait complete. 2023-10-14T10:34:23.576 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop' 2023-10-14T10:34:23.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.789+0000 7fc2aa290640 1 Processor -- start 2023-10-14T10:34:23.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.789+0000 7fc2aa290640 1 -- start start 2023-10-14T10:34:23.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.791+0000 7fc2aa290640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc2a4151470 0x7fc2a4070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:23.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.791+0000 7fc2aa290640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a4071650 con 0x7fc2a414abb0 2023-10-14T10:34:23.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.791+0000 7fc2aa290640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a41518e0 con 0x7fc2a40a9610 2023-10-14T10:34:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.791+0000 7fc2aa290640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a4070740 con 0x7fc2a4151470 2023-10-14T10:34:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.791+0000 7fc2a9a8f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc2a4151470 0x7fc2a4070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.791+0000 7fc2a928e640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc2a414abb0 0x7fc2a40c2110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44356/0 (socket says 172.21.15.8:44356) 2023-10-14T10:34:23.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.791+0000 7fc2a928e640 1 -- 172.21.15.8:0/3499735819 learned_addr learned my addr 172.21.15.8:0/3499735819 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:23.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.792+0000 7fc2a9a8f640 1 -- 172.21.15.8:0/3499735819 >> v1:172.21.15.92:6789/0 conn(0x7fc2a40a9610 legacy=0x7fc2a406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.792+0000 7fc2a9a8f640 1 -- 172.21.15.8:0/3499735819 >> v1:172.21.15.8:6789/0 conn(0x7fc2a414abb0 legacy=0x7fc2a40c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.792+0000 7fc2a9a8f640 1 -- 172.21.15.8:0/3499735819 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40aa6f0 con 0x7fc2a4151470 2023-10-14T10:34:23.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.792+0000 7fc29bfff640 1 -- 172.21.15.8:0/3499735819 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151887588 0 0) 0x7fc2a4071650 con 0x7fc2a414abb0 2023-10-14T10:34:23.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.793+0000 7fc2a9a8f640 1 --2- 172.21.15.8:0/3499735819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2a4151470 0x7fc2a4070200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009d90 tx=0x7fc29c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f80116f23f17ab2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:23.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.793+0000 7fc29bfff640 1 -- 172.21.15.8:0/3499735819 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c02cd00 con 0x7fc2a4151470 2023-10-14T10:34:23.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.793+0000 7fc29bfff640 1 -- 172.21.15.8:0/3499735819 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c02ce60 con 0x7fc2a4151470 2023-10-14T10:34:23.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.793+0000 7fc29bfff640 1 -- 172.21.15.8:0/3499735819 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c034660 con 0x7fc2a4151470 2023-10-14T10:34:23.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.794+0000 7fc2aa290640 1 -- 172.21.15.8:0/3499735819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2a4151470 msgr2=0x7fc2a4070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.794+0000 7fc2aa290640 1 --2- 172.21.15.8:0/3499735819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2a4151470 0x7fc2a4070200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009d90 tx=0x7fc29c02bf50 comp rx=0 tx=0).stop 2023-10-14T10:34:23.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.794+0000 7fc2aa290640 1 -- 172.21.15.8:0/3499735819 shutdown_connections 2023-10-14T10:34:23.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.794+0000 7fc2aa290640 1 --2- 172.21.15.8:0/3499735819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2a4151470 0x7fc2a4070200 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.794+0000 7fc2aa290640 1 -- 172.21.15.8:0/3499735819 >> 172.21.15.8:0/3499735819 conn(0x7fc2a406a200 msgr2=0x7fc2a406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:23.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.794+0000 7fc2aa290640 1 -- 172.21.15.8:0/3499735819 shutdown_connections 2023-10-14T10:34:23.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.794+0000 7fc2aa290640 1 -- 172.21.15.8:0/3499735819 wait complete. 2023-10-14T10:34:23.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.796+0000 7fc2aa290640 1 Processor -- start 2023-10-14T10:34:23.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.796+0000 7fc2aa290640 1 -- start start 2023-10-14T10:34:23.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.797+0000 7fc2aa290640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2a40a9610 0x7fc2a41ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:23.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.797+0000 7fc2aa290640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2a414abb0 0x7fc2a4147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:23.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.797+0000 7fc2aa290640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2a4151470 0x7fc2a4148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:23.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.797+0000 7fc2aa290640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a414e100 con 0x7fc2a414abb0 2023-10-14T10:34:23.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.797+0000 7fc2aa290640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4148850 con 0x7fc2a40a9610 2023-10-14T10:34:23.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.797+0000 7fc2aa290640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a414b430 con 0x7fc2a4151470 2023-10-14T10:34:23.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.797+0000 7fc2a8a8d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2a414abb0 0x7fc2a4147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:23.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.797+0000 7fc2a8a8d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2a414abb0 0x7fc2a4147dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42398/0 (socket says 172.21.15.8:42398) 2023-10-14T10:34:23.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.797+0000 7fc2a8a8d640 1 -- 172.21.15.8:0/3868337340 learned_addr learned my addr 172.21.15.8:0/3868337340 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:23.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.797+0000 7fc2a9a8f640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2a4151470 0x7fc2a4148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:23.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.798+0000 7fc2a928e640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2a40a9610 0x7fc2a41ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:23.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.798+0000 7fc2a8a8d640 1 -- 172.21.15.8:0/3868337340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2a4151470 msgr2=0x7fc2a4148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.798+0000 7fc2a8a8d640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2a4151470 0x7fc2a4148310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.798+0000 7fc2a8a8d640 1 -- 172.21.15.8:0/3868337340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2a40a9610 msgr2=0x7fc2a41ecc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:23.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.798+0000 7fc2a8a8d640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2a40a9610 0x7fc2a41ecc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:23.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.798+0000 7fc2a8a8d640 1 -- 172.21.15.8:0/3868337340 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c009a70 con 0x7fc2a414abb0 2023-10-14T10:34:23.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.798+0000 7fc2a8a8d640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2a414abb0 0x7fc2a4147dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc29400c480 tx=0x7fc29400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:23.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.798+0000 7fc299ffb640 1 -- 172.21.15.8:0/3868337340 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940052d0 con 0x7fc2a414abb0 2023-10-14T10:34:23.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.798+0000 7fc299ffb640 1 -- 172.21.15.8:0/3868337340 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294005430 con 0x7fc2a414abb0 2023-10-14T10:34:23.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.798+0000 7fc299ffb640 1 -- 172.21.15.8:0/3868337340 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294012870 con 0x7fc2a414abb0 2023-10-14T10:34:23.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.798+0000 7fc2aa290640 1 -- 172.21.15.8:0/3868337340 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a414eb60 con 0x7fc2a414abb0 2023-10-14T10:34:23.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.799+0000 7fc2aa290640 1 -- 172.21.15.8:0/3868337340 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a4148d40 con 0x7fc2a414abb0 2023-10-14T10:34:23.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.800+0000 7fc2aa290640 1 -- 172.21.15.8:0/3868337340 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a414b5e0 con 0x7fc2a414abb0 2023-10-14T10:34:23.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.801+0000 7fc299ffb640 1 -- 172.21.15.8:0/3868337340 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc2940129d0 con 0x7fc2a414abb0 2023-10-14T10:34:23.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.802+0000 7fc299ffb640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc28806aea0 0x7fc28806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:23.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.803+0000 7fc299ffb640 1 -- 172.21.15.8:0/3868337340 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2940891c0 con 0x7fc2a414abb0 2023-10-14T10:34:23.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.803+0000 7fc2a928e640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc28806aea0 0x7fc28806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:23.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.803+0000 7fc2a928e640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc28806aea0 0x7fc28806d360 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0000f60 tx=0x7fc2a0007bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:23.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:23.807+0000 7fc299ffb640 1 -- 172.21.15.8:0/3868337340 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc2a414b5e0 con 0x7fc2a414abb0 2023-10-14T10:34:24.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.072+0000 7fc2aa290640 1 -- 172.21.15.8:0/3868337340 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop"]} v 0) v1 -- 0x7fc2a414b5e0 con 0x7fc2a414abb0 2023-10-14T10:34:24.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.544+0000 7fc299ffb640 1 -- 172.21.15.8:0/3868337340 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop"]}]=0 v51) v1 ==== 146+0+0 (secure 0 0 0) 0x7fc2a414b5e0 con 0x7fc2a414abb0 2023-10-14T10:34:24.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.548+0000 7fc2aa290640 1 -- 172.21.15.8:0/3868337340 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc28806aea0 msgr2=0x7fc28806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:24.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.548+0000 7fc2aa290640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc28806aea0 0x7fc28806d360 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0000f60 tx=0x7fc2a0007bb0 comp rx=0 tx=0).stop 2023-10-14T10:34:24.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.548+0000 7fc2aa290640 1 -- 172.21.15.8:0/3868337340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2a414abb0 msgr2=0x7fc2a4147dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:24.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.548+0000 7fc2aa290640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2a414abb0 0x7fc2a4147dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc29400c480 tx=0x7fc29400c940 comp rx=0 tx=0).stop 2023-10-14T10:34:24.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.548+0000 7fc2aa290640 1 -- 172.21.15.8:0/3868337340 shutdown_connections 2023-10-14T10:34:24.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.548+0000 7fc2aa290640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fc28806aea0 0x7fc28806d360 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:24.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.548+0000 7fc2aa290640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2a4151470 0x7fc2a4148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:24.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.548+0000 7fc2aa290640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2a414abb0 0x7fc2a4147dd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:24.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.548+0000 7fc2aa290640 1 --2- 172.21.15.8:0/3868337340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2a40a9610 0x7fc2a41ecc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:24.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.548+0000 7fc2aa290640 1 -- 172.21.15.8:0/3868337340 >> 172.21.15.8:0/3868337340 conn(0x7fc2a406a200 msgr2=0x7fc2a406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:24.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.548+0000 7fc2aa290640 1 -- 172.21.15.8:0/3868337340 shutdown_connections 2023-10-14T10:34:24.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.548+0000 7fc2aa290640 1 -- 172.21.15.8:0/3868337340 wait complete. 2023-10-14T10:34:24.574 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T10:34:24.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.806+0000 7fd83759e640 1 Processor -- start 2023-10-14T10:34:24.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.807+0000 7fd83759e640 1 -- start start 2023-10-14T10:34:24.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.808+0000 7fd83759e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd838155a80 0x7fd8380719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:24.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.808+0000 7fd83759e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8380ba3e0 0x7fd8380c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:24.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.808+0000 7fd83759e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd8380c2670 0x7fd83815b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:24.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.808+0000 7fd83759e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd838072060 con 0x7fd838155a80 2023-10-14T10:34:24.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.808+0000 7fd83759e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8381584f0 con 0x7fd8380c2670 2023-10-14T10:34:24.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.808+0000 7fd83759e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd838159270 con 0x7fd8380ba3e0 2023-10-14T10:34:24.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.808+0000 7fd83659c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd838155a80 0x7fd8380719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:24.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.809+0000 7fd83659c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd838155a80 0x7fd8380719f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42400/0 (socket says 172.21.15.8:42400) 2023-10-14T10:34:24.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.809+0000 7fd83659c640 1 -- 172.21.15.8:0/1475246264 learned_addr learned my addr 172.21.15.8:0/1475246264 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:24.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.809+0000 7fd82ffff640 1 --2- 172.21.15.8:0/1475246264 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8380ba3e0 0x7fd8380c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:24.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.809+0000 7fd836d9d640 1 --2- 172.21.15.8:0/1475246264 >> v2:172.21.15.92:3300/0 conn(0x7fd8380c2670 0x7fd83815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:24.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.809+0000 7fd83659c640 1 -- 172.21.15.8:0/1475246264 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8380ba3e0 msgr2=0x7fd8380c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:24.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.809+0000 7fd83659c640 1 --2- 172.21.15.8:0/1475246264 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8380ba3e0 0x7fd8380c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:24.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.809+0000 7fd83659c640 1 -- 172.21.15.8:0/1475246264 >> v2:172.21.15.92:3300/0 conn(0x7fd8380c2670 msgr2=0x7fd83815b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:24.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.809+0000 7fd83659c640 1 --2- 172.21.15.8:0/1475246264 >> v2:172.21.15.92:3300/0 conn(0x7fd8380c2670 0x7fd83815b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:24.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.809+0000 7fd83659c640 1 -- 172.21.15.8:0/1475246264 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd838158790 con 0x7fd838155a80 2023-10-14T10:34:24.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.809+0000 7fd82ffff640 1 --2- 172.21.15.8:0/1475246264 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8380ba3e0 0x7fd8380c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:24.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.810+0000 7fd83659c640 1 --2- 172.21.15.8:0/1475246264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd838155a80 0x7fd8380719f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd8380c1ce0 tx=0x7fd82802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a381789888a76 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:24.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.811+0000 7fd835d9b640 1 -- 172.21.15.8:0/1475246264 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8280317d0 con 0x7fd838155a80 2023-10-14T10:34:24.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.811+0000 7fd835d9b640 1 -- 172.21.15.8:0/1475246264 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd828031930 con 0x7fd838155a80 2023-10-14T10:34:24.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.811+0000 7fd835d9b640 1 -- 172.21.15.8:0/1475246264 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828031cc0 con 0x7fd838155a80 2023-10-14T10:34:24.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.811+0000 7fd83759e640 1 -- 172.21.15.8:0/1475246264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd838155a80 msgr2=0x7fd8380719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:24.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.811+0000 7fd83759e640 1 --2- 172.21.15.8:0/1475246264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd838155a80 0x7fd8380719f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd8380c1ce0 tx=0x7fd82802b870 comp rx=0 tx=0).stop 2023-10-14T10:34:24.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.811+0000 7fd83759e640 1 -- 172.21.15.8:0/1475246264 shutdown_connections 2023-10-14T10:34:24.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.811+0000 7fd83759e640 1 --2- 172.21.15.8:0/1475246264 >> v2:172.21.15.92:3300/0 conn(0x7fd8380c2670 0x7fd83815b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:24.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.811+0000 7fd83759e640 1 --2- 172.21.15.8:0/1475246264 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8380ba3e0 0x7fd8380c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:24.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.811+0000 7fd83759e640 1 --2- 172.21.15.8:0/1475246264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd838155a80 0x7fd8380719f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:24.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.811+0000 7fd83759e640 1 -- 172.21.15.8:0/1475246264 >> 172.21.15.8:0/1475246264 conn(0x7fd83806a200 msgr2=0x7fd83806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:24.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.812+0000 7fd83759e640 1 -- 172.21.15.8:0/1475246264 shutdown_connections 2023-10-14T10:34:24.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.812+0000 7fd83759e640 1 -- 172.21.15.8:0/1475246264 wait complete. 2023-10-14T10:34:24.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.813+0000 7fd83759e640 1 Processor -- start 2023-10-14T10:34:24.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.813+0000 7fd83759e640 1 -- start start 2023-10-14T10:34:24.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.814+0000 7fd83759e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8380ba3e0 0x7fd8380c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:24.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.814+0000 7fd83759e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8380c2670 0x7fd83814d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:24.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.814+0000 7fd83759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd838155a80 0x7fd83814da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:24.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.814+0000 7fd83759e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd838159b60 con 0x7fd8380ba3e0 2023-10-14T10:34:24.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.814+0000 7fd83759e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83814df60 con 0x7fd838155a80 2023-10-14T10:34:24.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.814+0000 7fd83759e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380aa0b0 con 0x7fd8380c2670 2023-10-14T10:34:24.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.815+0000 7fd83659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8380ba3e0 0x7fd8380c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:24.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.815+0000 7fd83659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8380ba3e0 0x7fd8380c45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42410/0 (socket says 172.21.15.8:42410) 2023-10-14T10:34:24.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.815+0000 7fd83659c640 1 -- 172.21.15.8:0/2395579019 learned_addr learned my addr 172.21.15.8:0/2395579019 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:24.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.815+0000 7fd83659c640 1 -- 172.21.15.8:0/2395579019 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8380c2670 msgr2=0x7fd83814d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:24.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.815+0000 7fd83659c640 1 --2- 172.21.15.8:0/2395579019 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8380c2670 0x7fd83814d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:24.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.815+0000 7fd83659c640 1 -- 172.21.15.8:0/2395579019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd838155a80 msgr2=0x7fd83814da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:24.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.815+0000 7fd83659c640 1 --2- 172.21.15.8:0/2395579019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd838155a80 0x7fd83814da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:24.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.815+0000 7fd83659c640 1 -- 172.21.15.8:0/2395579019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280094d0 con 0x7fd8380ba3e0 2023-10-14T10:34:24.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.815+0000 7fd83659c640 1 --2- 172.21.15.8:0/2395579019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8380ba3e0 0x7fd8380c45a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd828000c00 tx=0x7fd8280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:24.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.816+0000 7fd82effd640 1 -- 172.21.15.8:0/2395579019 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828032870 con 0x7fd8380ba3e0 2023-10-14T10:34:24.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.816+0000 7fd82effd640 1 -- 172.21.15.8:0/2395579019 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd828032a10 con 0x7fd8380ba3e0 2023-10-14T10:34:24.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.816+0000 7fd82effd640 1 -- 172.21.15.8:0/2395579019 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828032dc0 con 0x7fd8380ba3e0 2023-10-14T10:34:24.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.816+0000 7fd83759e640 1 -- 172.21.15.8:0/2395579019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8380aa390 con 0x7fd8380ba3e0 2023-10-14T10:34:24.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.816+0000 7fd83759e640 1 -- 172.21.15.8:0/2395579019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8381f14f0 con 0x7fd8380ba3e0 2023-10-14T10:34:24.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.817+0000 7fd83759e640 1 -- 172.21.15.8:0/2395579019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8380aa1f0 con 0x7fd8380ba3e0 2023-10-14T10:34:24.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.818+0000 7fd82effd640 1 -- 172.21.15.8:0/2395579019 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd828030070 con 0x7fd8380ba3e0 2023-10-14T10:34:24.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.819+0000 7fd82effd640 1 --2- 172.21.15.8:0/2395579019 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd81806ae70 0x7fd81806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:24.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.819+0000 7fd82effd640 1 -- 172.21.15.8:0/2395579019 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8280ab5a0 con 0x7fd8380ba3e0 2023-10-14T10:34:24.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.819+0000 7fd82ffff640 1 --2- 172.21.15.8:0/2395579019 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd81806ae70 0x7fd81806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:24.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.820+0000 7fd82ffff640 1 --2- 172.21.15.8:0/2395579019 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd81806ae70 0x7fd81806d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd83806de90 tx=0x7fd820008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:24.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:24.823+0000 7fd82effd640 1 -- 172.21.15.8:0/2395579019 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8380aa1f0 con 0x7fd8380ba3e0 2023-10-14T10:34:25.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.017+0000 7fd83759e640 1 -- 172.21.15.8:0/2395579019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd8380aa1f0 con 0x7fd8380ba3e0 2023-10-14T10:34:25.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.024+0000 7fd82effd640 1 -- 172.21.15.8:0/2395579019 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd8380aa1f0 con 0x7fd8380ba3e0 2023-10-14T10:34:25.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.028+0000 7fd83759e640 1 -- 172.21.15.8:0/2395579019 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd81806ae70 msgr2=0x7fd81806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:25.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.028+0000 7fd83759e640 1 --2- 172.21.15.8:0/2395579019 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd81806ae70 0x7fd81806d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd83806de90 tx=0x7fd820008040 comp rx=0 tx=0).stop 2023-10-14T10:34:25.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.028+0000 7fd83759e640 1 -- 172.21.15.8:0/2395579019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8380ba3e0 msgr2=0x7fd8380c45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:25.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.028+0000 7fd83759e640 1 --2- 172.21.15.8:0/2395579019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8380ba3e0 0x7fd8380c45a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd828000c00 tx=0x7fd8280046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.028+0000 7fd83759e640 1 -- 172.21.15.8:0/2395579019 shutdown_connections 2023-10-14T10:34:25.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.028+0000 7fd83759e640 1 --2- 172.21.15.8:0/2395579019 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd81806ae70 0x7fd81806d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.028+0000 7fd83759e640 1 --2- 172.21.15.8:0/2395579019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd838155a80 0x7fd83814da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.028+0000 7fd83759e640 1 --2- 172.21.15.8:0/2395579019 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8380c2670 0x7fd83814d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.028+0000 7fd83759e640 1 --2- 172.21.15.8:0/2395579019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8380ba3e0 0x7fd8380c45a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.028+0000 7fd83759e640 1 -- 172.21.15.8:0/2395579019 >> 172.21.15.8:0/2395579019 conn(0x7fd83806a200 msgr2=0x7fd83806cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:25.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.029+0000 7fd83759e640 1 -- 172.21.15.8:0/2395579019 shutdown_connections 2023-10-14T10:34:25.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.029+0000 7fd83759e640 1 -- 172.21.15.8:0/2395579019 wait complete. 2023-10-14T10:34:25.051 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T10:34:25.052 DEBUG:teuthology.orchestra.run.smithi008:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T10:34:25.171 DEBUG:teuthology.orchestra.run.smithi092:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T10:34:25.292 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T10:34:25.293 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:34:25.293 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T10:34:25.357 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:34:25.357 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T10:34:25.415 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:34:25.416 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T10:34:25.474 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:25.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.703+0000 7fec9dfb8640 1 Processor -- start 2023-10-14T10:34:25.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.703+0000 7fec9dfb8640 1 -- start start 2023-10-14T10:34:25.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.705+0000 7fec9dfb8640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fec980c2380 0x7fec98070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:25.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.705+0000 7fec9dfb8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec98071550 0x7fec980a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:25.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.705+0000 7fec9dfb8640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec980719e0 con 0x7fec980c06f0 2023-10-14T10:34:25.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.705+0000 7fec9dfb8640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec98071190 con 0x7fec980c2380 2023-10-14T10:34:25.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.705+0000 7fec9dfb8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec98071cc0 con 0x7fec98071550 2023-10-14T10:34:25.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.705+0000 7fec9d7b7640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fec980c06f0 0x7fec981511a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:44364/0 (socket says 172.21.15.8:44364) 2023-10-14T10:34:25.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.705+0000 7fec9d7b7640 1 -- 172.21.15.8:0/3371945553 learned_addr learned my addr 172.21.15.8:0/3371945553 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:25.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508297985 0 0) 0x7fec980719e0 con 0x7fec980c06f0 2023-10-14T10:34:25.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec9cfb6640 1 --2- 172.21.15.8:0/3371945553 >> v2:172.21.15.92:3300/0 conn(0x7fec980c2380 0x7fec98070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:25.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec97fff640 1 --2- 172.21.15.8:0/3371945553 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec98071550 0x7fec980a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:25.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec88003520 con 0x7fec980c06f0 2023-10-14T10:34:25.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3614414889 0 0) 0x7fec88003520 con 0x7fec980c06f0 2023-10-14T10:34:25.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec98071550 msgr2=0x7fec980a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:25.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 --2- 172.21.15.8:0/3371945553 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec98071550 0x7fec980a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 >> v2:172.21.15.92:3300/0 conn(0x7fec980c2380 msgr2=0x7fec98070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:25.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 --2- 172.21.15.8:0/3371945553 >> v2:172.21.15.92:3300/0 conn(0x7fec980c2380 0x7fec98070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec98071fa0 con 0x7fec980c06f0 2023-10-14T10:34:25.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fec900019f0 con 0x7fec980c06f0 2023-10-14T10:34:25.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 >> v1:172.21.15.8:6789/0 conn(0x7fec980c06f0 legacy=0x7fec981511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:25.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 --2- 172.21.15.8:0/3371945553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec88003970 0x7fec88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:25.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 --2- 172.21.15.8:0/3371945553 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec880047c0 0x7fec88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:25.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 --2- 172.21.15.8:0/3371945553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec88005180 0x7fec8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:25.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec98071190 con 0x7fec88005180 2023-10-14T10:34:25.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec98071cc0 con 0x7fec88003970 2023-10-14T10:34:25.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8800bfc0 con 0x7fec880047c0 2023-10-14T10:34:25.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec97fff640 1 --2- 172.21.15.8:0/3371945553 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec98071550 0x7fec980a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.706+0000 7fec9cfb6640 1 --2- 172.21.15.8:0/3371945553 >> v2:172.21.15.92:3300/0 conn(0x7fec980c2380 0x7fec98070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.707+0000 7fec9d7b7640 1 --2- 172.21.15.8:0/3371945553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec88005180 0x7fec8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.707+0000 7fec9d7b7640 1 -- 172.21.15.8:0/3371945553 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec880047c0 msgr2=0x7fec88004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.707+0000 7fec9d7b7640 1 --2- 172.21.15.8:0/3371945553 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec880047c0 0x7fec88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.707+0000 7fec9d7b7640 1 -- 172.21.15.8:0/3371945553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec88003970 msgr2=0x7fec88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:25.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.707+0000 7fec9d7b7640 1 --2- 172.21.15.8:0/3371945553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec88003970 0x7fec88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.707+0000 7fec9d7b7640 1 -- 172.21.15.8:0/3371945553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec88003520 con 0x7fec88005180 2023-10-14T10:34:25.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.708+0000 7fec9d7b7640 1 --2- 172.21.15.8:0/3371945553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec88005180 0x7fec8800b980 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fec9000a890 tx=0x7fec880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbe74f4a4e8417e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:25.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.708+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90034630 con 0x7fec88005180 2023-10-14T10:34:25.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.708+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9002f070 con 0x7fec88005180 2023-10-14T10:34:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.708+0000 7fec977fe640 1 -- 172.21.15.8:0/3371945553 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900349f0 con 0x7fec88005180 2023-10-14T10:34:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.709+0000 7fec9dfb8640 1 -- 172.21.15.8:0/3371945553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec88005180 msgr2=0x7fec8800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.709+0000 7fec9dfb8640 1 --2- 172.21.15.8:0/3371945553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec88005180 0x7fec8800b980 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fec9000a890 tx=0x7fec880057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.709+0000 7fec9d7b7640 1 -- 172.21.15.8:0/3371945553 reap_dead start 2023-10-14T10:34:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.709+0000 7fec9dfb8640 1 -- 172.21.15.8:0/3371945553 shutdown_connections 2023-10-14T10:34:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.709+0000 7fec9dfb8640 1 -- 172.21.15.8:0/3371945553 >> 172.21.15.8:0/3371945553 conn(0x7fec9806a200 msgr2=0x7fec9806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.709+0000 7fec9dfb8640 1 -- 172.21.15.8:0/3371945553 shutdown_connections 2023-10-14T10:34:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.709+0000 7fec9dfb8640 1 -- 172.21.15.8:0/3371945553 wait complete. 2023-10-14T10:34:25.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.711+0000 7fec9dfb8640 1 Processor -- start 2023-10-14T10:34:25.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.711+0000 7fec9dfb8640 1 -- start start 2023-10-14T10:34:25.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.712+0000 7fec9dfb8640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec88005180 0x7fec980c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:25.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.712+0000 7fec9dfb8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec98156f80 0x7fec981e8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:25.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.712+0000 7fec9dfb8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec981ec860 0x7fec981e9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:25.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.712+0000 7fec9dfb8640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec981ecdb0 con 0x7fec88005180 2023-10-14T10:34:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.712+0000 7fec9dfb8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec981e88e0 con 0x7fec98156f80 2023-10-14T10:34:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.712+0000 7fec9dfb8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec980c3050 con 0x7fec981ec860 2023-10-14T10:34:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.712+0000 7fec9cfb6640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec88005180 0x7fec980c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:25.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.713+0000 7fec9cfb6640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec88005180 0x7fec980c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42426/0 (socket says 172.21.15.8:42426) 2023-10-14T10:34:25.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.713+0000 7fec9cfb6640 1 -- 172.21.15.8:0/1814602819 learned_addr learned my addr 172.21.15.8:0/1814602819 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:25.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.713+0000 7fec9cfb6640 1 -- 172.21.15.8:0/1814602819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec981ec860 msgr2=0x7fec981e9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:25.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.713+0000 7fec9cfb6640 1 --2- 172.21.15.8:0/1814602819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec981ec860 0x7fec981e9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.713+0000 7fec9cfb6640 1 -- 172.21.15.8:0/1814602819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec98156f80 msgr2=0x7fec981e8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:25.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.713+0000 7fec9cfb6640 1 --2- 172.21.15.8:0/1814602819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec98156f80 0x7fec981e8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.713+0000 7fec9cfb6640 1 -- 172.21.15.8:0/1814602819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec98155ce0 con 0x7fec88005180 2023-10-14T10:34:25.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.713+0000 7fec9cfb6640 1 --2- 172.21.15.8:0/1814602819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec88005180 0x7fec980c54e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00e810 tx=0x7fec8c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:25.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.714+0000 7fec957fa640 1 -- 172.21.15.8:0/1814602819 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c004030 con 0x7fec88005180 2023-10-14T10:34:25.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.714+0000 7fec957fa640 1 -- 172.21.15.8:0/1814602819 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c004190 con 0x7fec88005180 2023-10-14T10:34:25.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.714+0000 7fec957fa640 1 -- 172.21.15.8:0/1814602819 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c003610 con 0x7fec88005180 2023-10-14T10:34:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.714+0000 7fec9dfb8640 1 -- 172.21.15.8:0/1814602819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec98155fc0 con 0x7fec88005180 2023-10-14T10:34:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.714+0000 7fec9dfb8640 1 -- 172.21.15.8:0/1814602819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec980c5a20 con 0x7fec88005180 2023-10-14T10:34:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.715+0000 7fec9dfb8640 1 -- 172.21.15.8:0/1814602819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9804e9b0 con 0x7fec88005180 2023-10-14T10:34:25.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.716+0000 7fec957fa640 1 -- 172.21.15.8:0/1814602819 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fec8c003770 con 0x7fec88005180 2023-10-14T10:34:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.717+0000 7fec957fa640 1 --2- 172.21.15.8:0/1814602819 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fec7c06aea0 0x7fec7c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:25.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.717+0000 7fec957fa640 1 -- 172.21.15.8:0/1814602819 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec8c0890e0 con 0x7fec88005180 2023-10-14T10:34:25.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.718+0000 7fec97fff640 1 --2- 172.21.15.8:0/1814602819 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fec7c06aea0 0x7fec7c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:25.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.718+0000 7fec97fff640 1 --2- 172.21.15.8:0/1814602819 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fec7c06aea0 0x7fec7c06d360 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec84006fd0 tx=0x7fec84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:25.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.721+0000 7fec957fa640 1 -- 172.21.15.8:0/1814602819 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fec8c054220 con 0x7fec88005180 2023-10-14T10:34:25.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.917+0000 7fec9dfb8640 1 -- 172.21.15.8:0/1814602819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec980008d0 con 0x7fec88005180 2023-10-14T10:34:25.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.921+0000 7fec957fa640 1 -- 172.21.15.8:0/1814602819 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7fec8c057840 con 0x7fec88005180 2023-10-14T10:34:25.923 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:25.923 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:25.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.923+0000 7fec9dfb8640 1 -- 172.21.15.8:0/1814602819 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fec7c06aea0 msgr2=0x7fec7c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:25.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.923+0000 7fec9dfb8640 1 --2- 172.21.15.8:0/1814602819 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fec7c06aea0 0x7fec7c06d360 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec84006fd0 tx=0x7fec84008040 comp rx=0 tx=0).stop 2023-10-14T10:34:25.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.923+0000 7fec9dfb8640 1 -- 172.21.15.8:0/1814602819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec88005180 msgr2=0x7fec980c54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:25.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.923+0000 7fec9dfb8640 1 --2- 172.21.15.8:0/1814602819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec88005180 0x7fec980c54e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00e810 tx=0x7fec8c00ecd0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.923+0000 7fec9dfb8640 1 -- 172.21.15.8:0/1814602819 shutdown_connections 2023-10-14T10:34:25.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.923+0000 7fec9dfb8640 1 --2- 172.21.15.8:0/1814602819 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fec7c06aea0 0x7fec7c06d360 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.923+0000 7fec9dfb8640 1 --2- 172.21.15.8:0/1814602819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec981ec860 0x7fec981e9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.923+0000 7fec9dfb8640 1 --2- 172.21.15.8:0/1814602819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec98156f80 0x7fec981e8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.923+0000 7fec9dfb8640 1 --2- 172.21.15.8:0/1814602819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec88005180 0x7fec980c54e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:25.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.923+0000 7fec9dfb8640 1 -- 172.21.15.8:0/1814602819 >> 172.21.15.8:0/1814602819 conn(0x7fec9806a200 msgr2=0x7fec980bfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:25.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.924+0000 7fec9dfb8640 1 -- 172.21.15.8:0/1814602819 shutdown_connections 2023-10-14T10:34:25.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:25.924+0000 7fec9dfb8640 1 -- 172.21.15.8:0/1814602819 wait complete. 2023-10-14T10:34:25.945 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T10:33:44.913451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T10:33:46.397320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:34:25.946 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:34:26.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.175+0000 7fd21b3d0640 1 Processor -- start 2023-10-14T10:34:26.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.175+0000 7fd21b3d0640 1 -- start start 2023-10-14T10:34:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.176+0000 7fd21b3d0640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd2140bfbd0 0x7fd214070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.176+0000 7fd21b3d0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd214070a70 0x7fd21414dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.176+0000 7fd21b3d0640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21406bc80 con 0x7fd214071180 2023-10-14T10:34:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.177+0000 7fd21b3d0640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21406bf60 con 0x7fd2140bfbd0 2023-10-14T10:34:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.177+0000 7fd21b3d0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21406fd30 con 0x7fd214070a70 2023-10-14T10:34:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.177+0000 7fd219bcd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd2140bfbd0 0x7fd214070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.177+0000 7fd219bcd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd2140bfbd0 0x7fd214070530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42440/0 (socket says 172.21.15.8:42440) 2023-10-14T10:34:26.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.177+0000 7fd219bcd640 1 -- 172.21.15.8:0/847877873 learned_addr learned my addr 172.21.15.8:0/847877873 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:26.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.177+0000 7fd219bcd640 1 -- 172.21.15.8:0/847877873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd214070a70 msgr2=0x7fd21414dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:26.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.177+0000 7fd219bcd640 1 --2- 172.21.15.8:0/847877873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd214070a70 0x7fd21414dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.177+0000 7fd219bcd640 1 -- 172.21.15.8:0/847877873 >> v1:172.21.15.92:6789/0 conn(0x7fd214071180 legacy=0x7fd214151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:26.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.177+0000 7fd219bcd640 1 -- 172.21.15.8:0/847877873 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd214070010 con 0x7fd2140bfbd0 2023-10-14T10:34:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.178+0000 7fd219bcd640 1 --2- 172.21.15.8:0/847877873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2140bfbd0 0x7fd214070530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd204009870 tx=0x7fd20402da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b211716269e03 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.179+0000 7fd2193cc640 1 -- 172.21.15.8:0/847877873 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20402f830 con 0x7fd2140bfbd0 2023-10-14T10:34:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.179+0000 7fd2193cc640 1 -- 172.21.15.8:0/847877873 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20402f990 con 0x7fd2140bfbd0 2023-10-14T10:34:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.179+0000 7fd2193cc640 1 -- 172.21.15.8:0/847877873 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20402fd20 con 0x7fd2140bfbd0 2023-10-14T10:34:26.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.179+0000 7fd21b3d0640 1 -- 172.21.15.8:0/847877873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2140bfbd0 msgr2=0x7fd214070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:26.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.179+0000 7fd21b3d0640 1 --2- 172.21.15.8:0/847877873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2140bfbd0 0x7fd214070530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd204009870 tx=0x7fd20402da70 comp rx=0 tx=0).stop 2023-10-14T10:34:26.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.179+0000 7fd21b3d0640 1 -- 172.21.15.8:0/847877873 shutdown_connections 2023-10-14T10:34:26.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.179+0000 7fd21b3d0640 1 --2- 172.21.15.8:0/847877873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd214070a70 0x7fd21414dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.179+0000 7fd21b3d0640 1 --2- 172.21.15.8:0/847877873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2140bfbd0 0x7fd214070530 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.179+0000 7fd21b3d0640 1 -- 172.21.15.8:0/847877873 >> 172.21.15.8:0/847877873 conn(0x7fd2140c5250 msgr2=0x7fd2140c5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:26.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.179+0000 7fd21b3d0640 1 -- 172.21.15.8:0/847877873 shutdown_connections 2023-10-14T10:34:26.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.180+0000 7fd21b3d0640 1 -- 172.21.15.8:0/847877873 wait complete. 2023-10-14T10:34:26.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.181+0000 7fd21b3d0640 1 Processor -- start 2023-10-14T10:34:26.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.181+0000 7fd21b3d0640 1 -- start start 2023-10-14T10:34:26.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.182+0000 7fd21b3d0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd214071180 0x7fd2140c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:26.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.182+0000 7fd21b3d0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2140bfbd0 0x7fd214149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:26.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.182+0000 7fd21b3d0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd214154bb0 0x7fd214149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:26.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.182+0000 7fd21b3d0640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21414b380 con 0x7fd2140bfbd0 2023-10-14T10:34:26.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.182+0000 7fd21b3d0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21414b640 con 0x7fd214071180 2023-10-14T10:34:26.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.182+0000 7fd21b3d0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21414b920 con 0x7fd214154bb0 2023-10-14T10:34:26.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.182+0000 7fd219bcd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2140bfbd0 0x7fd214149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:26.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.182+0000 7fd219bcd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2140bfbd0 0x7fd214149050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42448/0 (socket says 172.21.15.8:42448) 2023-10-14T10:34:26.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.182+0000 7fd219bcd640 1 -- 172.21.15.8:0/571683613 learned_addr learned my addr 172.21.15.8:0/571683613 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:26.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.183+0000 7fd219bcd640 1 -- 172.21.15.8:0/571683613 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd214154bb0 msgr2=0x7fd214149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:26.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.183+0000 7fd219bcd640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd214154bb0 0x7fd214149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.183+0000 7fd219bcd640 1 -- 172.21.15.8:0/571683613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd214071180 msgr2=0x7fd2140c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:26.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.183+0000 7fd21a3ce640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd214071180 0x7fd2140c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:26.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.183+0000 7fd219bcd640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd214071180 0x7fd2140c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.183+0000 7fd219bcd640 1 -- 172.21.15.8:0/571683613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2040094d0 con 0x7fd2140bfbd0 2023-10-14T10:34:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.183+0000 7fd219bcd640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2140bfbd0 0x7fd214149050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd204009990 tx=0x7fd2040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.184+0000 7fd20affd640 1 -- 172.21.15.8:0/571683613 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20402f7e0 con 0x7fd2140bfbd0 2023-10-14T10:34:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.184+0000 7fd20affd640 1 -- 172.21.15.8:0/571683613 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20403aad0 con 0x7fd2140bfbd0 2023-10-14T10:34:26.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.184+0000 7fd20affd640 1 -- 172.21.15.8:0/571683613 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20403ae80 con 0x7fd2140bfbd0 2023-10-14T10:34:26.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.184+0000 7fd21b3d0640 1 -- 172.21.15.8:0/571683613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd214149c40 con 0x7fd2140bfbd0 2023-10-14T10:34:26.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.184+0000 7fd21b3d0640 1 -- 172.21.15.8:0/571683613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21414e7f0 con 0x7fd2140bfbd0 2023-10-14T10:34:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.185+0000 7fd21b3d0640 1 -- 172.21.15.8:0/571683613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd214149e50 con 0x7fd2140bfbd0 2023-10-14T10:34:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.186+0000 7fd20affd640 1 -- 172.21.15.8:0/571683613 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd20404d430 con 0x7fd2140bfbd0 2023-10-14T10:34:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.187+0000 7fd20affd640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd1f806ae70 0x7fd1f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:26.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.187+0000 7fd20affd640 1 -- 172.21.15.8:0/571683613 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd204034070 con 0x7fd2140bfbd0 2023-10-14T10:34:26.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.187+0000 7fd21a3ce640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd1f806ae70 0x7fd1f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:26.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.188+0000 7fd21a3ce640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd1f806ae70 0x7fd1f806d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd210001d10 tx=0x7fd210009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:26.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.192+0000 7fd20affd640 1 -- 172.21.15.8:0/571683613 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd2040767f0 con 0x7fd2140bfbd0 2023-10-14T10:34:26.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.385+0000 7fd21b3d0640 1 -- 172.21.15.8:0/571683613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2140beab0 con 0x7fd2140bfbd0 2023-10-14T10:34:26.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.386+0000 7fd20affd640 1 -- 172.21.15.8:0/571683613 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd204079e10 con 0x7fd2140bfbd0 2023-10-14T10:34:26.388 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:34:26.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.389+0000 7fd21b3d0640 1 -- 172.21.15.8:0/571683613 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd1f806ae70 msgr2=0x7fd1f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:26.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.389+0000 7fd21b3d0640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd1f806ae70 0x7fd1f806d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd210001d10 tx=0x7fd210009040 comp rx=0 tx=0).stop 2023-10-14T10:34:26.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.389+0000 7fd21b3d0640 1 -- 172.21.15.8:0/571683613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2140bfbd0 msgr2=0x7fd214149050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:26.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.389+0000 7fd21b3d0640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2140bfbd0 0x7fd214149050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd204009990 tx=0x7fd2040046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.389+0000 7fd21b3d0640 1 -- 172.21.15.8:0/571683613 shutdown_connections 2023-10-14T10:34:26.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.389+0000 7fd21b3d0640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd1f806ae70 0x7fd1f806d330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.389+0000 7fd21b3d0640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd214154bb0 0x7fd214149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.389+0000 7fd21b3d0640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2140bfbd0 0x7fd214149050 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.389+0000 7fd21b3d0640 1 --2- 172.21.15.8:0/571683613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd214071180 0x7fd2140c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.389+0000 7fd21b3d0640 1 -- 172.21.15.8:0/571683613 >> 172.21.15.8:0/571683613 conn(0x7fd2140c5250 msgr2=0x7fd2140aa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:26.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.389+0000 7fd21b3d0640 1 -- 172.21.15.8:0/571683613 shutdown_connections 2023-10-14T10:34:26.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.389+0000 7fd21b3d0640 1 -- 172.21.15.8:0/571683613 wait complete. 2023-10-14T10:34:26.409 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T10:34:26.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.635+0000 7f4ac5935640 1 Processor -- start 2023-10-14T10:34:26.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.635+0000 7f4ac5935640 1 -- start start 2023-10-14T10:34:26.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.636+0000 7f4ac5935640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ac00c4450 0x7f4ac00c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.636+0000 7f4ac5935640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac0158330 con 0x7f4ac006ae00 2023-10-14T10:34:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.636+0000 7f4ac5935640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac00c5e30 con 0x7f4ac0151640 2023-10-14T10:34:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.636+0000 7f4ac5935640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac00c4a40 con 0x7f4ac00c4450 2023-10-14T10:34:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.637+0000 7f4abffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ac00c4450 0x7f4ac00c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:26.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.637+0000 7f4abffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ac00c4450 0x7f4ac00c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42464/0 (socket says 172.21.15.8:42464) 2023-10-14T10:34:26.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.637+0000 7f4abffff640 1 -- 172.21.15.8:0/1361514988 learned_addr learned my addr 172.21.15.8:0/1361514988 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:26.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.637+0000 7f4abffff640 1 -- 172.21.15.8:0/1361514988 >> v1:172.21.15.92:6789/0 conn(0x7f4ac0151640 legacy=0x7f4ac006b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:26.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.637+0000 7f4abffff640 1 -- 172.21.15.8:0/1361514988 >> v1:172.21.15.8:6789/0 conn(0x7f4ac006ae00 legacy=0x7f4ac0157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:26.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.637+0000 7f4abffff640 1 -- 172.21.15.8:0/1361514988 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac00c4d20 con 0x7f4ac00c4450 2023-10-14T10:34:26.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.637+0000 7f4abf7fe640 1 -- 172.21.15.8:0/1361514988 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243109979 0 0) 0x7f4ac0158330 con 0x7f4ac006ae00 2023-10-14T10:34:26.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.639+0000 7f4abffff640 1 --2- 172.21.15.8:0/1361514988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ac00c4450 0x7f4ac00c75b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4009870 tx=0x7f4ab402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c08e4f9a7be7cad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:26.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.639+0000 7f4abf7fe640 1 -- 172.21.15.8:0/1361514988 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4031860 con 0x7f4ac00c4450 2023-10-14T10:34:26.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.639+0000 7f4abf7fe640 1 -- 172.21.15.8:0/1361514988 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab40319c0 con 0x7f4ac00c4450 2023-10-14T10:34:26.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.639+0000 7f4abf7fe640 1 -- 172.21.15.8:0/1361514988 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4031d50 con 0x7f4ac00c4450 2023-10-14T10:34:26.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.640+0000 7f4ac5935640 1 -- 172.21.15.8:0/1361514988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ac00c4450 msgr2=0x7f4ac00c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:26.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.640+0000 7f4ac5935640 1 --2- 172.21.15.8:0/1361514988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ac00c4450 0x7f4ac00c75b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4009870 tx=0x7f4ab402b900 comp rx=0 tx=0).stop 2023-10-14T10:34:26.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.640+0000 7f4ac5935640 1 -- 172.21.15.8:0/1361514988 shutdown_connections 2023-10-14T10:34:26.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.640+0000 7f4ac5935640 1 --2- 172.21.15.8:0/1361514988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ac00c4450 0x7f4ac00c75b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.640+0000 7f4ac5935640 1 -- 172.21.15.8:0/1361514988 >> 172.21.15.8:0/1361514988 conn(0x7f4ac00c96b0 msgr2=0x7f4ac00c9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:26.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.640+0000 7f4ac5935640 1 -- 172.21.15.8:0/1361514988 shutdown_connections 2023-10-14T10:34:26.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.640+0000 7f4ac5935640 1 -- 172.21.15.8:0/1361514988 wait complete. 2023-10-14T10:34:26.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.642+0000 7f4ac5935640 1 Processor -- start 2023-10-14T10:34:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.642+0000 7f4ac5935640 1 -- start start 2023-10-14T10:34:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.643+0000 7f4ac5935640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac006ae00 0x7f4ac0156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.643+0000 7f4ac5935640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ac00c4450 0x7f4ac00aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.643+0000 7f4ac5935640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ac0151640 0x7f4ac0155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.643+0000 7f4ac5935640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac014e170 con 0x7f4ac0151640 2023-10-14T10:34:26.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.643+0000 7f4ac5935640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac0156d70 con 0x7f4ac006ae00 2023-10-14T10:34:26.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.643+0000 7f4ac5935640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac0157050 con 0x7f4ac00c4450 2023-10-14T10:34:26.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.643+0000 7f4ac5134640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ac0151640 0x7f4ac0155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:26.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.643+0000 7f4ac5134640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ac0151640 0x7f4ac0155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42468/0 (socket says 172.21.15.8:42468) 2023-10-14T10:34:26.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.643+0000 7f4ac5134640 1 -- 172.21.15.8:0/3966460219 learned_addr learned my addr 172.21.15.8:0/3966460219 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:26.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4abffff640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ac00c4450 0x7f4ac00aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:26.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4ac5134640 1 -- 172.21.15.8:0/3966460219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ac00c4450 msgr2=0x7f4ac00aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:26.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4ac4933640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac006ae00 0x7f4ac0156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:26.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4ac5134640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ac00c4450 0x7f4ac00aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4ac5134640 1 -- 172.21.15.8:0/3966460219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac006ae00 msgr2=0x7f4ac0156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:26.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4ac5134640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac006ae00 0x7f4ac0156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4ac5134640 1 -- 172.21.15.8:0/3966460219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab40094d0 con 0x7f4ac0151640 2023-10-14T10:34:26.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4ac4933640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac006ae00 0x7f4ac0156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:26.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4ac5134640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ac0151640 0x7f4ac0155560 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c480 tx=0x7f4ab800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:26.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4abd7fa640 1 -- 172.21.15.8:0/3966460219 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8005480 con 0x7f4ac0151640 2023-10-14T10:34:26.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4abd7fa640 1 -- 172.21.15.8:0/3966460219 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab80035f0 con 0x7f4ac0151640 2023-10-14T10:34:26.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4abd7fa640 1 -- 172.21.15.8:0/3966460219 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80039a0 con 0x7f4ac0151640 2023-10-14T10:34:26.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4ac5935640 1 -- 172.21.15.8:0/3966460219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac014de00 con 0x7f4ac0151640 2023-10-14T10:34:26.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.644+0000 7f4ac5935640 1 -- 172.21.15.8:0/3966460219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac014da90 con 0x7f4ac0151640 2023-10-14T10:34:26.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.646+0000 7f4ac5935640 1 -- 172.21.15.8:0/3966460219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac014e2e0 con 0x7f4ac0151640 2023-10-14T10:34:26.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.647+0000 7f4abd7fa640 1 -- 172.21.15.8:0/3966460219 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4ab8003b00 con 0x7f4ac0151640 2023-10-14T10:34:26.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.648+0000 7f4abd7fa640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4aac06ae70 0x7f4aac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:26.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.648+0000 7f4abd7fa640 1 -- 172.21.15.8:0/3966460219 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ab8089110 con 0x7f4ac0151640 2023-10-14T10:34:26.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.648+0000 7f4ac4933640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4aac06ae70 0x7f4aac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:26.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.649+0000 7f4ac4933640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4aac06ae70 0x7f4aac06d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4ac014fa10 tx=0x7f4ab0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:26.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.653+0000 7f4abd7fa640 1 -- 172.21.15.8:0/3966460219 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ab8057ce0 con 0x7f4ac0151640 2023-10-14T10:34:26.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.849+0000 7f4ac5935640 1 -- 172.21.15.8:0/3966460219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ac00619f0 con 0x7f4ac0151640 2023-10-14T10:34:26.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.850+0000 7f4abd7fa640 1 -- 172.21.15.8:0/3966460219 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ab8057870 con 0x7f4ac0151640 2023-10-14T10:34:26.853 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T10:34:26.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.853+0000 7f4ac5935640 1 -- 172.21.15.8:0/3966460219 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4aac06ae70 msgr2=0x7f4aac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:26.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.853+0000 7f4ac5935640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4aac06ae70 0x7f4aac06d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4ac014fa10 tx=0x7f4ab0009040 comp rx=0 tx=0).stop 2023-10-14T10:34:26.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.853+0000 7f4ac5935640 1 -- 172.21.15.8:0/3966460219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ac0151640 msgr2=0x7f4ac0155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:26.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.853+0000 7f4ac5935640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ac0151640 0x7f4ac0155560 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c480 tx=0x7f4ab800c940 comp rx=0 tx=0).stop 2023-10-14T10:34:26.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.854+0000 7f4ac5935640 1 -- 172.21.15.8:0/3966460219 shutdown_connections 2023-10-14T10:34:26.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.854+0000 7f4ac5935640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4aac06ae70 0x7f4aac06d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.854+0000 7f4ac5935640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ac0151640 0x7f4ac0155560 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.854+0000 7f4ac5935640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ac00c4450 0x7f4ac00aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.854+0000 7f4ac5935640 1 --2- 172.21.15.8:0/3966460219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac006ae00 0x7f4ac0156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:26.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.854+0000 7f4ac5935640 1 -- 172.21.15.8:0/3966460219 >> 172.21.15.8:0/3966460219 conn(0x7f4ac00c96b0 msgr2=0x7f4ac014ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:26.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.854+0000 7f4ac5935640 1 -- 172.21.15.8:0/3966460219 shutdown_connections 2023-10-14T10:34:26.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:26.854+0000 7f4ac5935640 1 -- 172.21.15.8:0/3966460219 wait complete. 2023-10-14T10:34:26.876 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T10:34:27.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.100+0000 7f3017fff640 1 Processor -- start 2023-10-14T10:34:27.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.100+0000 7f3017fff640 1 -- start start 2023-10-14T10:34:27.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.102+0000 7f3017fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f301813af90 0x7f30180a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.102+0000 7f3017fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f301806fb10 0x7f30180c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.102+0000 7f3017fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f30180c2670 0x7f30180bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.102+0000 7f3017fff640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3018152ac0 con 0x7f301806fb10 2023-10-14T10:34:27.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.102+0000 7f3017fff640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3018151eb0 con 0x7f30180c2670 2023-10-14T10:34:27.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.102+0000 7f3017fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3018152190 con 0x7f301813af90 2023-10-14T10:34:27.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.102+0000 7f30167fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f301806fb10 0x7f30180c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:27.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.103+0000 7f30167fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f301806fb10 0x7f30180c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60494/0 (socket says 172.21.15.8:60494) 2023-10-14T10:34:27.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.103+0000 7f30167fc640 1 -- 172.21.15.8:0/3547369581 learned_addr learned my addr 172.21.15.8:0/3547369581 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:27.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.103+0000 7f30167fc640 1 -- 172.21.15.8:0/3547369581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f301813af90 msgr2=0x7f30180a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:27.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.103+0000 7f30167fc640 1 --2- 172.21.15.8:0/3547369581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f301813af90 0x7f30180a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.103+0000 7f30167fc640 1 -- 172.21.15.8:0/3547369581 >> v2:172.21.15.92:3300/0 conn(0x7f30180c2670 msgr2=0x7f30180bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:27.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.103+0000 7f30167fc640 1 --2- 172.21.15.8:0/3547369581 >> v2:172.21.15.92:3300/0 conn(0x7f30180c2670 0x7f30180bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.103+0000 7f30167fc640 1 -- 172.21.15.8:0/3547369581 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018152470 con 0x7f301806fb10 2023-10-14T10:34:27.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.104+0000 7f30167fc640 1 --2- 172.21.15.8:0/3547369581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f301806fb10 0x7f30180c2130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3018151da0 tx=0x7f300002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231c1f6e8a3748c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:27.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.104+0000 7f3015ffb640 1 -- 172.21.15.8:0/3547369581 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30000317e0 con 0x7f301806fb10 2023-10-14T10:34:27.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.104+0000 7f3015ffb640 1 -- 172.21.15.8:0/3547369581 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3000031940 con 0x7f301806fb10 2023-10-14T10:34:27.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.104+0000 7f3015ffb640 1 -- 172.21.15.8:0/3547369581 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000031cd0 con 0x7f301806fb10 2023-10-14T10:34:27.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.105+0000 7f3017fff640 1 -- 172.21.15.8:0/3547369581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f301806fb10 msgr2=0x7f30180c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:27.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.105+0000 7f3017fff640 1 --2- 172.21.15.8:0/3547369581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f301806fb10 0x7f30180c2130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3018151da0 tx=0x7f300002b880 comp rx=0 tx=0).stop 2023-10-14T10:34:27.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.105+0000 7f3017fff640 1 -- 172.21.15.8:0/3547369581 shutdown_connections 2023-10-14T10:34:27.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.105+0000 7f3017fff640 1 --2- 172.21.15.8:0/3547369581 >> v2:172.21.15.92:3300/0 conn(0x7f30180c2670 0x7f30180bfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.105+0000 7f3017fff640 1 --2- 172.21.15.8:0/3547369581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f301806fb10 0x7f30180c2130 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.105+0000 7f3017fff640 1 --2- 172.21.15.8:0/3547369581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f301813af90 0x7f30180a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.105+0000 7f3017fff640 1 -- 172.21.15.8:0/3547369581 >> 172.21.15.8:0/3547369581 conn(0x7f301806a200 msgr2=0x7f301806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:27.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.105+0000 7f3017fff640 1 -- 172.21.15.8:0/3547369581 shutdown_connections 2023-10-14T10:34:27.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.105+0000 7f3017fff640 1 -- 172.21.15.8:0/3547369581 wait complete. 2023-10-14T10:34:27.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.107+0000 7f3017fff640 1 Processor -- start 2023-10-14T10:34:27.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.107+0000 7f3017fff640 1 -- start start 2023-10-14T10:34:27.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.108+0000 7f3017fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f301806fb10 0x7f30180bd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.108+0000 7f3017fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180c2670 0x7f30181ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.108+0000 7f3017fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f301813af90 0x7f30181e0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.108+0000 7f3017fff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018071a40 con 0x7f30180c2670 2023-10-14T10:34:27.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.108+0000 7f3017fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30180bf060 con 0x7f301806fb10 2023-10-14T10:34:27.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.108+0000 7f3017fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30180bf340 con 0x7f301813af90 2023-10-14T10:34:27.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.108+0000 7f30167fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180c2670 0x7f30181ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:27.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.109+0000 7f30167fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180c2670 0x7f30181ecfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60508/0 (socket says 172.21.15.8:60508) 2023-10-14T10:34:27.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.109+0000 7f30167fc640 1 -- 172.21.15.8:0/277242618 learned_addr learned my addr 172.21.15.8:0/277242618 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:27.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.109+0000 7f3016ffd640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f301806fb10 0x7f30180bd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:27.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.109+0000 7f30167fc640 1 -- 172.21.15.8:0/277242618 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f301813af90 msgr2=0x7f30181e0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:27.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.109+0000 7f30167fc640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f301813af90 0x7f30181e0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.109+0000 7f30167fc640 1 -- 172.21.15.8:0/277242618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f301806fb10 msgr2=0x7f30180bd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:27.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.109+0000 7f30167fc640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f301806fb10 0x7f30180bd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.109+0000 7f30167fc640 1 -- 172.21.15.8:0/277242618 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30000094d0 con 0x7f30180c2670 2023-10-14T10:34:27.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.109+0000 7f30167fc640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180c2670 0x7f30181ecfd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3000000c00 tx=0x7f30000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:27.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.110+0000 7f300f7fe640 1 -- 172.21.15.8:0/277242618 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000032880 con 0x7f30180c2670 2023-10-14T10:34:27.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.110+0000 7f300f7fe640 1 -- 172.21.15.8:0/277242618 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30000329e0 con 0x7f30180c2670 2023-10-14T10:34:27.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.110+0000 7f300f7fe640 1 -- 172.21.15.8:0/277242618 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000032d90 con 0x7f30180c2670 2023-10-14T10:34:27.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.110+0000 7f3017fff640 1 -- 172.21.15.8:0/277242618 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30181ec4f0 con 0x7f30180c2670 2023-10-14T10:34:27.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.110+0000 7f3017fff640 1 -- 172.21.15.8:0/277242618 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30181ecab0 con 0x7f30180c2670 2023-10-14T10:34:27.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.111+0000 7f3017fff640 1 -- 172.21.15.8:0/277242618 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30181ecca0 con 0x7f30180c2670 2023-10-14T10:34:27.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.112+0000 7f300f7fe640 1 -- 172.21.15.8:0/277242618 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f300004d3f0 con 0x7f30180c2670 2023-10-14T10:34:27.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.113+0000 7f300f7fe640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ff806ae70 0x7f2ff806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.113+0000 7f300f7fe640 1 -- 172.21.15.8:0/277242618 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30000ab610 con 0x7f30180c2670 2023-10-14T10:34:27.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.113+0000 7f3016ffd640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ff806ae70 0x7f2ff806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:27.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.114+0000 7f3016ffd640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ff806ae70 0x7f2ff806d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3008009f10 tx=0x7f3008009570 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:27.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.117+0000 7f300f7fe640 1 -- 172.21.15.8:0/277242618 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3000076620 con 0x7f30180c2670 2023-10-14T10:34:27.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.311+0000 7f3017fff640 1 -- 172.21.15.8:0/277242618 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30180a86f0 con 0x7f30180c2670 2023-10-14T10:34:27.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.312+0000 7f300f7fe640 1 -- 172.21.15.8:0/277242618 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3000080070 con 0x7f30180c2670 2023-10-14T10:34:27.314 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T10:34:27.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.314+0000 7f3017fff640 1 -- 172.21.15.8:0/277242618 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ff806ae70 msgr2=0x7f2ff806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:27.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.314+0000 7f3017fff640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ff806ae70 0x7f2ff806d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3008009f10 tx=0x7f3008009570 comp rx=0 tx=0).stop 2023-10-14T10:34:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.314+0000 7f3017fff640 1 -- 172.21.15.8:0/277242618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180c2670 msgr2=0x7f30181ecfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.314+0000 7f3017fff640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180c2670 0x7f30181ecfd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3000000c00 tx=0x7f30000046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.315+0000 7f3017fff640 1 -- 172.21.15.8:0/277242618 shutdown_connections 2023-10-14T10:34:27.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.315+0000 7f3017fff640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ff806ae70 0x7f2ff806d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.315+0000 7f3017fff640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f301813af90 0x7f30181e0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.315+0000 7f3017fff640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30180c2670 0x7f30181ecfd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.315+0000 7f3017fff640 1 --2- 172.21.15.8:0/277242618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f301806fb10 0x7f30180bd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.315+0000 7f3017fff640 1 -- 172.21.15.8:0/277242618 >> 172.21.15.8:0/277242618 conn(0x7f301806a200 msgr2=0x7f3018070250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:27.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.315+0000 7f3017fff640 1 -- 172.21.15.8:0/277242618 shutdown_connections 2023-10-14T10:34:27.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.315+0000 7f3017fff640 1 -- 172.21.15.8:0/277242618 wait complete. 2023-10-14T10:34:27.335 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T10:34:27.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.569+0000 7f27e4fe2640 1 Processor -- start 2023-10-14T10:34:27.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.569+0000 7f27e4fe2640 1 -- start start 2023-10-14T10:34:27.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.571+0000 7f27e4fe2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27e014f3a0 0x7f27e0071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.571+0000 7f27e4fe2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f27e00bfee0 0x7f27e0152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.571+0000 7f27e4fe2640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e00c57a0 con 0x7f27e0155440 2023-10-14T10:34:27.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.571+0000 7f27e4fe2640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e006cee0 con 0x7f27e00bfee0 2023-10-14T10:34:27.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.571+0000 7f27e4fe2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e0151e50 con 0x7f27e014f3a0 2023-10-14T10:34:27.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.571+0000 7f27d7fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f27e0155440 0x7f27e006d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51546/0 (socket says 172.21.15.8:51546) 2023-10-14T10:34:27.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.571+0000 7f27d7fff640 1 -- 172.21.15.8:0/645966249 learned_addr learned my addr 172.21.15.8:0/645966249 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:27.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.571+0000 7f27de59c640 1 --2- 172.21.15.8:0/645966249 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27e014f3a0 0x7f27e0071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:27.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.571+0000 7f27ded9d640 1 --2- 172.21.15.8:0/645966249 >> v2:172.21.15.8:3300/0 conn(0x7f27e00bfee0 0x7f27e0152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:27.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.572+0000 7f27ded9d640 1 -- 172.21.15.8:0/645966249 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27e014f3a0 msgr2=0x7f27e0071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:27.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.572+0000 7f27ded9d640 1 --2- 172.21.15.8:0/645966249 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27e014f3a0 0x7f27e0071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.572+0000 7f27ded9d640 1 -- 172.21.15.8:0/645966249 >> v1:172.21.15.8:6789/0 conn(0x7f27e0155440 legacy=0x7f27e006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:27.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.572+0000 7f27ded9d640 1 -- 172.21.15.8:0/645966249 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e00c59f0 con 0x7f27e00bfee0 2023-10-14T10:34:27.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.572+0000 7f27de59c640 1 --2- 172.21.15.8:0/645966249 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27e014f3a0 0x7f27e0071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:34:27.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.572+0000 7f27ddd9b640 1 -- 172.21.15.8:0/645966249 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342766120 0 0) 0x7f27e00c57a0 con 0x7f27e0155440 2023-10-14T10:34:27.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.575+0000 7f27ded9d640 1 --2- 172.21.15.8:0/645966249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27e00bfee0 0x7f27e0152580 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009d90 tx=0x7f27d802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f36854fcc0f4e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:27.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.575+0000 7f27ddd9b640 1 -- 172.21.15.8:0/645966249 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d802cbc0 con 0x7f27e00bfee0 2023-10-14T10:34:27.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.575+0000 7f27ddd9b640 1 -- 172.21.15.8:0/645966249 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d802cd20 con 0x7f27e00bfee0 2023-10-14T10:34:27.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.575+0000 7f27ddd9b640 1 -- 172.21.15.8:0/645966249 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8034660 con 0x7f27e00bfee0 2023-10-14T10:34:27.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.576+0000 7f27e4fe2640 1 -- 172.21.15.8:0/645966249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27e00bfee0 msgr2=0x7f27e0152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:27.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.576+0000 7f27e4fe2640 1 --2- 172.21.15.8:0/645966249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27e00bfee0 0x7f27e0152580 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009d90 tx=0x7f27d802be10 comp rx=0 tx=0).stop 2023-10-14T10:34:27.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.576+0000 7f27e4fe2640 1 -- 172.21.15.8:0/645966249 shutdown_connections 2023-10-14T10:34:27.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.576+0000 7f27e4fe2640 1 --2- 172.21.15.8:0/645966249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27e00bfee0 0x7f27e0152580 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.576+0000 7f27e4fe2640 1 --2- 172.21.15.8:0/645966249 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27e014f3a0 0x7f27e0071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.576+0000 7f27e4fe2640 1 -- 172.21.15.8:0/645966249 >> 172.21.15.8:0/645966249 conn(0x7f27e00a74d0 msgr2=0x7f27e00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:27.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.576+0000 7f27e4fe2640 1 -- 172.21.15.8:0/645966249 shutdown_connections 2023-10-14T10:34:27.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.576+0000 7f27e4fe2640 1 -- 172.21.15.8:0/645966249 wait complete. 2023-10-14T10:34:27.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.578+0000 7f27e4fe2640 1 Processor -- start 2023-10-14T10:34:27.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.578+0000 7f27e4fe2640 1 -- start start 2023-10-14T10:34:27.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.579+0000 7f27e4fe2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27e00bfee0 0x7f27e01ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.579+0000 7f27e4fe2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27e014f3a0 0x7f27e01517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.579+0000 7f27e4fe2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27e0155440 0x7f27e0152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.579+0000 7f27e4fe2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00a9580 con 0x7f27e014f3a0 2023-10-14T10:34:27.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.579+0000 7f27e4fe2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e0151cf0 con 0x7f27e00bfee0 2023-10-14T10:34:27.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.579+0000 7f27e4fe2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e01e9cf0 con 0x7f27e0155440 2023-10-14T10:34:27.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.580+0000 7f27d7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27e014f3a0 0x7f27e01517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:27.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.580+0000 7f27d7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27e014f3a0 0x7f27e01517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60512/0 (socket says 172.21.15.8:60512) 2023-10-14T10:34:27.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.580+0000 7f27d7fff640 1 -- 172.21.15.8:0/2510687835 learned_addr learned my addr 172.21.15.8:0/2510687835 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:27.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.580+0000 7f27d7fff640 1 -- 172.21.15.8:0/2510687835 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27e0155440 msgr2=0x7f27e0152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:27.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.580+0000 7f27ded9d640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27e0155440 0x7f27e0152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:27.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.580+0000 7f27de59c640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27e00bfee0 0x7f27e01ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.580+0000 7f27d7fff640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27e0155440 0x7f27e0152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.580+0000 7f27d7fff640 1 -- 172.21.15.8:0/2510687835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27e00bfee0 msgr2=0x7f27e01ed430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.580+0000 7f27d7fff640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27e00bfee0 0x7f27e01ed430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.580+0000 7f27d7fff640 1 -- 172.21.15.8:0/2510687835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d0009400 con 0x7f27e014f3a0 2023-10-14T10:34:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.580+0000 7f27de59c640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27e00bfee0 0x7f27e01ed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:27.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.580+0000 7f27d7fff640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27e014f3a0 0x7f27e01517b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f27c800c410 tx=0x7f27c800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:27.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.581+0000 7f27d6ffd640 1 -- 172.21.15.8:0/2510687835 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80074e0 con 0x7f27e014f3a0 2023-10-14T10:34:27.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.581+0000 7f27d6ffd640 1 -- 172.21.15.8:0/2510687835 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c8007660 con 0x7f27e014f3a0 2023-10-14T10:34:27.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.581+0000 7f27d6ffd640 1 -- 172.21.15.8:0/2510687835 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8004a20 con 0x7f27e014f3a0 2023-10-14T10:34:27.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.581+0000 7f27e4fe2640 1 -- 172.21.15.8:0/2510687835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d8009a70 con 0x7f27e014f3a0 2023-10-14T10:34:27.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.581+0000 7f27e4fe2640 1 -- 172.21.15.8:0/2510687835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e01ec990 con 0x7f27e014f3a0 2023-10-14T10:34:27.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.582+0000 7f27e4fe2640 1 -- 172.21.15.8:0/2510687835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e00c5f90 con 0x7f27e014f3a0 2023-10-14T10:34:27.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.583+0000 7f27d6ffd640 1 -- 172.21.15.8:0/2510687835 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f27c8004b80 con 0x7f27e014f3a0 2023-10-14T10:34:27.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.584+0000 7f27d6ffd640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f27c006ae70 0x7f27c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:27.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.584+0000 7f27d6ffd640 1 -- 172.21.15.8:0/2510687835 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27c8089490 con 0x7f27e014f3a0 2023-10-14T10:34:27.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.584+0000 7f27de59c640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f27c006ae70 0x7f27c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:27.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.585+0000 7f27de59c640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f27c006ae70 0x7f27c006d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009c50 tx=0x7f27d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:27.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.589+0000 7f27d6ffd640 1 -- 172.21.15.8:0/2510687835 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27e00c5f90 con 0x7f27e014f3a0 2023-10-14T10:34:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.796+0000 7f27e4fe2640 1 -- 172.21.15.8:0/2510687835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f27e00c5f90 con 0x7f27e014f3a0 2023-10-14T10:34:27.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.797+0000 7f27d6ffd640 1 -- 172.21.15.8:0/2510687835 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f27e00c5f90 con 0x7f27e014f3a0 2023-10-14T10:34:27.799 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2023-10-14T10:34:27.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.799+0000 7f27e4fe2640 1 -- 172.21.15.8:0/2510687835 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f27c006ae70 msgr2=0x7f27c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:27.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.799+0000 7f27e4fe2640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f27c006ae70 0x7f27c006d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009c50 tx=0x7f27d0008040 comp rx=0 tx=0).stop 2023-10-14T10:34:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.799+0000 7f27e4fe2640 1 -- 172.21.15.8:0/2510687835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27e014f3a0 msgr2=0x7f27e01517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.799+0000 7f27e4fe2640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27e014f3a0 0x7f27e01517b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f27c800c410 tx=0x7f27c800c8d0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.800+0000 7f27e4fe2640 1 -- 172.21.15.8:0/2510687835 shutdown_connections 2023-10-14T10:34:27.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.800+0000 7f27e4fe2640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f27c006ae70 0x7f27c006d330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.800+0000 7f27e4fe2640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27e0155440 0x7f27e0152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.800+0000 7f27e4fe2640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f27e014f3a0 0x7f27e01517b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.800+0000 7f27e4fe2640 1 --2- 172.21.15.8:0/2510687835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27e00bfee0 0x7f27e01ed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:27.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.800+0000 7f27e4fe2640 1 -- 172.21.15.8:0/2510687835 >> 172.21.15.8:0/2510687835 conn(0x7f27e00a74d0 msgr2=0x7f27e00c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:27.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.800+0000 7f27e4fe2640 1 -- 172.21.15.8:0/2510687835 shutdown_connections 2023-10-14T10:34:27.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:27.800+0000 7f27e4fe2640 1 -- 172.21.15.8:0/2510687835 wait complete. 2023-10-14T10:34:27.822 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T10:34:27.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:27.823 DEBUG:teuthology.orchestra.run.smithi008:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-14T10:34:27.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:34:27.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:27.935 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T10:34:28.003 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:34:28.003 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T10:34:28.064 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:34:28.065 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T10:34:28.123 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:34:28.124 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T10:34:28.179 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:28.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.412+0000 7f5f60af3640 1 Processor -- start 2023-10-14T10:34:28.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.412+0000 7f5f60af3640 1 -- start start 2023-10-14T10:34:28.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.413+0000 7f5f60af3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5f5c0c2380 0x7f5f5c155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.414+0000 7f5f60af3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5f5c0a8500 0x7f5f5c155860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.414+0000 7f5f60af3640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5c071d70 con 0x7f5f5c158170 2023-10-14T10:34:28.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.414+0000 7f5f60af3640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5c158d10 con 0x7f5f5c0a8500 2023-10-14T10:34:28.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.414+0000 7f5f60af3640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5c15c230 con 0x7f5f5c0c2380 2023-10-14T10:34:28.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.414+0000 7f5f53fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5f5c0a8500 0x7f5f5c155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.414+0000 7f5f5bfff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5f5c158170 0x7f5f5c158600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51552/0 (socket says 172.21.15.8:51552) 2023-10-14T10:34:28.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.414+0000 7f5f5bfff640 1 -- 172.21.15.8:0/3966981860 learned_addr learned my addr 172.21.15.8:0/3966981860 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:28.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.414+0000 7f5f5b7fe640 1 --2- 172.21.15.8:0/3966981860 >> v2:172.21.15.92:3300/0 conn(0x7f5f5c0c2380 0x7f5f5c155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.415+0000 7f5f53fff640 1 -- 172.21.15.8:0/3966981860 >> v2:172.21.15.92:3300/0 conn(0x7f5f5c0c2380 msgr2=0x7f5f5c155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:28.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.415+0000 7f5f53fff640 1 --2- 172.21.15.8:0/3966981860 >> v2:172.21.15.92:3300/0 conn(0x7f5f5c0c2380 0x7f5f5c155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.415+0000 7f5f53fff640 1 -- 172.21.15.8:0/3966981860 >> v1:172.21.15.8:6789/0 conn(0x7f5f5c158170 legacy=0x7f5f5c158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:28.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.415+0000 7f5f53fff640 1 -- 172.21.15.8:0/3966981860 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c15c6c0 con 0x7f5f5c0a8500 2023-10-14T10:34:28.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.416+0000 7f5f53fff640 1 --2- 172.21.15.8:0/3966981860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f5c0a8500 0x7f5f5c155860 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0c2d20 tx=0x7f5f4402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aaa5786600883fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:28.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.416+0000 7f5f5affd640 1 -- 172.21.15.8:0/3966981860 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4402e070 con 0x7f5f5c0a8500 2023-10-14T10:34:28.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.416+0000 7f5f5affd640 1 -- 172.21.15.8:0/3966981860 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f440315a0 con 0x7f5f5c0a8500 2023-10-14T10:34:28.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.416+0000 7f5f5affd640 1 -- 172.21.15.8:0/3966981860 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44031930 con 0x7f5f5c0a8500 2023-10-14T10:34:28.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.417+0000 7f5f60af3640 1 -- 172.21.15.8:0/3966981860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f5c0a8500 msgr2=0x7f5f5c155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:28.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.417+0000 7f5f60af3640 1 --2- 172.21.15.8:0/3966981860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f5c0a8500 0x7f5f5c155860 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0c2d20 tx=0x7f5f4402b840 comp rx=0 tx=0).stop 2023-10-14T10:34:28.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.417+0000 7f5f60af3640 1 -- 172.21.15.8:0/3966981860 shutdown_connections 2023-10-14T10:34:28.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.417+0000 7f5f60af3640 1 --2- 172.21.15.8:0/3966981860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f5c0a8500 0x7f5f5c155860 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.417+0000 7f5f60af3640 1 --2- 172.21.15.8:0/3966981860 >> v2:172.21.15.92:3300/0 conn(0x7f5f5c0c2380 0x7f5f5c155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.417+0000 7f5f60af3640 1 -- 172.21.15.8:0/3966981860 >> 172.21.15.8:0/3966981860 conn(0x7f5f5c06a200 msgr2=0x7f5f5c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:28.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.417+0000 7f5f60af3640 1 -- 172.21.15.8:0/3966981860 shutdown_connections 2023-10-14T10:34:28.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.417+0000 7f5f60af3640 1 -- 172.21.15.8:0/3966981860 wait complete. 2023-10-14T10:34:28.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.419+0000 7f5f60af3640 1 Processor -- start 2023-10-14T10:34:28.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.419+0000 7f5f60af3640 1 -- start start 2023-10-14T10:34:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.420+0000 7f5f60af3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f5c0a8500 0x7f5f5c0be700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.420+0000 7f5f60af3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f5c0c2380 0x7f5f5c15a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.420+0000 7f5f60af3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f5c158170 0x7f5f5c06b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.420+0000 7f5f60af3640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c1502b0 con 0x7f5f5c0a8500 2023-10-14T10:34:28.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.420+0000 7f5f60af3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c1f15f0 con 0x7f5f5c0c2380 2023-10-14T10:34:28.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.420+0000 7f5f60af3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c0c4720 con 0x7f5f5c158170 2023-10-14T10:34:28.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.420+0000 7f5f5b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f5c0a8500 0x7f5f5c0be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.420+0000 7f5f5b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f5c0a8500 0x7f5f5c0be700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60540/0 (socket says 172.21.15.8:60540) 2023-10-14T10:34:28.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.420+0000 7f5f5b7fe640 1 -- 172.21.15.8:0/858753655 learned_addr learned my addr 172.21.15.8:0/858753655 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:28.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f53fff640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f5c0c2380 0x7f5f5c15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f5bfff640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f5c158170 0x7f5f5c06b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f5b7fe640 1 -- 172.21.15.8:0/858753655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f5c158170 msgr2=0x7f5f5c06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:28.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f5b7fe640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f5c158170 0x7f5f5c06b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f5b7fe640 1 -- 172.21.15.8:0/858753655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f5c0c2380 msgr2=0x7f5f5c15a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:28.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f5b7fe640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f5c0c2380 0x7f5f5c15a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f5b7fe640 1 -- 172.21.15.8:0/858753655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44009400 con 0x7f5f5c0a8500 2023-10-14T10:34:28.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f5bfff640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f5c158170 0x7f5f5c06b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:28.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f53fff640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f5c0c2380 0x7f5f5c15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f5b7fe640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f5c0a8500 0x7f5f5c0be700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00d830 tx=0x7f5f4c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f58ff9640 1 -- 172.21.15.8:0/858753655 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00b6c0 con 0x7f5f5c0a8500 2023-10-14T10:34:28.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f58ff9640 1 -- 172.21.15.8:0/858753655 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c00b820 con 0x7f5f5c0a8500 2023-10-14T10:34:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f58ff9640 1 -- 172.21.15.8:0/858753655 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00bbb0 con 0x7f5f5c0a8500 2023-10-14T10:34:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.421+0000 7f5f60af3640 1 -- 172.21.15.8:0/858753655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5c1f1090 con 0x7f5f5c0a8500 2023-10-14T10:34:28.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.422+0000 7f5f60af3640 1 -- 172.21.15.8:0/858753655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5c0c43b0 con 0x7f5f5c0a8500 2023-10-14T10:34:28.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.423+0000 7f5f60af3640 1 -- 172.21.15.8:0/858753655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5c070390 con 0x7f5f5c0a8500 2023-10-14T10:34:28.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.423+0000 7f5f58ff9640 1 -- 172.21.15.8:0/858753655 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5f4c01e460 con 0x7f5f5c0a8500 2023-10-14T10:34:28.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.424+0000 7f5f58ff9640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5f3c06ae70 0x7f5f3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.424+0000 7f5f58ff9640 1 -- 172.21.15.8:0/858753655 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f4c089dc0 con 0x7f5f5c0a8500 2023-10-14T10:34:28.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.425+0000 7f5f53fff640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5f3c06ae70 0x7f5f3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.425+0000 7f5f53fff640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5f3c06ae70 0x7f5f3c06d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f44036000 tx=0x7f5f4403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:28.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.429+0000 7f5f58ff9640 1 -- 172.21.15.8:0/858753655 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f4c054e60 con 0x7f5f5c0a8500 2023-10-14T10:34:28.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.625+0000 7f5f60af3640 1 -- 172.21.15.8:0/858753655 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f5c04e9b0 con 0x7f5f5c0a8500 2023-10-14T10:34:28.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.628+0000 7f5f58ff9640 1 -- 172.21.15.8:0/858753655 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7f5f4c058480 con 0x7f5f5c0a8500 2023-10-14T10:34:28.631 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:28.631 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:28.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.631+0000 7f5f60af3640 1 -- 172.21.15.8:0/858753655 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5f3c06ae70 msgr2=0x7f5f3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:28.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.631+0000 7f5f60af3640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5f3c06ae70 0x7f5f3c06d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f44036000 tx=0x7f5f4403d040 comp rx=0 tx=0).stop 2023-10-14T10:34:28.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.631+0000 7f5f60af3640 1 -- 172.21.15.8:0/858753655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f5c0a8500 msgr2=0x7f5f5c0be700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:28.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.631+0000 7f5f60af3640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f5c0a8500 0x7f5f5c0be700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00d830 tx=0x7f5f4c00dcf0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.631+0000 7f5f60af3640 1 -- 172.21.15.8:0/858753655 shutdown_connections 2023-10-14T10:34:28.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.631+0000 7f5f60af3640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5f3c06ae70 0x7f5f3c06d330 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.631+0000 7f5f60af3640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f5c158170 0x7f5f5c06b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.631+0000 7f5f60af3640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f5c0c2380 0x7f5f5c15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.631+0000 7f5f60af3640 1 --2- 172.21.15.8:0/858753655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f5c0a8500 0x7f5f5c0be700 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.631+0000 7f5f60af3640 1 -- 172.21.15.8:0/858753655 >> 172.21.15.8:0/858753655 conn(0x7f5f5c06a200 msgr2=0x7f5f5c1585e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:28.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.632+0000 7f5f60af3640 1 -- 172.21.15.8:0/858753655 shutdown_connections 2023-10-14T10:34:28.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.632+0000 7f5f60af3640 1 -- 172.21.15.8:0/858753655 wait complete. 2023-10-14T10:34:28.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T10:33:44.913451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T10:33:46.397320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:34:28.656 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:34:28.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.884+0000 7f2f9ffff640 1 Processor -- start 2023-10-14T10:34:28.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.884+0000 7f2f9ffff640 1 -- start start 2023-10-14T10:34:28.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.885+0000 7f2f9ffff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2fa00c4720 0x7f2fa006b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.885+0000 7f2f9ffff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa00c66f0 con 0x7f2fa0151400 2023-10-14T10:34:28.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.885+0000 7f2f9ffff640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa01548d0 con 0x7f2fa00bcd60 2023-10-14T10:34:28.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.885+0000 7f2f9ffff640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa00c4d20 con 0x7f2fa00c4720 2023-10-14T10:34:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.886+0000 7f2f9effd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2fa0151400 0x7f2fa00c4010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51554/0 (socket says 172.21.15.8:51554) 2023-10-14T10:34:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.886+0000 7f2f9effd640 1 -- 172.21.15.8:0/867175635 learned_addr learned my addr 172.21.15.8:0/867175635 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:28.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.886+0000 7f2f9e7fc640 1 --2- 172.21.15.8:0/867175635 >> v2:172.21.15.92:3300/0 conn(0x7f2fa00c4720 0x7f2fa006b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.886+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090159293 0 0) 0x7f2fa00c66f0 con 0x7f2fa0151400 2023-10-14T10:34:28.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f8c003520 con 0x7f2fa0151400 2023-10-14T10:34:28.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717271764 0 0) 0x7f2fa01548d0 con 0x7f2fa00bcd60 2023-10-14T10:34:28.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa00c66f0 con 0x7f2fa00bcd60 2023-10-14T10:34:28.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3380100256 0 0) 0x7f2f8c003520 con 0x7f2fa0151400 2023-10-14T10:34:28.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 >> v2:172.21.15.92:3300/0 conn(0x7f2fa00c4720 msgr2=0x7f2fa006b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:28.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 --2- 172.21.15.8:0/867175635 >> v2:172.21.15.92:3300/0 conn(0x7f2fa00c4720 0x7f2fa006b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 >> v1:172.21.15.92:6789/0 conn(0x7f2fa00bcd60 legacy=0x7f2fa006b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:28.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa0154bb0 con 0x7f2fa0151400 2023-10-14T10:34:28.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f2f900019f0 con 0x7f2fa0151400 2023-10-14T10:34:28.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 >> v1:172.21.15.8:6789/0 conn(0x7f2fa0151400 legacy=0x7f2fa00c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:28.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 --2- 172.21.15.8:0/867175635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f8c003b00 0x7f2f8c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 --2- 172.21.15.8:0/867175635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f8c0047c0 0x7f2f8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 --2- 172.21.15.8:0/867175635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f8c0051f0 0x7f2f8c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c00c120 con 0x7f2f8c0047c0 2023-10-14T10:34:28.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c00c290 con 0x7f2f8c003b00 2023-10-14T10:34:28.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.887+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c00c450 con 0x7f2f8c0051f0 2023-10-14T10:34:28.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.888+0000 7f2f9e7fc640 1 --2- 172.21.15.8:0/867175635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f8c0047c0 0x7f2f8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.888+0000 7f2f9effd640 1 --2- 172.21.15.8:0/867175635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f8c003b00 0x7f2f8c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.888+0000 7f2f9f7fe640 1 --2- 172.21.15.8:0/867175635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f8c0051f0 0x7f2f8c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.888+0000 7f2f9e7fc640 1 -- 172.21.15.8:0/867175635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f8c0051f0 msgr2=0x7f2f8c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:28.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.888+0000 7f2f9e7fc640 1 --2- 172.21.15.8:0/867175635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f8c0051f0 0x7f2f8c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.888+0000 7f2f9e7fc640 1 -- 172.21.15.8:0/867175635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f8c003b00 msgr2=0x7f2f8c003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:28.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.888+0000 7f2f9e7fc640 1 --2- 172.21.15.8:0/867175635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f8c003b00 0x7f2f8c003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.888+0000 7f2f9e7fc640 1 -- 172.21.15.8:0/867175635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c003520 con 0x7f2f8c0047c0 2023-10-14T10:34:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.888+0000 7f2f9f7fe640 1 -- 172.21.15.8:0/867175635 reap_dead start 2023-10-14T10:34:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.889+0000 7f2f9e7fc640 1 --2- 172.21.15.8:0/867175635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f8c0047c0 0x7f2f8c004c40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009a90 tx=0x7f2f8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c63197f4ae7c5f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.890+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8802c680 con 0x7f2f8c0047c0 2023-10-14T10:34:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.890+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8802c7e0 con 0x7f2f8c0047c0 2023-10-14T10:34:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.890+0000 7f2f9dffb640 1 -- 172.21.15.8:0/867175635 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8802cb90 con 0x7f2f8c0047c0 2023-10-14T10:34:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.890+0000 7f2f9ffff640 1 -- 172.21.15.8:0/867175635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f8c0047c0 msgr2=0x7f2f8c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.890+0000 7f2f9ffff640 1 --2- 172.21.15.8:0/867175635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f8c0047c0 0x7f2f8c004c40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009a90 tx=0x7f2f8c0057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.890+0000 7f2f9ffff640 1 -- 172.21.15.8:0/867175635 shutdown_connections 2023-10-14T10:34:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.890+0000 7f2f9ffff640 1 --2- 172.21.15.8:0/867175635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f8c0047c0 0x7f2f8c004c40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.890+0000 7f2f9ffff640 1 -- 172.21.15.8:0/867175635 >> 172.21.15.8:0/867175635 conn(0x7f2fa00ab280 msgr2=0x7f2fa00ab690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.890+0000 7f2f9ffff640 1 -- 172.21.15.8:0/867175635 shutdown_connections 2023-10-14T10:34:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.891+0000 7f2f9ffff640 1 -- 172.21.15.8:0/867175635 wait complete. 2023-10-14T10:34:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.892+0000 7f2f9ffff640 1 Processor -- start 2023-10-14T10:34:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.892+0000 7f2f9ffff640 1 -- start start 2023-10-14T10:34:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.893+0000 7f2f9ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f8c0047c0 0x7f2fa01e9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.893+0000 7f2f9ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa00bc680 0x7f2fa00aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.893+0000 7f2f9ffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fa00beb40 0x7f2fa00befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.893+0000 7f2f9ffff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00bf500 con 0x7f2fa00bc680 2023-10-14T10:34:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.893+0000 7f2f9ffff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa01e9ec0 con 0x7f2f8c0047c0 2023-10-14T10:34:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.893+0000 7f2f9ffff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa0151dc0 con 0x7f2fa00beb40 2023-10-14T10:34:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.894+0000 7f2f9e7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa00bc680 0x7f2fa00aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.894+0000 7f2f9e7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa00bc680 0x7f2fa00aa400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60552/0 (socket says 172.21.15.8:60552) 2023-10-14T10:34:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.894+0000 7f2f9e7fc640 1 -- 172.21.15.8:0/3853917710 learned_addr learned my addr 172.21.15.8:0/3853917710 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.894+0000 7f2f9effd640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f8c0047c0 0x7f2fa01e9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.894+0000 7f2f9f7fe640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fa00beb40 0x7f2fa00befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.894+0000 7f2f9e7fc640 1 -- 172.21.15.8:0/3853917710 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fa00beb40 msgr2=0x7f2fa00befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.894+0000 7f2f9e7fc640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fa00beb40 0x7f2fa00befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.894+0000 7f2f9e7fc640 1 -- 172.21.15.8:0/3853917710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f8c0047c0 msgr2=0x7f2fa01e9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.894+0000 7f2f9e7fc640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f8c0047c0 0x7f2fa01e9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.894+0000 7f2f9e7fc640 1 -- 172.21.15.8:0/3853917710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa01461e0 con 0x7f2fa00bc680 2023-10-14T10:34:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.894+0000 7f2f9f7fe640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fa00beb40 0x7f2fa00befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.895+0000 7f2f9e7fc640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa00bc680 0x7f2fa00aa400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2f8802c2f0 tx=0x7f2f88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.895+0000 7f2f977fe640 1 -- 172.21.15.8:0/3853917710 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88034a50 con 0x7f2fa00bc680 2023-10-14T10:34:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.895+0000 7f2f977fe640 1 -- 172.21.15.8:0/3853917710 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88034bb0 con 0x7f2fa00bc680 2023-10-14T10:34:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.895+0000 7f2f977fe640 1 -- 172.21.15.8:0/3853917710 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8803e400 con 0x7f2fa00bc680 2023-10-14T10:34:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.895+0000 7f2f9ffff640 1 -- 172.21.15.8:0/3853917710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa00bd5e0 con 0x7f2fa00bc680 2023-10-14T10:34:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.895+0000 7f2f9ffff640 1 -- 172.21.15.8:0/3853917710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa01ea3d0 con 0x7f2fa00bc680 2023-10-14T10:34:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.896+0000 7f2f9ffff640 1 -- 172.21.15.8:0/3853917710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa00c6f90 con 0x7f2fa00bc680 2023-10-14T10:34:28.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.897+0000 7f2f977fe640 1 -- 172.21.15.8:0/3853917710 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2f8803e560 con 0x7f2fa00bc680 2023-10-14T10:34:28.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.898+0000 7f2f977fe640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2f8006aea0 0x7f2f8006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:28.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.898+0000 7f2f977fe640 1 -- 172.21.15.8:0/3853917710 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f880ab580 con 0x7f2fa00bc680 2023-10-14T10:34:28.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.899+0000 7f2f9effd640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2f8006aea0 0x7f2f8006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:28.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.899+0000 7f2f9effd640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2f8006aea0 0x7f2f8006d360 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f90002230 tx=0x7f2f90009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:28.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:28.902+0000 7f2f977fe640 1 -- 172.21.15.8:0/3853917710 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f880767f0 con 0x7f2fa00bc680 2023-10-14T10:34:29.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.093+0000 7f2f9ffff640 1 -- 172.21.15.8:0/3853917710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fa00c7620 con 0x7f2fa00bc680 2023-10-14T10:34:29.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.094+0000 7f2f977fe640 1 -- 172.21.15.8:0/3853917710 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f88079e10 con 0x7f2fa00bc680 2023-10-14T10:34:29.096 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:34:29.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.097+0000 7f2f9ffff640 1 -- 172.21.15.8:0/3853917710 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2f8006aea0 msgr2=0x7f2f8006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:29.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.097+0000 7f2f9ffff640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2f8006aea0 0x7f2f8006d360 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f90002230 tx=0x7f2f90009040 comp rx=0 tx=0).stop 2023-10-14T10:34:29.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.097+0000 7f2f9ffff640 1 -- 172.21.15.8:0/3853917710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa00bc680 msgr2=0x7f2fa00aa400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:29.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.097+0000 7f2f9ffff640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa00bc680 0x7f2fa00aa400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2f8802c2f0 tx=0x7f2f88004730 comp rx=0 tx=0).stop 2023-10-14T10:34:29.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.097+0000 7f2f9ffff640 1 -- 172.21.15.8:0/3853917710 shutdown_connections 2023-10-14T10:34:29.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.097+0000 7f2f9ffff640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2f8006aea0 0x7f2f8006d360 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.097+0000 7f2f9ffff640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fa00beb40 0x7f2fa00befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.097+0000 7f2f9ffff640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fa00bc680 0x7f2fa00aa400 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.097+0000 7f2f9ffff640 1 --2- 172.21.15.8:0/3853917710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f8c0047c0 0x7f2fa01e9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.097+0000 7f2f9ffff640 1 -- 172.21.15.8:0/3853917710 >> 172.21.15.8:0/3853917710 conn(0x7f2fa00ab280 msgr2=0x7f2fa00c3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:29.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.097+0000 7f2f9ffff640 1 -- 172.21.15.8:0/3853917710 shutdown_connections 2023-10-14T10:34:29.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.097+0000 7f2f9ffff640 1 -- 172.21.15.8:0/3853917710 wait complete. 2023-10-14T10:34:29.119 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T10:34:29.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.348+0000 7f0ce759e640 1 Processor -- start 2023-10-14T10:34:29.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.349+0000 7f0ce759e640 1 -- start start 2023-10-14T10:34:29.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.350+0000 7f0ce759e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ce8155a80 0x7f0ce80719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.350+0000 7f0ce759e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ce80ba3e0 0x7f0ce80c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.350+0000 7f0ce759e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0ce80c2670 0x7f0ce815b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.350+0000 7f0ce759e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce8072060 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.350+0000 7f0ce759e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce81584f0 con 0x7f0ce80c2670 2023-10-14T10:34:29.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.350+0000 7f0ce759e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8159270 con 0x7f0ce8155a80 2023-10-14T10:34:29.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.351+0000 7f0ce5d9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ce80ba3e0 0x7f0ce80c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:29.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.351+0000 7f0ce5d9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ce80ba3e0 0x7f0ce80c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60556/0 (socket says 172.21.15.8:60556) 2023-10-14T10:34:29.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.351+0000 7f0ce5d9b640 1 -- 172.21.15.8:0/3767989307 learned_addr learned my addr 172.21.15.8:0/3767989307 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:29.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.351+0000 7f0ce659c640 1 --2- 172.21.15.8:0/3767989307 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ce8155a80 0x7f0ce80719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:29.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.351+0000 7f0ce5d9b640 1 -- 172.21.15.8:0/3767989307 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ce8155a80 msgr2=0x7f0ce80719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:29.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.351+0000 7f0ce5d9b640 1 --2- 172.21.15.8:0/3767989307 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ce8155a80 0x7f0ce80719f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.351+0000 7f0ce5d9b640 1 -- 172.21.15.8:0/3767989307 >> v2:172.21.15.92:3300/0 conn(0x7f0ce80c2670 msgr2=0x7f0ce815b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:29.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.351+0000 7f0ce5d9b640 1 --2- 172.21.15.8:0/3767989307 >> v2:172.21.15.92:3300/0 conn(0x7f0ce80c2670 0x7f0ce815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.351+0000 7f0ce5d9b640 1 -- 172.21.15.8:0/3767989307 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce8158790 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.352+0000 7f0ce5d9b640 1 --2- 172.21.15.8:0/3767989307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ce80ba3e0 0x7f0ce80c2130 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80c1ce0 tx=0x7f0cdc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd663a86afa6437 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:29.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.353+0000 7f0ce559a640 1 -- 172.21.15.8:0/3767989307 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0317e0 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.353+0000 7f0ce559a640 1 -- 172.21.15.8:0/3767989307 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc031940 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.353+0000 7f0ce559a640 1 -- 172.21.15.8:0/3767989307 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc031cd0 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.353+0000 7f0ce759e640 1 -- 172.21.15.8:0/3767989307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ce80ba3e0 msgr2=0x7f0ce80c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:29.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.353+0000 7f0ce759e640 1 --2- 172.21.15.8:0/3767989307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ce80ba3e0 0x7f0ce80c2130 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80c1ce0 tx=0x7f0cdc02b880 comp rx=0 tx=0).stop 2023-10-14T10:34:29.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.354+0000 7f0ce759e640 1 -- 172.21.15.8:0/3767989307 shutdown_connections 2023-10-14T10:34:29.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.354+0000 7f0ce759e640 1 --2- 172.21.15.8:0/3767989307 >> v2:172.21.15.92:3300/0 conn(0x7f0ce80c2670 0x7f0ce815b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.354+0000 7f0ce759e640 1 --2- 172.21.15.8:0/3767989307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ce80ba3e0 0x7f0ce80c2130 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.354+0000 7f0ce759e640 1 --2- 172.21.15.8:0/3767989307 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ce8155a80 0x7f0ce80719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.354+0000 7f0ce759e640 1 -- 172.21.15.8:0/3767989307 >> 172.21.15.8:0/3767989307 conn(0x7f0ce806a200 msgr2=0x7f0ce806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:29.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.354+0000 7f0ce759e640 1 -- 172.21.15.8:0/3767989307 shutdown_connections 2023-10-14T10:34:29.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.354+0000 7f0ce759e640 1 -- 172.21.15.8:0/3767989307 wait complete. 2023-10-14T10:34:29.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.356+0000 7f0ce759e640 1 Processor -- start 2023-10-14T10:34:29.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.356+0000 7f0ce759e640 1 -- start start 2023-10-14T10:34:29.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.357+0000 7f0ce759e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ce80ba3e0 0x7f0ce80a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ce80c2670 0x7f0ce8159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce759e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ce8155a80 0x7f0ce80a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce759e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce81ede20 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce759e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80a84a0 con 0x7f0ce80c2670 2023-10-14T10:34:29.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce759e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80a81c0 con 0x7f0ce8155a80 2023-10-14T10:34:29.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ce80ba3e0 0x7f0ce80a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:29.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ce80ba3e0 0x7f0ce80a8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60562/0 (socket says 172.21.15.8:60562) 2023-10-14T10:34:29.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce659c640 1 -- 172.21.15.8:0/1786629787 learned_addr learned my addr 172.21.15.8:0/1786629787 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:29.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce659c640 1 -- 172.21.15.8:0/1786629787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ce8155a80 msgr2=0x7f0ce80a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:29.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce659c640 1 --2- 172.21.15.8:0/1786629787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ce8155a80 0x7f0ce80a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce659c640 1 -- 172.21.15.8:0/1786629787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ce80c2670 msgr2=0x7f0ce8159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:29.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce659c640 1 --2- 172.21.15.8:0/1786629787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ce80c2670 0x7f0ce8159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.358+0000 7f0ce659c640 1 -- 172.21.15.8:0/1786629787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc0094d0 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.359+0000 7f0ce659c640 1 --2- 172.21.15.8:0/1786629787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ce80ba3e0 0x7f0ce80a8960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800c7f0 tx=0x7f0cd800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:29.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.359+0000 7f0cd6ffd640 1 -- 172.21.15.8:0/1786629787 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8004220 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.359+0000 7f0cd6ffd640 1 -- 172.21.15.8:0/1786629787 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd80043a0 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.359+0000 7f0cd6ffd640 1 -- 172.21.15.8:0/1786629787 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8007860 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.359+0000 7f0ce759e640 1 -- 172.21.15.8:0/1786629787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce80a9080 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.359+0000 7f0ce759e640 1 -- 172.21.15.8:0/1786629787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce81edab0 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.360+0000 7f0ce759e640 1 -- 172.21.15.8:0/1786629787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce80619f0 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.361+0000 7f0cd6ffd640 1 -- 172.21.15.8:0/1786629787 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0cd8007bd0 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.363+0000 7f0cd6ffd640 1 --2- 172.21.15.8:0/1786629787 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0cc806aea0 0x7f0cc806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.363+0000 7f0cd6ffd640 1 -- 172.21.15.8:0/1786629787 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cd80895f0 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.363+0000 7f0ce5d9b640 1 --2- 172.21.15.8:0/1786629787 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0cc806aea0 0x7f0cc806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:29.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.364+0000 7f0ce5d9b640 1 --2- 172.21.15.8:0/1786629787 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0cc806aea0 0x7f0cc806d360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc036000 tx=0x7f0cdc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:29.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.367+0000 7f0cd6ffd640 1 -- 172.21.15.8:0/1786629787 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0cd8054690 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.559+0000 7f0ce759e640 1 -- 172.21.15.8:0/1786629787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ce806b060 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.560+0000 7f0cd6ffd640 1 -- 172.21.15.8:0/1786629787 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0cd8057cb0 con 0x7f0ce80ba3e0 2023-10-14T10:34:29.562 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T10:34:29.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.563+0000 7f0ce759e640 1 -- 172.21.15.8:0/1786629787 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0cc806aea0 msgr2=0x7f0cc806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:29.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.563+0000 7f0ce759e640 1 --2- 172.21.15.8:0/1786629787 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0cc806aea0 0x7f0cc806d360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc036000 tx=0x7f0cdc030000 comp rx=0 tx=0).stop 2023-10-14T10:34:29.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.563+0000 7f0ce759e640 1 -- 172.21.15.8:0/1786629787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ce80ba3e0 msgr2=0x7f0ce80a8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:29.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.563+0000 7f0ce759e640 1 --2- 172.21.15.8:0/1786629787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ce80ba3e0 0x7f0ce80a8960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800c7f0 tx=0x7f0cd800ccb0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.563+0000 7f0ce759e640 1 -- 172.21.15.8:0/1786629787 shutdown_connections 2023-10-14T10:34:29.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.563+0000 7f0ce759e640 1 --2- 172.21.15.8:0/1786629787 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0cc806aea0 0x7f0cc806d360 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.563+0000 7f0ce759e640 1 --2- 172.21.15.8:0/1786629787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ce8155a80 0x7f0ce80a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.563+0000 7f0ce759e640 1 --2- 172.21.15.8:0/1786629787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ce80c2670 0x7f0ce8159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.563+0000 7f0ce759e640 1 --2- 172.21.15.8:0/1786629787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ce80ba3e0 0x7f0ce80a8960 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.563+0000 7f0ce759e640 1 -- 172.21.15.8:0/1786629787 >> 172.21.15.8:0/1786629787 conn(0x7f0ce806a200 msgr2=0x7f0ce80c5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.563+0000 7f0ce759e640 1 -- 172.21.15.8:0/1786629787 shutdown_connections 2023-10-14T10:34:29.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.563+0000 7f0ce759e640 1 -- 172.21.15.8:0/1786629787 wait complete. 2023-10-14T10:34:29.585 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T10:34:29.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.800+0000 7faa0ffff640 1 Processor -- start 2023-10-14T10:34:29.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.800+0000 7faa0ffff640 1 -- start start 2023-10-14T10:34:29.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.802+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa1013af90 0x7faa100a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.802+0000 7faa0ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faa1006fb10 0x7faa100c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.803+0000 7faa0ffff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa10152ac0 con 0x7faa100c2670 2023-10-14T10:34:29.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.803+0000 7faa0ffff640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa10151eb0 con 0x7faa1006fb10 2023-10-14T10:34:29.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.803+0000 7faa0ffff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa10152190 con 0x7faa1013af90 2023-10-14T10:34:29.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.803+0000 7faa07fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faa1006fb10 0x7faa100c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:29.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.803+0000 7faa0f7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7faa100c2670 0x7faa100bfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51566/0 (socket says 172.21.15.8:51566) 2023-10-14T10:34:29.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.803+0000 7faa0f7fe640 1 -- 172.21.15.8:0/1790141713 learned_addr learned my addr 172.21.15.8:0/1790141713 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:29.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.803+0000 7faa0effd640 1 --2- 172.21.15.8:0/1790141713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa1013af90 0x7faa100a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:29.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.803+0000 7faa07fff640 1 -- 172.21.15.8:0/1790141713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa1013af90 msgr2=0x7faa100a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:29.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.803+0000 7faa07fff640 1 --2- 172.21.15.8:0/1790141713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa1013af90 0x7faa100a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.803+0000 7faa07fff640 1 -- 172.21.15.8:0/1790141713 >> v1:172.21.15.8:6789/0 conn(0x7faa100c2670 legacy=0x7faa100bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:29.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.804+0000 7faa0e7fc640 1 -- 172.21.15.8:0/1790141713 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264618670 0 0) 0x7faa10152ac0 con 0x7faa100c2670 2023-10-14T10:34:29.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.804+0000 7faa07fff640 1 -- 172.21.15.8:0/1790141713 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa10152470 con 0x7faa1006fb10 2023-10-14T10:34:29.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.805+0000 7faa07fff640 1 --2- 172.21.15.8:0/1790141713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1006fb10 0x7faa100c2130 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80097a0 tx=0x7fa9f802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbc12078b976bcb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:29.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.805+0000 7faa0e7fc640 1 -- 172.21.15.8:0/1790141713 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8031780 con 0x7faa1006fb10 2023-10-14T10:34:29.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.805+0000 7faa0e7fc640 1 -- 172.21.15.8:0/1790141713 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f80318e0 con 0x7faa1006fb10 2023-10-14T10:34:29.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.805+0000 7faa0e7fc640 1 -- 172.21.15.8:0/1790141713 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8031c70 con 0x7faa1006fb10 2023-10-14T10:34:29.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.806+0000 7faa0ffff640 1 -- 172.21.15.8:0/1790141713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1006fb10 msgr2=0x7faa100c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:29.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.806+0000 7faa0ffff640 1 --2- 172.21.15.8:0/1790141713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1006fb10 0x7faa100c2130 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80097a0 tx=0x7fa9f802b820 comp rx=0 tx=0).stop 2023-10-14T10:34:29.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.806+0000 7faa0ffff640 1 -- 172.21.15.8:0/1790141713 shutdown_connections 2023-10-14T10:34:29.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.806+0000 7faa0ffff640 1 --2- 172.21.15.8:0/1790141713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1006fb10 0x7faa100c2130 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.806+0000 7faa0ffff640 1 --2- 172.21.15.8:0/1790141713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa1013af90 0x7faa100a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.806+0000 7faa0ffff640 1 -- 172.21.15.8:0/1790141713 >> 172.21.15.8:0/1790141713 conn(0x7faa1006a200 msgr2=0x7faa1006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:29.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.806+0000 7faa0ffff640 1 -- 172.21.15.8:0/1790141713 shutdown_connections 2023-10-14T10:34:29.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.806+0000 7faa0ffff640 1 -- 172.21.15.8:0/1790141713 wait complete. 2023-10-14T10:34:29.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.807+0000 7faa0ffff640 1 Processor -- start 2023-10-14T10:34:29.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.808+0000 7faa0ffff640 1 -- start start 2023-10-14T10:34:29.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.808+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa1006fb10 0x7faa100bec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.808+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa100c2670 0x7faa10138f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.808+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1013af90 0x7faa101e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.808+0000 7faa0ffff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1006d3f0 con 0x7faa1013af90 2023-10-14T10:34:29.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.808+0000 7faa0ffff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1006d740 con 0x7faa1006fb10 2023-10-14T10:34:29.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.808+0000 7faa0ffff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa101e8410 con 0x7faa100c2670 2023-10-14T10:34:29.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.809+0000 7faa0f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1013af90 0x7faa101e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:29.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.809+0000 7faa0f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1013af90 0x7faa101e4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60578/0 (socket says 172.21.15.8:60578) 2023-10-14T10:34:29.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.809+0000 7faa0f7fe640 1 -- 172.21.15.8:0/1152976343 learned_addr learned my addr 172.21.15.8:0/1152976343 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:29.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.809+0000 7faa07fff640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa100c2670 0x7faa10138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:29.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.809+0000 7faa0effd640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa1006fb10 0x7faa100bec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:29.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.809+0000 7faa0f7fe640 1 -- 172.21.15.8:0/1152976343 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa100c2670 msgr2=0x7faa10138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:29.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.809+0000 7faa0f7fe640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa100c2670 0x7faa10138f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.809+0000 7faa0f7fe640 1 -- 172.21.15.8:0/1152976343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa1006fb10 msgr2=0x7faa100bec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:29.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.809+0000 7faa0f7fe640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa1006fb10 0x7faa100bec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:29.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.809+0000 7faa0f7fe640 1 -- 172.21.15.8:0/1152976343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f8009400 con 0x7faa1013af90 2023-10-14T10:34:29.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.810+0000 7faa0f7fe640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1013af90 0x7faa101e4ea0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faa0800c7b0 tx=0x7faa0800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:29.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.810+0000 7faa0cff9640 1 -- 172.21.15.8:0/1152976343 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0800a640 con 0x7faa1013af90 2023-10-14T10:34:29.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.810+0000 7faa0cff9640 1 -- 172.21.15.8:0/1152976343 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0800a7c0 con 0x7faa1013af90 2023-10-14T10:34:29.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.810+0000 7faa0cff9640 1 -- 172.21.15.8:0/1152976343 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0800ab70 con 0x7faa1013af90 2023-10-14T10:34:29.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.810+0000 7faa0ffff640 1 -- 172.21.15.8:0/1152976343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa101e8cb0 con 0x7faa1013af90 2023-10-14T10:34:29.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.810+0000 7faa0ffff640 1 -- 172.21.15.8:0/1152976343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa101e8660 con 0x7faa1013af90 2023-10-14T10:34:29.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.811+0000 7faa0ffff640 1 -- 172.21.15.8:0/1152976343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa101e8e40 con 0x7faa1013af90 2023-10-14T10:34:29.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.812+0000 7faa0cff9640 1 -- 172.21.15.8:0/1152976343 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faa0800acd0 con 0x7faa1013af90 2023-10-14T10:34:29.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.813+0000 7faa0cff9640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa9f006ae70 0x7fa9f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:29.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.813+0000 7faa0cff9640 1 -- 172.21.15.8:0/1152976343 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa08088a70 con 0x7faa1013af90 2023-10-14T10:34:29.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.814+0000 7faa0effd640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa9f006ae70 0x7fa9f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:29.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.814+0000 7faa0effd640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa9f006ae70 0x7fa9f006d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa00006fd0 tx=0x7faa00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:29.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:29.818+0000 7faa0cff9640 1 -- 172.21.15.8:0/1152976343 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa08053b10 con 0x7faa1013af90 2023-10-14T10:34:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.010+0000 7faa0ffff640 1 -- 172.21.15.8:0/1152976343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faa100619f0 con 0x7faa1013af90 2023-10-14T10:34:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.010+0000 7faa0cff9640 1 -- 172.21.15.8:0/1152976343 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7faa08018020 con 0x7faa1013af90 2023-10-14T10:34:30.013 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T10:34:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.013+0000 7faa0ffff640 1 -- 172.21.15.8:0/1152976343 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa9f006ae70 msgr2=0x7fa9f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:30.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.013+0000 7faa0ffff640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa9f006ae70 0x7fa9f006d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa00006fd0 tx=0x7faa00008040 comp rx=0 tx=0).stop 2023-10-14T10:34:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.013+0000 7faa0ffff640 1 -- 172.21.15.8:0/1152976343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1013af90 msgr2=0x7faa101e4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:30.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.013+0000 7faa0ffff640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1013af90 0x7faa101e4ea0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faa0800c7b0 tx=0x7faa0800cc70 comp rx=0 tx=0).stop 2023-10-14T10:34:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.013+0000 7faa0ffff640 1 -- 172.21.15.8:0/1152976343 shutdown_connections 2023-10-14T10:34:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.013+0000 7faa0ffff640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa9f006ae70 0x7fa9f006d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.013+0000 7faa0ffff640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1013af90 0x7faa101e4ea0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.013+0000 7faa0ffff640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa100c2670 0x7faa10138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.013+0000 7faa0ffff640 1 --2- 172.21.15.8:0/1152976343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa1006fb10 0x7faa100bec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.013+0000 7faa0ffff640 1 -- 172.21.15.8:0/1152976343 >> 172.21.15.8:0/1152976343 conn(0x7faa1006a200 msgr2=0x7faa1006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:30.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.013+0000 7faa0ffff640 1 -- 172.21.15.8:0/1152976343 shutdown_connections 2023-10-14T10:34:30.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.013+0000 7faa0ffff640 1 -- 172.21.15.8:0/1152976343 wait complete. 2023-10-14T10:34:30.035 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T10:34:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.266+0000 7f5d8295e640 1 Processor -- start 2023-10-14T10:34:30.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.267+0000 7f5d8295e640 1 -- start start 2023-10-14T10:34:30.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.268+0000 7f5d8295e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d7c155440 0x7f5d7c071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:30.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.268+0000 7f5d8295e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5d7c0bfee0 0x7f5d7c152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:30.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.269+0000 7f5d8295e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7c0c57a0 con 0x7f5d7c14f3a0 2023-10-14T10:34:30.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.269+0000 7f5d8295e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7c06cee0 con 0x7f5d7c0bfee0 2023-10-14T10:34:30.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.269+0000 7f5d8295e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c151e50 con 0x7f5d7c155440 2023-10-14T10:34:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.269+0000 7f5d7b7fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d7c155440 0x7f5d7c071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.269+0000 7f5d7bfff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5d7c14f3a0 0x7f5d7c06d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:58512/0 (socket says 172.21.15.8:58512) 2023-10-14T10:34:30.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.269+0000 7f5d7bfff640 1 -- 172.21.15.8:0/828316896 learned_addr learned my addr 172.21.15.8:0/828316896 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:30.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.269+0000 7f5d80efb640 1 --2- 172.21.15.8:0/828316896 >> v2:172.21.15.92:3300/0 conn(0x7f5d7c0bfee0 0x7f5d7c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:30.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.270+0000 7f5d7affd640 1 -- 172.21.15.8:0/828316896 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711096105 0 0) 0x7f5d7c0c57a0 con 0x7f5d7c14f3a0 2023-10-14T10:34:30.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.270+0000 7f5d7affd640 1 -- 172.21.15.8:0/828316896 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d64003520 con 0x7f5d7c14f3a0 2023-10-14T10:34:30.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.270+0000 7f5d7b7fe640 1 -- 172.21.15.8:0/828316896 >> v2:172.21.15.92:3300/0 conn(0x7f5d7c0bfee0 msgr2=0x7f5d7c152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:30.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.270+0000 7f5d7b7fe640 1 --2- 172.21.15.8:0/828316896 >> v2:172.21.15.92:3300/0 conn(0x7f5d7c0bfee0 0x7f5d7c152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.270+0000 7f5d7b7fe640 1 -- 172.21.15.8:0/828316896 >> v1:172.21.15.92:6789/0 conn(0x7f5d7c14f3a0 legacy=0x7f5d7c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:30.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.270+0000 7f5d7b7fe640 1 -- 172.21.15.8:0/828316896 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c0c59f0 con 0x7f5d7c155440 2023-10-14T10:34:30.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.272+0000 7f5d7b7fe640 1 --2- 172.21.15.8:0/828316896 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d7c155440 0x7f5d7c071f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5d700097a0 tx=0x7f5d7002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a79d3cc1e98d8f33 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:30.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.272+0000 7f5d7affd640 1 -- 172.21.15.8:0/828316896 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70031780 con 0x7f5d7c155440 2023-10-14T10:34:30.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.272+0000 7f5d7affd640 1 -- 172.21.15.8:0/828316896 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d700318e0 con 0x7f5d7c155440 2023-10-14T10:34:30.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.272+0000 7f5d7affd640 1 -- 172.21.15.8:0/828316896 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70031c70 con 0x7f5d7c155440 2023-10-14T10:34:30.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.273+0000 7f5d8295e640 1 -- 172.21.15.8:0/828316896 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d7c155440 msgr2=0x7f5d7c071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:30.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.273+0000 7f5d8295e640 1 --2- 172.21.15.8:0/828316896 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d7c155440 0x7f5d7c071f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5d700097a0 tx=0x7f5d7002b820 comp rx=0 tx=0).stop 2023-10-14T10:34:30.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.273+0000 7f5d8295e640 1 -- 172.21.15.8:0/828316896 shutdown_connections 2023-10-14T10:34:30.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.273+0000 7f5d8295e640 1 --2- 172.21.15.8:0/828316896 >> v2:172.21.15.92:3300/0 conn(0x7f5d7c0bfee0 0x7f5d7c152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.273+0000 7f5d8295e640 1 --2- 172.21.15.8:0/828316896 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d7c155440 0x7f5d7c071f90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.273+0000 7f5d8295e640 1 -- 172.21.15.8:0/828316896 >> 172.21.15.8:0/828316896 conn(0x7f5d7c0a74d0 msgr2=0x7f5d7c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:30.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.273+0000 7f5d8295e640 1 -- 172.21.15.8:0/828316896 shutdown_connections 2023-10-14T10:34:30.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.273+0000 7f5d8295e640 1 -- 172.21.15.8:0/828316896 wait complete. 2023-10-14T10:34:30.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.275+0000 7f5d8295e640 1 Processor -- start 2023-10-14T10:34:30.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.275+0000 7f5d8295e640 1 -- start start 2023-10-14T10:34:30.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.276+0000 7f5d8295e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d7c0bfee0 0x7f5d7c0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:30.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.276+0000 7f5d8295e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d7c14f3a0 0x7f5d7c1471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:30.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.276+0000 7f5d8295e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d7c0c5050 0x7f5d7c1e9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:30.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.276+0000 7f5d8295e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c150e90 con 0x7f5d7c0c5050 2023-10-14T10:34:30.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.276+0000 7f5d8295e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c0a9f60 con 0x7f5d7c14f3a0 2023-10-14T10:34:30.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.276+0000 7f5d8295e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c150910 con 0x7f5d7c0bfee0 2023-10-14T10:34:30.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.277+0000 7f5d80efb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d7c0c5050 0x7f5d7c1e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:30.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.277+0000 7f5d80efb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d7c0c5050 0x7f5d7c1e9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60582/0 (socket says 172.21.15.8:60582) 2023-10-14T10:34:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.277+0000 7f5d80efb640 1 -- 172.21.15.8:0/2989800869 learned_addr learned my addr 172.21.15.8:0/2989800869 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.277+0000 7f5d7bfff640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d7c0bfee0 0x7f5d7c0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.277+0000 7f5d7b7fe640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d7c14f3a0 0x7f5d7c1471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.277+0000 7f5d80efb640 1 -- 172.21.15.8:0/2989800869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d7c0bfee0 msgr2=0x7f5d7c0c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:30.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.277+0000 7f5d80efb640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d7c0bfee0 0x7f5d7c0c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.277+0000 7f5d80efb640 1 -- 172.21.15.8:0/2989800869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d7c14f3a0 msgr2=0x7f5d7c1471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:30.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.277+0000 7f5d80efb640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d7c14f3a0 0x7f5d7c1471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.277+0000 7f5d80efb640 1 -- 172.21.15.8:0/2989800869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d70009400 con 0x7f5d7c0c5050 2023-10-14T10:34:30.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.278+0000 7f5d80efb640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d7c0c5050 0x7f5d7c1e9770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400efc0 tx=0x7f5d7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:30.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.278+0000 7f5d78ff9640 1 -- 172.21.15.8:0/2989800869 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74014480 con 0x7f5d7c0c5050 2023-10-14T10:34:30.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.278+0000 7f5d78ff9640 1 -- 172.21.15.8:0/2989800869 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7400f040 con 0x7f5d7c0c5050 2023-10-14T10:34:30.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.278+0000 7f5d78ff9640 1 -- 172.21.15.8:0/2989800869 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74014840 con 0x7f5d7c0c5050 2023-10-14T10:34:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.278+0000 7f5d8295e640 1 -- 172.21.15.8:0/2989800869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7c151770 con 0x7f5d7c0c5050 2023-10-14T10:34:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.278+0000 7f5d8295e640 1 -- 172.21.15.8:0/2989800869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7c151a10 con 0x7f5d7c0c5050 2023-10-14T10:34:30.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.279+0000 7f5d8295e640 1 -- 172.21.15.8:0/2989800869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7c0c11b0 con 0x7f5d7c0c5050 2023-10-14T10:34:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.280+0000 7f5d78ff9640 1 -- 172.21.15.8:0/2989800869 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5d740149a0 con 0x7f5d7c0c5050 2023-10-14T10:34:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.282+0000 7f5d78ff9640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5d6806ae70 0x7f5d6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.282+0000 7f5d78ff9640 1 -- 172.21.15.8:0/2989800869 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d7408a1e0 con 0x7f5d7c0c5050 2023-10-14T10:34:30.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.282+0000 7f5d7bfff640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5d6806ae70 0x7f5d6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:30.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.283+0000 7f5d7bfff640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5d6806ae70 0x7f5d6806d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0011e0 tx=0x7f5d6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:30.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.287+0000 7f5d78ff9640 1 -- 172.21.15.8:0/2989800869 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d74055280 con 0x7f5d7c0c5050 2023-10-14T10:34:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.495+0000 7f5d8295e640 1 -- 172.21.15.8:0/2989800869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5d7c151c00 con 0x7f5d7c0c5050 2023-10-14T10:34:30.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.496+0000 7f5d78ff9640 1 -- 172.21.15.8:0/2989800869 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5d740588a0 con 0x7f5d7c0c5050 2023-10-14T10:34:30.498 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2023-10-14T10:34:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.499+0000 7f5d8295e640 1 -- 172.21.15.8:0/2989800869 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5d6806ae70 msgr2=0x7f5d6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.499+0000 7f5d8295e640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5d6806ae70 0x7f5d6806d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0011e0 tx=0x7f5d6c009040 comp rx=0 tx=0).stop 2023-10-14T10:34:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.499+0000 7f5d8295e640 1 -- 172.21.15.8:0/2989800869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d7c0c5050 msgr2=0x7f5d7c1e9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.499+0000 7f5d8295e640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d7c0c5050 0x7f5d7c1e9770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400efc0 tx=0x7f5d7400c490 comp rx=0 tx=0).stop 2023-10-14T10:34:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.499+0000 7f5d8295e640 1 -- 172.21.15.8:0/2989800869 shutdown_connections 2023-10-14T10:34:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.499+0000 7f5d8295e640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5d6806ae70 0x7f5d6806d330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.499+0000 7f5d8295e640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d7c0c5050 0x7f5d7c1e9770 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.499+0000 7f5d8295e640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d7c14f3a0 0x7f5d7c1471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.499+0000 7f5d8295e640 1 --2- 172.21.15.8:0/2989800869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d7c0bfee0 0x7f5d7c0c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.499+0000 7f5d8295e640 1 -- 172.21.15.8:0/2989800869 >> 172.21.15.8:0/2989800869 conn(0x7f5d7c0a74d0 msgr2=0x7f5d7c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:30.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.499+0000 7f5d8295e640 1 -- 172.21.15.8:0/2989800869 shutdown_connections 2023-10-14T10:34:30.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.499+0000 7f5d8295e640 1 -- 172.21.15.8:0/2989800869 wait complete. 2023-10-14T10:34:30.519 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T10:34:30.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:30.520 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-14T10:34:30.630 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T10:34:30.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:34:30.630 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T10:34:30.694 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-10-14T10:34:30.694 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:34:30.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.926+0000 7f2ec551a640 1 Processor -- start 2023-10-14T10:34:30.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.926+0000 7f2ec551a640 1 -- start start 2023-10-14T10:34:30.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.927+0000 7f2ec551a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2ec0071b50 0x7f2ec00bd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:30.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.928+0000 7f2ec551a640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec0071410 con 0x7f2ec014a2f0 2023-10-14T10:34:30.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.928+0000 7f2ec551a640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec0071fe0 con 0x7f2ec00bdd60 2023-10-14T10:34:30.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.928+0000 7f2ec551a640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec0070800 con 0x7f2ec0071b50 2023-10-14T10:34:30.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.928+0000 7f2ebffff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2ec014a2f0 0x7f2ec0153990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51574/0 (socket says 172.21.15.8:51574) 2023-10-14T10:34:30.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.928+0000 7f2ebffff640 1 -- 172.21.15.8:0/3573393468 learned_addr learned my addr 172.21.15.8:0/3573393468 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:30.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.928+0000 7f2eb77fe640 1 --2- 172.21.15.8:0/3573393468 >> v2:172.21.15.8:3300/0 conn(0x7f2ec0071b50 0x7f2ec00bd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.928+0000 7f2eb77fe640 1 -- 172.21.15.8:0/3573393468 >> v1:172.21.15.92:6789/0 conn(0x7f2ec00bdd60 legacy=0x7f2ec015ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.928+0000 7f2eb77fe640 1 -- 172.21.15.8:0/3573393468 >> v1:172.21.15.8:6789/0 conn(0x7f2ec014a2f0 legacy=0x7f2ec0153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.928+0000 7f2eb77fe640 1 -- 172.21.15.8:0/3573393468 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0070ae0 con 0x7f2ec0071b50 2023-10-14T10:34:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.930+0000 7f2eb77fe640 1 --2- 172.21.15.8:0/3573393468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec0071b50 0x7f2ec00bd820 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80097a0 tx=0x7f2ea802dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2e2ede9d582498 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.930+0000 7f2ebf7fe640 1 -- 172.21.15.8:0/3573393468 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea802f8a0 con 0x7f2ec0071b50 2023-10-14T10:34:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.930+0000 7f2ebf7fe640 1 -- 172.21.15.8:0/3573393468 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea802fa00 con 0x7f2ec0071b50 2023-10-14T10:34:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.930+0000 7f2ebf7fe640 1 -- 172.21.15.8:0/3573393468 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea802fd90 con 0x7f2ec0071b50 2023-10-14T10:34:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.930+0000 7f2ec551a640 1 -- 172.21.15.8:0/3573393468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec0071b50 msgr2=0x7f2ec00bd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.930+0000 7f2ec551a640 1 --2- 172.21.15.8:0/3573393468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec0071b50 0x7f2ec00bd820 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80097a0 tx=0x7f2ea802dae0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.931+0000 7f2ec551a640 1 -- 172.21.15.8:0/3573393468 shutdown_connections 2023-10-14T10:34:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.931+0000 7f2ec551a640 1 --2- 172.21.15.8:0/3573393468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec0071b50 0x7f2ec00bd820 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.931+0000 7f2ec551a640 1 -- 172.21.15.8:0/3573393468 >> 172.21.15.8:0/3573393468 conn(0x7f2ec0069de0 msgr2=0x7f2ec006a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.931+0000 7f2ec551a640 1 -- 172.21.15.8:0/3573393468 shutdown_connections 2023-10-14T10:34:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.931+0000 7f2ec551a640 1 -- 172.21.15.8:0/3573393468 wait complete. 2023-10-14T10:34:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.932+0000 7f2ec551a640 1 Processor -- start 2023-10-14T10:34:30.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.933+0000 7f2ec551a640 1 -- start start 2023-10-14T10:34:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.934+0000 7f2ec551a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec0071b50 0x7f2ec00bab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.934+0000 7f2ec551a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ec00bdd60 0x7f2ec00bb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.934+0000 7f2ec551a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec014a2f0 0x7f2ec01ec940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.934+0000 7f2ec551a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec01516a0 con 0x7f2ec014a2f0 2023-10-14T10:34:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.934+0000 7f2ec551a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec00bb580 con 0x7f2ec0071b50 2023-10-14T10:34:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.934+0000 7f2ec551a640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec00a7580 con 0x7f2ec00bdd60 2023-10-14T10:34:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.934+0000 7f2ec4d19640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec014a2f0 0x7f2ec01ec940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.934+0000 7f2ec4d19640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec014a2f0 0x7f2ec01ec940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60598/0 (socket says 172.21.15.8:60598) 2023-10-14T10:34:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.934+0000 7f2ec4d19640 1 -- 172.21.15.8:0/4200691257 learned_addr learned my addr 172.21.15.8:0/4200691257 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.934+0000 7f2eb77fe640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ec00bdd60 0x7f2ec00bb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2ebffff640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec0071b50 0x7f2ec00bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2ec4d19640 1 -- 172.21.15.8:0/4200691257 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ec00bdd60 msgr2=0x7f2ec00bb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2ec4d19640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ec00bdd60 0x7f2ec00bb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2ec4d19640 1 -- 172.21.15.8:0/4200691257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec0071b50 msgr2=0x7f2ec00bab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2ec4d19640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec0071b50 0x7f2ec00bab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2ec4d19640 1 -- 172.21.15.8:0/4200691257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8009400 con 0x7f2ec014a2f0 2023-10-14T10:34:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2eb77fe640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ec00bdd60 0x7f2ec00bb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2ebffff640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec0071b50 0x7f2ec00bab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2ec4d19640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec014a2f0 0x7f2ec01ec940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800b410 tx=0x7f2eb800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2ebd7fa640 1 -- 172.21.15.8:0/4200691257 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8004020 con 0x7f2ec014a2f0 2023-10-14T10:34:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2ebd7fa640 1 -- 172.21.15.8:0/4200691257 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb8004180 con 0x7f2ec014a2f0 2023-10-14T10:34:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2ebd7fa640 1 -- 172.21.15.8:0/4200691257 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8011630 con 0x7f2ec014a2f0 2023-10-14T10:34:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.935+0000 7f2ec551a640 1 -- 172.21.15.8:0/4200691257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec00a7860 con 0x7f2ec014a2f0 2023-10-14T10:34:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.936+0000 7f2ec551a640 1 -- 172.21.15.8:0/4200691257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec0153230 con 0x7f2ec014a2f0 2023-10-14T10:34:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.937+0000 7f2ec551a640 1 -- 172.21.15.8:0/4200691257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec004e9b0 con 0x7f2ec014a2f0 2023-10-14T10:34:30.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.938+0000 7f2ebd7fa640 1 -- 172.21.15.8:0/4200691257 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2eb8011790 con 0x7f2ec014a2f0 2023-10-14T10:34:30.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.940+0000 7f2ebd7fa640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ea006ae70 0x7f2ea006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:30.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.940+0000 7f2ebd7fa640 1 -- 172.21.15.8:0/4200691257 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2eb8089360 con 0x7f2ec014a2f0 2023-10-14T10:34:30.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.940+0000 7f2ebffff640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ea006ae70 0x7f2ea006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:30.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.941+0000 7f2ebffff640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ea006ae70 0x7f2ea006d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00012e0 tx=0x7f2eb0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:30.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:30.945+0000 7f2ebd7fa640 1 -- 172.21.15.8:0/4200691257 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2eb8054370 con 0x7f2ec014a2f0 2023-10-14T10:34:31.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.172+0000 7f2ec551a640 1 -- 172.21.15.8:0/4200691257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ec006a5e0 con 0x7f2ec014a2f0 2023-10-14T10:34:31.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.173+0000 7f2ebd7fa640 1 -- 172.21.15.8:0/4200691257 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4898 (secure 0 0 0) 0x7f2eb8057990 con 0x7f2ec014a2f0 2023-10-14T10:34:31.176 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:31.176 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3003490368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3003490368},{"type":"v1","addr":"172.21.15.92:6834","nonce":3003490368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3352501671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":3352501671},{"type":"v1","addr":"172.21.15.92:6835","nonce":3352501671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4157669185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4157669185},{"type":"v1","addr":"172.21.15.8:6837","nonce":4157669185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:33:47.398252+0000","modified":"2023-10-14T10:33:50.442698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6835/524862170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":524862170},{"type":"v1","addr":"172.21.15.8:6835","nonce":524862170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T10:34:31.176 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T10:34:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.176+0000 7f2ec551a640 1 -- 172.21.15.8:0/4200691257 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ea006ae70 msgr2=0x7f2ea006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.176+0000 7f2ec551a640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ea006ae70 0x7f2ea006d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00012e0 tx=0x7f2eb0009040 comp rx=0 tx=0).stop 2023-10-14T10:34:31.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.176+0000 7f2ec551a640 1 -- 172.21.15.8:0/4200691257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec014a2f0 msgr2=0x7f2ec01ec940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:31.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.176+0000 7f2ec551a640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec014a2f0 0x7f2ec01ec940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800b410 tx=0x7f2eb800b8d0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.176+0000 7f2ec551a640 1 -- 172.21.15.8:0/4200691257 shutdown_connections 2023-10-14T10:34:31.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.176+0000 7f2ec551a640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2ea006ae70 0x7f2ea006d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.176+0000 7f2ec551a640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ec014a2f0 0x7f2ec01ec940 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.176+0000 7f2ec551a640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ec00bdd60 0x7f2ec00bb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.176+0000 7f2ec551a640 1 --2- 172.21.15.8:0/4200691257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec0071b50 0x7f2ec00bab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.176+0000 7f2ec551a640 1 -- 172.21.15.8:0/4200691257 >> 172.21.15.8:0/4200691257 conn(0x7f2ec0069de0 msgr2=0x7f2ec006d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:31.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.176+0000 7f2ec551a640 1 -- 172.21.15.8:0/4200691257 shutdown_connections 2023-10-14T10:34:31.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.176+0000 7f2ec551a640 1 -- 172.21.15.8:0/4200691257 wait complete. 2023-10-14T10:34:31.198 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:31.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.421+0000 7feb98bf4640 1 Processor -- start 2023-10-14T10:34:31.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.421+0000 7feb98bf4640 1 -- start start 2023-10-14T10:34:31.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.423+0000 7feb98bf4640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feb94071550 0x7feb94070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.423+0000 7feb98bf4640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb940c06f0 0x7feb941511a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.423+0000 7feb98bf4640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940719e0 con 0x7feb940c2380 2023-10-14T10:34:31.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.423+0000 7feb98bf4640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb94071190 con 0x7feb94071550 2023-10-14T10:34:31.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.423+0000 7feb98bf4640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb94071cc0 con 0x7feb940c06f0 2023-10-14T10:34:31.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.423+0000 7feb92ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feb94071550 0x7feb94070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.423+0000 7feb92ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feb94071550 0x7feb94070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60604/0 (socket says 172.21.15.8:60604) 2023-10-14T10:34:31.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.423+0000 7feb92ffd640 1 -- 172.21.15.8:0/107702823 learned_addr learned my addr 172.21.15.8:0/107702823 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:31.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.424+0000 7feb93fff640 1 --2- 172.21.15.8:0/107702823 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb940c06f0 0x7feb941511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.424+0000 7feb92ffd640 1 -- 172.21.15.8:0/107702823 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb940c06f0 msgr2=0x7feb941511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:31.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.424+0000 7feb92ffd640 1 --2- 172.21.15.8:0/107702823 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb940c06f0 0x7feb941511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.424+0000 7feb92ffd640 1 -- 172.21.15.8:0/107702823 >> v1:172.21.15.8:6789/0 conn(0x7feb940c2380 legacy=0x7feb940a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:31.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.424+0000 7feb92ffd640 1 -- 172.21.15.8:0/107702823 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb94071fa0 con 0x7feb94071550 2023-10-14T10:34:31.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.425+0000 7feb92ffd640 1 --2- 172.21.15.8:0/107702823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb94071550 0x7feb94070c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feb88009870 tx=0x7feb8802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28da02eb5edbfe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:31.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.425+0000 7feb927fc640 1 -- 172.21.15.8:0/107702823 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88030840 con 0x7feb94071550 2023-10-14T10:34:31.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.425+0000 7feb927fc640 1 -- 172.21.15.8:0/107702823 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880309a0 con 0x7feb94071550 2023-10-14T10:34:31.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.425+0000 7feb927fc640 1 -- 172.21.15.8:0/107702823 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88030d30 con 0x7feb94071550 2023-10-14T10:34:31.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.426+0000 7feb98bf4640 1 -- 172.21.15.8:0/107702823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb94071550 msgr2=0x7feb94070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:31.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.426+0000 7feb98bf4640 1 --2- 172.21.15.8:0/107702823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb94071550 0x7feb94070c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feb88009870 tx=0x7feb8802b980 comp rx=0 tx=0).stop 2023-10-14T10:34:31.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.426+0000 7feb98bf4640 1 -- 172.21.15.8:0/107702823 shutdown_connections 2023-10-14T10:34:31.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.426+0000 7feb98bf4640 1 --2- 172.21.15.8:0/107702823 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb940c06f0 0x7feb941511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.426+0000 7feb98bf4640 1 --2- 172.21.15.8:0/107702823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb94071550 0x7feb94070c50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.426+0000 7feb98bf4640 1 -- 172.21.15.8:0/107702823 >> 172.21.15.8:0/107702823 conn(0x7feb9406a200 msgr2=0x7feb9406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:31.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.426+0000 7feb98bf4640 1 -- 172.21.15.8:0/107702823 shutdown_connections 2023-10-14T10:34:31.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.426+0000 7feb98bf4640 1 -- 172.21.15.8:0/107702823 wait complete. 2023-10-14T10:34:31.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.427+0000 7feb98bf4640 1 Processor -- start 2023-10-14T10:34:31.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.428+0000 7feb98bf4640 1 -- start start 2023-10-14T10:34:31.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.428+0000 7feb98bf4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb940c06f0 0x7feb941e98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.428+0000 7feb98bf4640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb940c2380 0x7feb9406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.428+0000 7feb98bf4640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940c3c70 0x7feb94157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.428+0000 7feb98bf4640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb941508a0 con 0x7feb940c3c70 2023-10-14T10:34:31.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.428+0000 7feb98bf4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb94158430 con 0x7feb940c06f0 2023-10-14T10:34:31.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.428+0000 7feb98bf4640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb940c4480 con 0x7feb940c2380 2023-10-14T10:34:31.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.429+0000 7feb93fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940c3c70 0x7feb94157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.429+0000 7feb93fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940c3c70 0x7feb94157260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60608/0 (socket says 172.21.15.8:60608) 2023-10-14T10:34:31.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.429+0000 7feb93fff640 1 -- 172.21.15.8:0/1590421468 learned_addr learned my addr 172.21.15.8:0/1590421468 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:31.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.429+0000 7feb92ffd640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb940c2380 0x7feb9406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.429+0000 7feb937fe640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb940c06f0 0x7feb941e98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.429+0000 7feb93fff640 1 -- 172.21.15.8:0/1590421468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb940c2380 msgr2=0x7feb9406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:31.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.429+0000 7feb93fff640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb940c2380 0x7feb9406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.429+0000 7feb93fff640 1 -- 172.21.15.8:0/1590421468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb940c06f0 msgr2=0x7feb941e98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:31.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.429+0000 7feb93fff640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb940c06f0 0x7feb941e98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.429+0000 7feb93fff640 1 -- 172.21.15.8:0/1590421468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880094d0 con 0x7feb940c3c70 2023-10-14T10:34:31.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.429+0000 7feb92ffd640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb940c2380 0x7feb9406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:31.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.430+0000 7feb93fff640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940c3c70 0x7feb94157260 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00cc30 tx=0x7feb8c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:31.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.430+0000 7feb7bfff640 1 -- 172.21.15.8:0/1590421468 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c00ce40 con 0x7feb940c3c70 2023-10-14T10:34:31.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.430+0000 7feb7bfff640 1 -- 172.21.15.8:0/1590421468 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c003990 con 0x7feb940c3c70 2023-10-14T10:34:31.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.430+0000 7feb7bfff640 1 -- 172.21.15.8:0/1590421468 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c003d20 con 0x7feb940c3c70 2023-10-14T10:34:31.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.430+0000 7feb98bf4640 1 -- 172.21.15.8:0/1590421468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb941e9de0 con 0x7feb940c3c70 2023-10-14T10:34:31.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.430+0000 7feb98bf4640 1 -- 172.21.15.8:0/1590421468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb940c49a0 con 0x7feb940c3c70 2023-10-14T10:34:31.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.431+0000 7feb98bf4640 1 -- 172.21.15.8:0/1590421468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb940c4800 con 0x7feb940c3c70 2023-10-14T10:34:31.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.432+0000 7feb7bfff640 1 -- 172.21.15.8:0/1590421468 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feb8c003e80 con 0x7feb940c3c70 2023-10-14T10:34:31.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.433+0000 7feb7bfff640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7feb8006ae70 0x7feb8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.433+0000 7feb7bfff640 1 -- 172.21.15.8:0/1590421468 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb8c089820 con 0x7feb940c3c70 2023-10-14T10:34:31.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.434+0000 7feb937fe640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7feb8006ae70 0x7feb8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.434+0000 7feb937fe640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7feb8006ae70 0x7feb8006d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feb84000f60 tx=0x7feb84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:31.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.438+0000 7feb7bfff640 1 -- 172.21.15.8:0/1590421468 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb940c4800 con 0x7feb940c3c70 2023-10-14T10:34:31.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.628+0000 7feb98bf4640 1 -- 172.21.15.8:0/1590421468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb9406b6e0 con 0x7feb940c3c70 2023-10-14T10:34:31.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.630+0000 7feb7bfff640 1 -- 172.21.15.8:0/1590421468 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16373 (secure 0 0 0) 0x7feb9406b6e0 con 0x7feb940c3c70 2023-10-14T10:34:31.632 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:31.633 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:33:48.448544+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:31.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.632+0000 7feb98bf4640 1 -- 172.21.15.8:0/1590421468 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7feb8006ae70 msgr2=0x7feb8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:31.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.632+0000 7feb98bf4640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7feb8006ae70 0x7feb8006d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feb84000f60 tx=0x7feb84009040 comp rx=0 tx=0).stop 2023-10-14T10:34:31.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.632+0000 7feb98bf4640 1 -- 172.21.15.8:0/1590421468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940c3c70 msgr2=0x7feb94157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:31.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.632+0000 7feb98bf4640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940c3c70 0x7feb94157260 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00cc30 tx=0x7feb8c00a5c0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.633+0000 7feb98bf4640 1 -- 172.21.15.8:0/1590421468 shutdown_connections 2023-10-14T10:34:31.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.633+0000 7feb98bf4640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7feb8006ae70 0x7feb8006d330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.633+0000 7feb98bf4640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb940c3c70 0x7feb94157260 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.633+0000 7feb98bf4640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb940c2380 0x7feb9406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.633+0000 7feb98bf4640 1 --2- 172.21.15.8:0/1590421468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb940c06f0 0x7feb941e98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.633+0000 7feb98bf4640 1 -- 172.21.15.8:0/1590421468 >> 172.21.15.8:0/1590421468 conn(0x7feb9406a200 msgr2=0x7feb940bfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:31.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.633+0000 7feb98bf4640 1 -- 172.21.15.8:0/1590421468 shutdown_connections 2023-10-14T10:34:31.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.633+0000 7feb98bf4640 1 -- 172.21.15.8:0/1590421468 wait complete. 2023-10-14T10:34:31.654 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T10:33:44.913451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T10:33:46.397320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:34:31.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:34:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.882+0000 7f58f9f39640 1 Processor -- start 2023-10-14T10:34:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.882+0000 7f58f9f39640 1 -- start start 2023-10-14T10:34:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.884+0000 7f58f9f39640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f58f4155b00 0x7f58f40c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.884+0000 7f58f9f39640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f58f406d9c0 0x7f58f4158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.884+0000 7f58f9f39640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58f40c1470 0x7f58f40bab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.884+0000 7f58f9f39640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f40bbdf0 con 0x7f58f406d9c0 2023-10-14T10:34:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.884+0000 7f58f9f39640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f406de50 con 0x7f58f4155b00 2023-10-14T10:34:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.884+0000 7f58f9f39640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f4159520 con 0x7f58f40c1470 2023-10-14T10:34:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.884+0000 7f58ebfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f58f406d9c0 0x7f58f4158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.884+0000 7f58ebfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f58f406d9c0 0x7f58f4158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60624/0 (socket says 172.21.15.8:60624) 2023-10-14T10:34:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.884+0000 7f58ebfff640 1 -- 172.21.15.8:0/72588180 learned_addr learned my addr 172.21.15.8:0/72588180 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.884+0000 7f58f37fe640 1 --2- 172.21.15.8:0/72588180 >> v2:172.21.15.92:3300/0 conn(0x7f58f4155b00 0x7f58f40c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.884+0000 7f58f3fff640 1 --2- 172.21.15.8:0/72588180 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58f40c1470 0x7f58f40bab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.885+0000 7f58ebfff640 1 -- 172.21.15.8:0/72588180 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58f40c1470 msgr2=0x7f58f40bab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.885+0000 7f58ebfff640 1 --2- 172.21.15.8:0/72588180 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58f40c1470 0x7f58f40bab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.885+0000 7f58ebfff640 1 -- 172.21.15.8:0/72588180 >> v2:172.21.15.92:3300/0 conn(0x7f58f4155b00 msgr2=0x7f58f40c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.885+0000 7f58ebfff640 1 --2- 172.21.15.8:0/72588180 >> v2:172.21.15.92:3300/0 conn(0x7f58f4155b00 0x7f58f40c06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.885+0000 7f58ebfff640 1 -- 172.21.15.8:0/72588180 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f406d530 con 0x7f58f406d9c0 2023-10-14T10:34:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.886+0000 7f58ebfff640 1 --2- 172.21.15.8:0/72588180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58f406d9c0 0x7f58f4158fe0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f58f40c2f30 tx=0x7f58dc02b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f285b13e868b0d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.886+0000 7f58f2ffd640 1 -- 172.21.15.8:0/72588180 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc030850 con 0x7f58f406d9c0 2023-10-14T10:34:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.886+0000 7f58f2ffd640 1 -- 172.21.15.8:0/72588180 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc0309b0 con 0x7f58f406d9c0 2023-10-14T10:34:31.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.886+0000 7f58f2ffd640 1 -- 172.21.15.8:0/72588180 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc030d40 con 0x7f58f406d9c0 2023-10-14T10:34:31.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.887+0000 7f58f9f39640 1 -- 172.21.15.8:0/72588180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58f406d9c0 msgr2=0x7f58f4158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:31.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.887+0000 7f58f9f39640 1 --2- 172.21.15.8:0/72588180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58f406d9c0 0x7f58f4158fe0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f58f40c2f30 tx=0x7f58dc02b990 comp rx=0 tx=0).stop 2023-10-14T10:34:31.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.887+0000 7f58f9f39640 1 -- 172.21.15.8:0/72588180 shutdown_connections 2023-10-14T10:34:31.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.887+0000 7f58f9f39640 1 --2- 172.21.15.8:0/72588180 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58f40c1470 0x7f58f40bab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.887+0000 7f58f9f39640 1 --2- 172.21.15.8:0/72588180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58f406d9c0 0x7f58f4158fe0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.887+0000 7f58f9f39640 1 --2- 172.21.15.8:0/72588180 >> v2:172.21.15.92:3300/0 conn(0x7f58f4155b00 0x7f58f40c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.887+0000 7f58f9f39640 1 -- 172.21.15.8:0/72588180 >> 172.21.15.8:0/72588180 conn(0x7f58f4069de0 msgr2=0x7f58f406a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:31.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.887+0000 7f58f9f39640 1 -- 172.21.15.8:0/72588180 shutdown_connections 2023-10-14T10:34:31.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.887+0000 7f58f9f39640 1 -- 172.21.15.8:0/72588180 wait complete. 2023-10-14T10:34:31.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.889+0000 7f58f9f39640 1 Processor -- start 2023-10-14T10:34:31.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.889+0000 7f58f9f39640 1 -- start start 2023-10-14T10:34:31.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.890+0000 7f58f9f39640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58f406d9c0 0x7f58f41538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.890+0000 7f58f9f39640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58f40c1470 0x7f58f415c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.890+0000 7f58f9f39640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58f4155b00 0x7f58f41ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.890+0000 7f58f9f39640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40c5300 con 0x7f58f40c1470 2023-10-14T10:34:31.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.890+0000 7f58f9f39640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40c55e0 con 0x7f58f406d9c0 2023-10-14T10:34:31.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.890+0000 7f58f9f39640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40c58c0 con 0x7f58f4155b00 2023-10-14T10:34:31.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.890+0000 7f58ebfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58f40c1470 0x7f58f415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.890+0000 7f58ebfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58f40c1470 0x7f58f415c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60640/0 (socket says 172.21.15.8:60640) 2023-10-14T10:34:31.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.890+0000 7f58ebfff640 1 -- 172.21.15.8:0/1276915342 learned_addr learned my addr 172.21.15.8:0/1276915342 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:31.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.891+0000 7f58f37fe640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58f406d9c0 0x7f58f41538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.891+0000 7f58f3fff640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58f4155b00 0x7f58f41ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.891+0000 7f58ebfff640 1 -- 172.21.15.8:0/1276915342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58f4155b00 msgr2=0x7f58f41ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:31.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.891+0000 7f58ebfff640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58f4155b00 0x7f58f41ed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.891+0000 7f58ebfff640 1 -- 172.21.15.8:0/1276915342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58f406d9c0 msgr2=0x7f58f41538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:31.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.891+0000 7f58ebfff640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58f406d9c0 0x7f58f41538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:31.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.891+0000 7f58ebfff640 1 -- 172.21.15.8:0/1276915342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc0094d0 con 0x7f58f40c1470 2023-10-14T10:34:31.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.891+0000 7f58f37fe640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58f406d9c0 0x7f58f41538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:31.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.891+0000 7f58ebfff640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58f40c1470 0x7f58f415c030 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f58dc000c00 tx=0x7f58dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:31.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.892+0000 7f58f0ff9640 1 -- 172.21.15.8:0/1276915342 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc039c90 con 0x7f58f40c1470 2023-10-14T10:34:31.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.892+0000 7f58f0ff9640 1 -- 172.21.15.8:0/1276915342 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc039df0 con 0x7f58f40c1470 2023-10-14T10:34:31.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.892+0000 7f58f0ff9640 1 -- 172.21.15.8:0/1276915342 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc043620 con 0x7f58f40c1470 2023-10-14T10:34:31.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.892+0000 7f58f9f39640 1 -- 172.21.15.8:0/1276915342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f40c5ba0 con 0x7f58f40c1470 2023-10-14T10:34:31.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.892+0000 7f58f9f39640 1 -- 172.21.15.8:0/1276915342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f4153df0 con 0x7f58f40c1470 2023-10-14T10:34:31.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.893+0000 7f58f9f39640 1 -- 172.21.15.8:0/1276915342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f40c0470 con 0x7f58f40c1470 2023-10-14T10:34:31.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.894+0000 7f58f0ff9640 1 -- 172.21.15.8:0/1276915342 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f58dc02e070 con 0x7f58f40c1470 2023-10-14T10:34:31.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.895+0000 7f58f0ff9640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f58d406ae70 0x7f58d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:31.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.896+0000 7f58f0ff9640 1 -- 172.21.15.8:0/1276915342 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58dc03e070 con 0x7f58f40c1470 2023-10-14T10:34:31.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.896+0000 7f58f37fe640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f58d406ae70 0x7f58d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:31.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.896+0000 7f58f37fe640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f58d406ae70 0x7f58d406d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009a70 tx=0x7f58e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:31.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:31.900+0000 7f58f0ff9640 1 -- 172.21.15.8:0/1276915342 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58dc077620 con 0x7f58f40c1470 2023-10-14T10:34:32.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.095+0000 7f58f9f39640 1 -- 172.21.15.8:0/1276915342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58f40c60c0 con 0x7f58f40c1470 2023-10-14T10:34:32.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.096+0000 7f58f0ff9640 1 -- 172.21.15.8:0/1276915342 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58f40c60c0 con 0x7f58f40c1470 2023-10-14T10:34:32.098 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:34:32.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.099+0000 7f58f9f39640 1 -- 172.21.15.8:0/1276915342 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f58d406ae70 msgr2=0x7f58d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:32.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.099+0000 7f58f9f39640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f58d406ae70 0x7f58d406d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009a70 tx=0x7f58e4008040 comp rx=0 tx=0).stop 2023-10-14T10:34:32.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.099+0000 7f58f9f39640 1 -- 172.21.15.8:0/1276915342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58f40c1470 msgr2=0x7f58f415c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:32.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.099+0000 7f58f9f39640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58f40c1470 0x7f58f415c030 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f58dc000c00 tx=0x7f58dc004730 comp rx=0 tx=0).stop 2023-10-14T10:34:32.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.099+0000 7f58f9f39640 1 -- 172.21.15.8:0/1276915342 shutdown_connections 2023-10-14T10:34:32.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.099+0000 7f58f9f39640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f58d406ae70 0x7f58d406d330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.099+0000 7f58f9f39640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58f4155b00 0x7f58f41ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.099+0000 7f58f9f39640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58f40c1470 0x7f58f415c030 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.099+0000 7f58f9f39640 1 --2- 172.21.15.8:0/1276915342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58f406d9c0 0x7f58f41538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.099+0000 7f58f9f39640 1 -- 172.21.15.8:0/1276915342 >> 172.21.15.8:0/1276915342 conn(0x7f58f4069de0 msgr2=0x7f58f406a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:32.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.099+0000 7f58f9f39640 1 -- 172.21.15.8:0/1276915342 shutdown_connections 2023-10-14T10:34:32.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.099+0000 7f58f9f39640 1 -- 172.21.15.8:0/1276915342 wait complete. 2023-10-14T10:34:32.121 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T10:34:32.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.348+0000 7fe231ac3640 1 Processor -- start 2023-10-14T10:34:32.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.348+0000 7fe231ac3640 1 -- start start 2023-10-14T10:34:32.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.350+0000 7fe231ac3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe22c13af90 0x7fe22c0a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:32.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.350+0000 7fe231ac3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe22c06fb10 0x7fe22c0c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:32.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.350+0000 7fe231ac3640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c152ac0 con 0x7fe22c0c2670 2023-10-14T10:34:32.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.350+0000 7fe231ac3640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c151eb0 con 0x7fe22c13af90 2023-10-14T10:34:32.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.350+0000 7fe231ac3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c152190 con 0x7fe22c06fb10 2023-10-14T10:34:32.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.350+0000 7fe230ac1640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe22c13af90 0x7fe22c0a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:32.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.350+0000 7fe230ac1640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe22c13af90 0x7fe22c0a81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60646/0 (socket says 172.21.15.8:60646) 2023-10-14T10:34:32.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.350+0000 7fe230ac1640 1 -- 172.21.15.8:0/1503684873 learned_addr learned my addr 172.21.15.8:0/1503684873 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:32.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.350+0000 7fe22bfff640 1 --2- 172.21.15.8:0/1503684873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe22c06fb10 0x7fe22c0c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:32.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.351+0000 7fe230ac1640 1 -- 172.21.15.8:0/1503684873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe22c06fb10 msgr2=0x7fe22c0c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:32.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.351+0000 7fe230ac1640 1 --2- 172.21.15.8:0/1503684873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe22c06fb10 0x7fe22c0c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.351+0000 7fe230ac1640 1 -- 172.21.15.8:0/1503684873 >> v1:172.21.15.8:6789/0 conn(0x7fe22c0c2670 legacy=0x7fe22c0bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:32.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.351+0000 7fe230ac1640 1 -- 172.21.15.8:0/1503684873 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c152470 con 0x7fe22c13af90 2023-10-14T10:34:32.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.351+0000 7fe22bfff640 1 --2- 172.21.15.8:0/1503684873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe22c06fb10 0x7fe22c0c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:32.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.352+0000 7fe230ac1640 1 --2- 172.21.15.8:0/1503684873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13af90 0x7fe22c0a81e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe220009870 tx=0x7fe22002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d84ab5dcc42987 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:32.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.352+0000 7fe22b7fe640 1 -- 172.21.15.8:0/1503684873 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220031640 con 0x7fe22c13af90 2023-10-14T10:34:32.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.352+0000 7fe22b7fe640 1 -- 172.21.15.8:0/1503684873 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2200317a0 con 0x7fe22c13af90 2023-10-14T10:34:32.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.352+0000 7fe22b7fe640 1 -- 172.21.15.8:0/1503684873 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220031b30 con 0x7fe22c13af90 2023-10-14T10:34:32.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.353+0000 7fe231ac3640 1 -- 172.21.15.8:0/1503684873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13af90 msgr2=0x7fe22c0a81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:32.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.353+0000 7fe231ac3640 1 --2- 172.21.15.8:0/1503684873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13af90 0x7fe22c0a81e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe220009870 tx=0x7fe22002b8f0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.353+0000 7fe231ac3640 1 -- 172.21.15.8:0/1503684873 shutdown_connections 2023-10-14T10:34:32.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.353+0000 7fe231ac3640 1 --2- 172.21.15.8:0/1503684873 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe22c06fb10 0x7fe22c0c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.353+0000 7fe231ac3640 1 --2- 172.21.15.8:0/1503684873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13af90 0x7fe22c0a81e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.353+0000 7fe231ac3640 1 -- 172.21.15.8:0/1503684873 >> 172.21.15.8:0/1503684873 conn(0x7fe22c06a200 msgr2=0x7fe22c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:32.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.353+0000 7fe231ac3640 1 -- 172.21.15.8:0/1503684873 shutdown_connections 2023-10-14T10:34:32.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.353+0000 7fe231ac3640 1 -- 172.21.15.8:0/1503684873 wait complete. 2023-10-14T10:34:32.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.355+0000 7fe231ac3640 1 Processor -- start 2023-10-14T10:34:32.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.355+0000 7fe231ac3640 1 -- start start 2023-10-14T10:34:32.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.356+0000 7fe231ac3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe22c06fb10 0x7fe22c1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:32.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.356+0000 7fe231ac3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe22c0c2670 0x7fe22c133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:32.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.356+0000 7fe231ac3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13af90 0x7fe22c134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:32.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.356+0000 7fe231ac3640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c06d1b0 con 0x7fe22c13af90 2023-10-14T10:34:32.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.356+0000 7fe231ac3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c070fb0 con 0x7fe22c06fb10 2023-10-14T10:34:32.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.356+0000 7fe231ac3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c06bd20 con 0x7fe22c0c2670 2023-10-14T10:34:32.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.356+0000 7fe2312c2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13af90 0x7fe22c134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:32.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.356+0000 7fe2312c2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13af90 0x7fe22c134180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60658/0 (socket says 172.21.15.8:60658) 2023-10-14T10:34:32.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.356+0000 7fe2312c2640 1 -- 172.21.15.8:0/3074663963 learned_addr learned my addr 172.21.15.8:0/3074663963 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:32.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.356+0000 7fe230ac1640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe22c06fb10 0x7fe22c1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:32.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.357+0000 7fe22bfff640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe22c0c2670 0x7fe22c133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:32.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.357+0000 7fe2312c2640 1 -- 172.21.15.8:0/3074663963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe22c0c2670 msgr2=0x7fe22c133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:32.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.357+0000 7fe2312c2640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe22c0c2670 0x7fe22c133c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.357+0000 7fe2312c2640 1 -- 172.21.15.8:0/3074663963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe22c06fb10 msgr2=0x7fe22c1512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:32.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.357+0000 7fe2312c2640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe22c06fb10 0x7fe22c1512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.357+0000 7fe2312c2640 1 -- 172.21.15.8:0/3074663963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2200094d0 con 0x7fe22c13af90 2023-10-14T10:34:32.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.357+0000 7fe2312c2640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13af90 0x7fe22c134180 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe22400c7d0 tx=0x7fe22400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:32.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.357+0000 7fe2297fa640 1 -- 172.21.15.8:0/3074663963 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224003b70 con 0x7fe22c13af90 2023-10-14T10:34:32.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.357+0000 7fe2297fa640 1 -- 172.21.15.8:0/3074663963 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe224003cf0 con 0x7fe22c13af90 2023-10-14T10:34:32.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.357+0000 7fe2297fa640 1 -- 172.21.15.8:0/3074663963 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22400aa90 con 0x7fe22c13af90 2023-10-14T10:34:32.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.357+0000 7fe231ac3640 1 -- 172.21.15.8:0/3074663963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c06c2d0 con 0x7fe22c13af90 2023-10-14T10:34:32.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.358+0000 7fe231ac3640 1 -- 172.21.15.8:0/3074663963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c06c890 con 0x7fe22c13af90 2023-10-14T10:34:32.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.359+0000 7fe231ac3640 1 -- 172.21.15.8:0/3074663963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c06c130 con 0x7fe22c13af90 2023-10-14T10:34:32.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.360+0000 7fe2297fa640 1 -- 172.21.15.8:0/3074663963 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe22400abf0 con 0x7fe22c13af90 2023-10-14T10:34:32.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.361+0000 7fe2297fa640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe21006ae70 0x7fe21006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:32.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.362+0000 7fe2297fa640 1 -- 172.21.15.8:0/3074663963 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2240894f0 con 0x7fe22c13af90 2023-10-14T10:34:32.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.362+0000 7fe230ac1640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe21006ae70 0x7fe21006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:32.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.362+0000 7fe230ac1640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe21006ae70 0x7fe21006d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe220036000 tx=0x7fe22003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:32.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.366+0000 7fe2297fa640 1 -- 172.21.15.8:0/3074663963 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe22c06c130 con 0x7fe22c13af90 2023-10-14T10:34:32.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.564+0000 7fe231ac3640 1 -- 172.21.15.8:0/3074663963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe22c06c130 con 0x7fe22c13af90 2023-10-14T10:34:32.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.565+0000 7fe2297fa640 1 -- 172.21.15.8:0/3074663963 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe224003e60 con 0x7fe22c13af90 2023-10-14T10:34:32.567 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T10:34:32.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.567+0000 7fe231ac3640 1 -- 172.21.15.8:0/3074663963 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe21006ae70 msgr2=0x7fe21006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.567+0000 7fe231ac3640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe21006ae70 0x7fe21006d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe220036000 tx=0x7fe22003c040 comp rx=0 tx=0).stop 2023-10-14T10:34:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.567+0000 7fe231ac3640 1 -- 172.21.15.8:0/3074663963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13af90 msgr2=0x7fe22c134180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:32.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.567+0000 7fe231ac3640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13af90 0x7fe22c134180 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe22400c7d0 tx=0x7fe22400cc90 comp rx=0 tx=0).stop 2023-10-14T10:34:32.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.568+0000 7fe231ac3640 1 -- 172.21.15.8:0/3074663963 shutdown_connections 2023-10-14T10:34:32.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.568+0000 7fe231ac3640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe21006ae70 0x7fe21006d330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.568+0000 7fe231ac3640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13af90 0x7fe22c134180 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.568+0000 7fe231ac3640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe22c0c2670 0x7fe22c133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.568+0000 7fe231ac3640 1 --2- 172.21.15.8:0/3074663963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe22c06fb10 0x7fe22c1512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.568+0000 7fe231ac3640 1 -- 172.21.15.8:0/3074663963 >> 172.21.15.8:0/3074663963 conn(0x7fe22c06a200 msgr2=0x7fe22c137560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:32.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.568+0000 7fe231ac3640 1 -- 172.21.15.8:0/3074663963 shutdown_connections 2023-10-14T10:34:32.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.568+0000 7fe231ac3640 1 -- 172.21.15.8:0/3074663963 wait complete. 2023-10-14T10:34:32.588 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T10:34:32.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.818+0000 7f7840a75640 1 Processor -- start 2023-10-14T10:34:32.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.818+0000 7f7840a75640 1 -- start start 2023-10-14T10:34:32.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.820+0000 7f7840a75640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f783c151680 0x7f783c0c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:32.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.820+0000 7f7840a75640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f783c0c1f30 0x7f783c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:32.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.820+0000 7f7840a75640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783c157450 con 0x7f783c0702f0 2023-10-14T10:34:32.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.820+0000 7f7840a75640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f783c1582b0 con 0x7f783c0c1f30 2023-10-14T10:34:32.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.820+0000 7f7840a75640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783c1576a0 con 0x7f783c151680 2023-10-14T10:34:32.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.820+0000 7f783affd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f783c0c1f30 0x7f783c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:32.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.820+0000 7f783affd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f783c0c1f30 0x7f783c06fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60664/0 (socket says 172.21.15.8:60664) 2023-10-14T10:34:32.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.820+0000 7f783affd640 1 -- 172.21.15.8:0/147156332 learned_addr learned my addr 172.21.15.8:0/147156332 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:32.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.821+0000 7f783b7fe640 1 --2- 172.21.15.8:0/147156332 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f783c151680 0x7f783c0c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:32.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.821+0000 7f783affd640 1 -- 172.21.15.8:0/147156332 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f783c151680 msgr2=0x7f783c0c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:32.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.821+0000 7f783affd640 1 --2- 172.21.15.8:0/147156332 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f783c151680 0x7f783c0c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.821+0000 7f783affd640 1 -- 172.21.15.8:0/147156332 >> v1:172.21.15.92:6789/0 conn(0x7f783c0702f0 legacy=0x7f783c06ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:32.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.821+0000 7f783affd640 1 -- 172.21.15.8:0/147156332 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c157980 con 0x7f783c0c1f30 2023-10-14T10:34:32.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.822+0000 7f783affd640 1 --2- 172.21.15.8:0/147156332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c0c1f30 0x7f783c06fdb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7830009870 tx=0x7f783002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32ed59f82ddc7b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:32.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.822+0000 7f783a7fc640 1 -- 172.21.15.8:0/147156332 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830031640 con 0x7f783c0c1f30 2023-10-14T10:34:32.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.823+0000 7f783a7fc640 1 -- 172.21.15.8:0/147156332 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78300317a0 con 0x7f783c0c1f30 2023-10-14T10:34:32.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.823+0000 7f783a7fc640 1 -- 172.21.15.8:0/147156332 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830031b30 con 0x7f783c0c1f30 2023-10-14T10:34:32.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.823+0000 7f7840a75640 1 -- 172.21.15.8:0/147156332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c0c1f30 msgr2=0x7f783c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:32.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.823+0000 7f7840a75640 1 --2- 172.21.15.8:0/147156332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c0c1f30 0x7f783c06fdb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7830009870 tx=0x7f783002b8f0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.823+0000 7f7840a75640 1 -- 172.21.15.8:0/147156332 shutdown_connections 2023-10-14T10:34:32.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.823+0000 7f7840a75640 1 --2- 172.21.15.8:0/147156332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c0c1f30 0x7f783c06fdb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.823+0000 7f7840a75640 1 --2- 172.21.15.8:0/147156332 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f783c151680 0x7f783c0c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.823+0000 7f7840a75640 1 -- 172.21.15.8:0/147156332 >> 172.21.15.8:0/147156332 conn(0x7f783c0660e0 msgr2=0x7f783c0a9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:32.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.824+0000 7f7840a75640 1 -- 172.21.15.8:0/147156332 shutdown_connections 2023-10-14T10:34:32.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.824+0000 7f7840a75640 1 -- 172.21.15.8:0/147156332 wait complete. 2023-10-14T10:34:32.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.825+0000 7f7840a75640 1 Processor -- start 2023-10-14T10:34:32.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.825+0000 7f7840a75640 1 -- start start 2023-10-14T10:34:32.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.826+0000 7f7840a75640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c0702f0 0x7f783c0a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:32.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.826+0000 7f7840a75640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f783c0c1f30 0x7f783c0a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:32.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.826+0000 7f7840a75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f783c151680 0x7f783c0a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:32.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.826+0000 7f7840a75640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c0c0e70 con 0x7f783c0702f0 2023-10-14T10:34:32.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.826+0000 7f7840a75640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c1ed900 con 0x7f783c151680 2023-10-14T10:34:32.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.826+0000 7f7840a75640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783c0a6430 con 0x7f783c0c1f30 2023-10-14T10:34:32.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.827+0000 7f783b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c0702f0 0x7f783c0a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:32.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.827+0000 7f783b7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c0702f0 0x7f783c0a8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60666/0 (socket says 172.21.15.8:60666) 2023-10-14T10:34:32.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.827+0000 7f783b7fe640 1 -- 172.21.15.8:0/161973460 learned_addr learned my addr 172.21.15.8:0/161973460 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:32.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.827+0000 7f783affd640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f783c0c1f30 0x7f783c0a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:32.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.827+0000 7f783b7fe640 1 -- 172.21.15.8:0/161973460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f783c0c1f30 msgr2=0x7f783c0a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:32.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.827+0000 7f783b7fe640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f783c0c1f30 0x7f783c0a59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.827+0000 7f783b7fe640 1 -- 172.21.15.8:0/161973460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f783c151680 msgr2=0x7f783c0a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:32.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.827+0000 7f783b7fe640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f783c151680 0x7f783c0a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:32.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.827+0000 7f783b7fe640 1 -- 172.21.15.8:0/161973460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78300094d0 con 0x7f783c0702f0 2023-10-14T10:34:32.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.827+0000 7f783affd640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f783c0c1f30 0x7f783c0a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:32.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.828+0000 7f783b7fe640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c0702f0 0x7f783c0a8ce0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f782c00d5f0 tx=0x7f782c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:32.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.828+0000 7f7823fff640 1 -- 172.21.15.8:0/161973460 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c0125f0 con 0x7f783c0702f0 2023-10-14T10:34:32.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.828+0000 7f7823fff640 1 -- 172.21.15.8:0/161973460 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c012750 con 0x7f783c0702f0 2023-10-14T10:34:32.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.828+0000 7f7823fff640 1 -- 172.21.15.8:0/161973460 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c012b00 con 0x7f783c0702f0 2023-10-14T10:34:32.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.828+0000 7f7840a75640 1 -- 172.21.15.8:0/161973460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783c0c5280 con 0x7f783c0702f0 2023-10-14T10:34:32.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.828+0000 7f7840a75640 1 -- 172.21.15.8:0/161973460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783c0c1380 con 0x7f783c0702f0 2023-10-14T10:34:32.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.829+0000 7f7840a75640 1 -- 172.21.15.8:0/161973460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783c0ab610 con 0x7f783c0702f0 2023-10-14T10:34:32.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.830+0000 7f7823fff640 1 -- 172.21.15.8:0/161973460 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f782c012c60 con 0x7f783c0702f0 2023-10-14T10:34:32.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.831+0000 7f7823fff640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f782806aec0 0x7f782806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:32.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.831+0000 7f7823fff640 1 -- 172.21.15.8:0/161973460 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f782c089a70 con 0x7f783c0702f0 2023-10-14T10:34:32.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.832+0000 7f783affd640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f782806aec0 0x7f782806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:32.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.832+0000 7f783affd640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f782806aec0 0x7f782806d380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7830036000 tx=0x7f783003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:32.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:32.836+0000 7f7823fff640 1 -- 172.21.15.8:0/161973460 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f782c054b90 con 0x7f783c0702f0 2023-10-14T10:34:33.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.033+0000 7f7840a75640 1 -- 172.21.15.8:0/161973460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f783c0619f0 con 0x7f783c0702f0 2023-10-14T10:34:33.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.034+0000 7f7823fff640 1 -- 172.21.15.8:0/161973460 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f782c0581b0 con 0x7f783c0702f0 2023-10-14T10:34:33.036 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T10:34:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.037+0000 7f7840a75640 1 -- 172.21.15.8:0/161973460 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f782806aec0 msgr2=0x7f782806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.037+0000 7f7840a75640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f782806aec0 0x7f782806d380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7830036000 tx=0x7f783003c040 comp rx=0 tx=0).stop 2023-10-14T10:34:33.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.037+0000 7f7840a75640 1 -- 172.21.15.8:0/161973460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c0702f0 msgr2=0x7f783c0a8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:33.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.037+0000 7f7840a75640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c0702f0 0x7f783c0a8ce0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f782c00d5f0 tx=0x7f782c00dab0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.037+0000 7f7840a75640 1 -- 172.21.15.8:0/161973460 shutdown_connections 2023-10-14T10:34:33.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.037+0000 7f7840a75640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f782806aec0 0x7f782806d380 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.037+0000 7f7840a75640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f783c151680 0x7f783c0a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.037+0000 7f7840a75640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f783c0c1f30 0x7f783c0a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.037+0000 7f7840a75640 1 --2- 172.21.15.8:0/161973460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f783c0702f0 0x7f783c0a8ce0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.037+0000 7f7840a75640 1 -- 172.21.15.8:0/161973460 >> 172.21.15.8:0/161973460 conn(0x7f783c0660e0 msgr2=0x7f783c06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:33.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.037+0000 7f7840a75640 1 -- 172.21.15.8:0/161973460 shutdown_connections 2023-10-14T10:34:33.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.037+0000 7f7840a75640 1 -- 172.21.15.8:0/161973460 wait complete. 2023-10-14T10:34:33.059 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:34:33.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.281+0000 7f8dc494d640 1 Processor -- start 2023-10-14T10:34:33.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.281+0000 7f8dc494d640 1 -- start start 2023-10-14T10:34:33.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.282+0000 7f8dc494d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8dc01514c0 0x7f8dc006b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:33.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.282+0000 7f8dc494d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8dc0154840 0x7f8dc00c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:33.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.282+0000 7f8dc494d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc01543b0 con 0x7f8dc00c50f0 2023-10-14T10:34:33.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.282+0000 7f8dc494d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc006c3c0 con 0x7f8dc01514c0 2023-10-14T10:34:33.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.282+0000 7f8dc494d640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc0153e30 con 0x7f8dc0154840 2023-10-14T10:34:33.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.283+0000 7f8dbed9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8dc01514c0 0x7f8dc006b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:33.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.283+0000 7f8dbed9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8dc01514c0 0x7f8dc006b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60670/0 (socket says 172.21.15.8:60670) 2023-10-14T10:34:33.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.283+0000 7f8dbed9d640 1 -- 172.21.15.8:0/3171226712 learned_addr learned my addr 172.21.15.8:0/3171226712 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:33.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.283+0000 7f8dbf59e640 1 --2- 172.21.15.8:0/3171226712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8dc0154840 0x7f8dc00c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:33.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.283+0000 7f8dbed9d640 1 -- 172.21.15.8:0/3171226712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8dc0154840 msgr2=0x7f8dc00c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:33.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.283+0000 7f8dbed9d640 1 --2- 172.21.15.8:0/3171226712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8dc0154840 0x7f8dc00c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.283+0000 7f8dbed9d640 1 -- 172.21.15.8:0/3171226712 >> v1:172.21.15.8:6789/0 conn(0x7f8dc00c50f0 legacy=0x7f8dc00c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:33.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.283+0000 7f8dbed9d640 1 -- 172.21.15.8:0/3171226712 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc01518a0 con 0x7f8dc01514c0 2023-10-14T10:34:33.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.284+0000 7f8dbed9d640 1 --2- 172.21.15.8:0/3171226712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8dc01514c0 0x7f8dc006b5d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009870 tx=0x7f8db002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7303ff59cad49c3d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:33.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.285+0000 7f8dbe59c640 1 -- 172.21.15.8:0/3171226712 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0031640 con 0x7f8dc01514c0 2023-10-14T10:34:33.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.285+0000 7f8dbe59c640 1 -- 172.21.15.8:0/3171226712 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db00317a0 con 0x7f8dc01514c0 2023-10-14T10:34:33.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.285+0000 7f8dbe59c640 1 -- 172.21.15.8:0/3171226712 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0031b30 con 0x7f8dc01514c0 2023-10-14T10:34:33.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.285+0000 7f8dc494d640 1 -- 172.21.15.8:0/3171226712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8dc01514c0 msgr2=0x7f8dc006b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:33.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.285+0000 7f8dc494d640 1 --2- 172.21.15.8:0/3171226712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8dc01514c0 0x7f8dc006b5d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009870 tx=0x7f8db002b8f0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.286+0000 7f8dc494d640 1 -- 172.21.15.8:0/3171226712 shutdown_connections 2023-10-14T10:34:33.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.286+0000 7f8dc494d640 1 --2- 172.21.15.8:0/3171226712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8dc0154840 0x7f8dc00c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.286+0000 7f8dc494d640 1 --2- 172.21.15.8:0/3171226712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8dc01514c0 0x7f8dc006b5d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.286+0000 7f8dc494d640 1 -- 172.21.15.8:0/3171226712 >> 172.21.15.8:0/3171226712 conn(0x7f8dc00c60b0 msgr2=0x7f8dc00c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:33.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.286+0000 7f8dc494d640 1 -- 172.21.15.8:0/3171226712 shutdown_connections 2023-10-14T10:34:33.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.286+0000 7f8dc494d640 1 -- 172.21.15.8:0/3171226712 wait complete. 2023-10-14T10:34:33.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.287+0000 7f8dc494d640 1 Processor -- start 2023-10-14T10:34:33.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.288+0000 7f8dc494d640 1 -- start start 2023-10-14T10:34:33.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.288+0000 7f8dc494d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8dc00c50f0 0x7f8dc00bfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:33.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.288+0000 7f8dc494d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8dc01514c0 0x7f8dc00c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:33.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.289+0000 7f8dc494d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8dc0154840 0x7f8dc014bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:33.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.289+0000 7f8dc494d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc01ed100 con 0x7f8dc01514c0 2023-10-14T10:34:33.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.289+0000 7f8dc494d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc01edc80 con 0x7f8dc00c50f0 2023-10-14T10:34:33.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.289+0000 7f8dc494d640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc01ed350 con 0x7f8dc0154840 2023-10-14T10:34:33.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.289+0000 7f8db659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8dc01514c0 0x7f8dc00c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:33.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.289+0000 7f8db659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8dc01514c0 0x7f8dc00c1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60680/0 (socket says 172.21.15.8:60680) 2023-10-14T10:34:33.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.289+0000 7f8db659c640 1 -- 172.21.15.8:0/2496658700 learned_addr learned my addr 172.21.15.8:0/2496658700 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:33.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.289+0000 7f8db659c640 1 -- 172.21.15.8:0/2496658700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8dc0154840 msgr2=0x7f8dc014bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:33.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.289+0000 7f8db659c640 1 --2- 172.21.15.8:0/2496658700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8dc0154840 0x7f8dc014bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.289+0000 7f8db659c640 1 -- 172.21.15.8:0/2496658700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8dc00c50f0 msgr2=0x7f8dc00bfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:33.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.289+0000 7f8db659c640 1 --2- 172.21.15.8:0/2496658700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8dc00c50f0 0x7f8dc00bfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.289+0000 7f8db659c640 1 -- 172.21.15.8:0/2496658700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00094d0 con 0x7f8dc01514c0 2023-10-14T10:34:33.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.290+0000 7f8db659c640 1 --2- 172.21.15.8:0/2496658700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8dc01514c0 0x7f8dc00c1eb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8da800c8a0 tx=0x7f8da800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:33.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.290+0000 7f8db7fff640 1 -- 172.21.15.8:0/2496658700 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8003b70 con 0x7f8dc01514c0 2023-10-14T10:34:33.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.290+0000 7f8db7fff640 1 -- 172.21.15.8:0/2496658700 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da8003cf0 con 0x7f8dc01514c0 2023-10-14T10:34:33.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.290+0000 7f8db7fff640 1 -- 172.21.15.8:0/2496658700 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da800aa30 con 0x7f8dc01514c0 2023-10-14T10:34:33.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.290+0000 7f8dc494d640 1 -- 172.21.15.8:0/2496658700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc01ed630 con 0x7f8dc01514c0 2023-10-14T10:34:33.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.290+0000 7f8dc494d640 1 -- 172.21.15.8:0/2496658700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc014b7d0 con 0x7f8dc01514c0 2023-10-14T10:34:33.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.291+0000 7f8dc494d640 1 -- 172.21.15.8:0/2496658700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc004e9b0 con 0x7f8dc01514c0 2023-10-14T10:34:33.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.292+0000 7f8db7fff640 1 -- 172.21.15.8:0/2496658700 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8da800ab90 con 0x7f8dc01514c0 2023-10-14T10:34:33.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.293+0000 7f8db7fff640 1 --2- 172.21.15.8:0/2496658700 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8da006ae70 0x7f8da006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:33.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.293+0000 7f8db7fff640 1 -- 172.21.15.8:0/2496658700 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8da80895a0 con 0x7f8dc01514c0 2023-10-14T10:34:33.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.293+0000 7f8dbed9d640 1 --2- 172.21.15.8:0/2496658700 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8da006ae70 0x7f8da006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:33.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.294+0000 7f8dbed9d640 1 --2- 172.21.15.8:0/2496658700 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8da006ae70 0x7f8da006d330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8db0036000 tx=0x7f8db0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:33.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.298+0000 7f8db7fff640 1 -- 172.21.15.8:0/2496658700 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8da80546f0 con 0x7f8dc01514c0 2023-10-14T10:34:33.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.530+0000 7f8dc494d640 1 -- 172.21.15.8:0/2496658700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dc01eddc0 con 0x7f8dc01514c0 2023-10-14T10:34:33.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.531+0000 7f8db7fff640 1 -- 172.21.15.8:0/2496658700 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4898 (secure 0 0 0) 0x7f8da8003e60 con 0x7f8dc01514c0 2023-10-14T10:34:33.533 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:33.533 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3003490368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3003490368},{"type":"v1","addr":"172.21.15.92:6834","nonce":3003490368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3352501671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":3352501671},{"type":"v1","addr":"172.21.15.92:6835","nonce":3352501671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4157669185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4157669185},{"type":"v1","addr":"172.21.15.8:6837","nonce":4157669185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:33:47.398252+0000","modified":"2023-10-14T10:33:50.442698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6835/524862170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":524862170},{"type":"v1","addr":"172.21.15.8:6835","nonce":524862170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T10:34:33.534 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T10:34:33.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.533+0000 7f8dc494d640 1 -- 172.21.15.8:0/2496658700 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8da006ae70 msgr2=0x7f8da006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:33.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.533+0000 7f8dc494d640 1 --2- 172.21.15.8:0/2496658700 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8da006ae70 0x7f8da006d330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8db0036000 tx=0x7f8db0030000 comp rx=0 tx=0).stop 2023-10-14T10:34:33.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.533+0000 7f8dc494d640 1 -- 172.21.15.8:0/2496658700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8dc01514c0 msgr2=0x7f8dc00c1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:33.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.533+0000 7f8dc494d640 1 --2- 172.21.15.8:0/2496658700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8dc01514c0 0x7f8dc00c1eb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8da800c8a0 tx=0x7f8da800cd60 comp rx=0 tx=0).stop 2023-10-14T10:34:33.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.534+0000 7f8dc494d640 1 -- 172.21.15.8:0/2496658700 shutdown_connections 2023-10-14T10:34:33.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.534+0000 7f8dc494d640 1 --2- 172.21.15.8:0/2496658700 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8da006ae70 0x7f8da006d330 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.534+0000 7f8dc494d640 1 --2- 172.21.15.8:0/2496658700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8dc0154840 0x7f8dc014bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.534+0000 7f8dc494d640 1 --2- 172.21.15.8:0/2496658700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8dc01514c0 0x7f8dc00c1eb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.534+0000 7f8dc494d640 1 --2- 172.21.15.8:0/2496658700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8dc00c50f0 0x7f8dc00bfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.534+0000 7f8dc494d640 1 -- 172.21.15.8:0/2496658700 >> 172.21.15.8:0/2496658700 conn(0x7f8dc00c60b0 msgr2=0x7f8dc00c32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:33.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.534+0000 7f8dc494d640 1 -- 172.21.15.8:0/2496658700 shutdown_connections 2023-10-14T10:34:33.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.534+0000 7f8dc494d640 1 -- 172.21.15.8:0/2496658700 wait complete. 2023-10-14T10:34:33.556 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:33.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.780+0000 7ff122a75640 1 Processor -- start 2023-10-14T10:34:33.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.781+0000 7ff122a75640 1 -- start start 2023-10-14T10:34:33.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.782+0000 7ff122a75640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff11c14e640 0x7ff11c154d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:33.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.782+0000 7ff122a75640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11c1552d0 con 0x7ff11c0c1720 2023-10-14T10:34:33.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.782+0000 7ff122a75640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11c0c1cc0 con 0x7ff11c0a84d0 2023-10-14T10:34:33.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.782+0000 7ff122a75640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11c06cce0 con 0x7ff11c14e640 2023-10-14T10:34:33.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.783+0000 7ff120811640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff11c14e640 0x7ff11c154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:33.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.783+0000 7ff120811640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff11c14e640 0x7ff11c154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60684/0 (socket says 172.21.15.8:60684) 2023-10-14T10:34:33.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.783+0000 7ff120811640 1 -- 172.21.15.8:0/1038558897 learned_addr learned my addr 172.21.15.8:0/1038558897 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:33.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.783+0000 7ff120811640 1 -- 172.21.15.8:0/1038558897 >> v1:172.21.15.92:6789/0 conn(0x7ff11c0a84d0 legacy=0x7ff11c0a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:33.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.783+0000 7ff120811640 1 -- 172.21.15.8:0/1038558897 >> v1:172.21.15.8:6789/0 conn(0x7ff11c0c1720 legacy=0x7ff11c0c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:33.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.783+0000 7ff120811640 1 -- 172.21.15.8:0/1038558897 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c06cfc0 con 0x7ff11c14e640 2023-10-14T10:34:33.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.784+0000 7ff120811640 1 --2- 172.21.15.8:0/1038558897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11c14e640 0x7ff11c154d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009870 tx=0x7ff10c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd0b5c2a157b294 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:33.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.785+0000 7ff11b7fe640 1 -- 172.21.15.8:0/1038558897 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c030860 con 0x7ff11c14e640 2023-10-14T10:34:33.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.785+0000 7ff11b7fe640 1 -- 172.21.15.8:0/1038558897 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c0309c0 con 0x7ff11c14e640 2023-10-14T10:34:33.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.785+0000 7ff11b7fe640 1 -- 172.21.15.8:0/1038558897 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c030d50 con 0x7ff11c14e640 2023-10-14T10:34:33.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.785+0000 7ff122a75640 1 -- 172.21.15.8:0/1038558897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11c14e640 msgr2=0x7ff11c154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:33.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.785+0000 7ff122a75640 1 --2- 172.21.15.8:0/1038558897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11c14e640 0x7ff11c154d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009870 tx=0x7ff10c02b9a0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.786+0000 7ff122a75640 1 -- 172.21.15.8:0/1038558897 shutdown_connections 2023-10-14T10:34:33.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.786+0000 7ff122a75640 1 --2- 172.21.15.8:0/1038558897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11c14e640 0x7ff11c154d90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.786+0000 7ff122a75640 1 -- 172.21.15.8:0/1038558897 >> 172.21.15.8:0/1038558897 conn(0x7ff11c0a74d0 msgr2=0x7ff11c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:33.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.786+0000 7ff122a75640 1 -- 172.21.15.8:0/1038558897 shutdown_connections 2023-10-14T10:34:33.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.786+0000 7ff122a75640 1 -- 172.21.15.8:0/1038558897 wait complete. 2023-10-14T10:34:33.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.787+0000 7ff122a75640 1 Processor -- start 2023-10-14T10:34:33.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.788+0000 7ff122a75640 1 -- start start 2023-10-14T10:34:33.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.788+0000 7ff122a75640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11c0a84d0 0x7ff11c153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:33.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff122a75640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff11c0c1720 0x7ff11c1ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:33.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff122a75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff11c14e640 0x7ff11c0c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:33.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff122a75640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0be8e0 con 0x7ff11c0a84d0 2023-10-14T10:34:33.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff122a75640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0bf4e0 con 0x7ff11c14e640 2023-10-14T10:34:33.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff122a75640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c1ecbf0 con 0x7ff11c0c1720 2023-10-14T10:34:33.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff120811640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11c0a84d0 0x7ff11c153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:33.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff120811640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11c0a84d0 0x7ff11c153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60690/0 (socket says 172.21.15.8:60690) 2023-10-14T10:34:33.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff120811640 1 -- 172.21.15.8:0/2594539747 learned_addr learned my addr 172.21.15.8:0/2594539747 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:33.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff120811640 1 -- 172.21.15.8:0/2594539747 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff11c0c1720 msgr2=0x7ff11c1ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:33.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff120811640 1 --2- 172.21.15.8:0/2594539747 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff11c0c1720 0x7ff11c1ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff120811640 1 -- 172.21.15.8:0/2594539747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff11c14e640 msgr2=0x7ff11c0c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:33.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff120811640 1 --2- 172.21.15.8:0/2594539747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff11c14e640 0x7ff11c0c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:33.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.789+0000 7ff120811640 1 -- 172.21.15.8:0/2594539747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c0094d0 con 0x7ff11c0a84d0 2023-10-14T10:34:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.790+0000 7ff120811640 1 --2- 172.21.15.8:0/2594539747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11c0a84d0 0x7ff11c153f70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009870 tx=0x7ff10c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:33.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.790+0000 7ff1197fa640 1 -- 172.21.15.8:0/2594539747 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c030810 con 0x7ff11c0a84d0 2023-10-14T10:34:33.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.790+0000 7ff1197fa640 1 -- 172.21.15.8:0/2594539747 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c043400 con 0x7ff11c0a84d0 2023-10-14T10:34:33.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.790+0000 7ff1197fa640 1 -- 172.21.15.8:0/2594539747 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0437b0 con 0x7ff11c0a84d0 2023-10-14T10:34:33.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.790+0000 7ff122a75640 1 -- 172.21.15.8:0/2594539747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11c1ed910 con 0x7ff11c0a84d0 2023-10-14T10:34:33.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.790+0000 7ff122a75640 1 -- 172.21.15.8:0/2594539747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11c0bfa60 con 0x7ff11c0a84d0 2023-10-14T10:34:33.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.792+0000 7ff122a75640 1 -- 172.21.15.8:0/2594539747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11c073b50 con 0x7ff11c0a84d0 2023-10-14T10:34:33.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.792+0000 7ff1197fa640 1 -- 172.21.15.8:0/2594539747 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff10c043910 con 0x7ff11c0a84d0 2023-10-14T10:34:33.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.793+0000 7ff1197fa640 1 --2- 172.21.15.8:0/2594539747 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff10806ae70 0x7ff10806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:33.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.794+0000 7ff1197fa640 1 -- 172.21.15.8:0/2594539747 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff10c03e070 con 0x7ff11c0a84d0 2023-10-14T10:34:33.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.794+0000 7ff11bfff640 1 --2- 172.21.15.8:0/2594539747 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff10806ae70 0x7ff10806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:33.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.794+0000 7ff11bfff640 1 --2- 172.21.15.8:0/2594539747 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff10806ae70 0x7ff10806d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0aa180 tx=0x7ff110007cd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:33.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.798+0000 7ff1197fa640 1 -- 172.21.15.8:0/2594539747 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff10c077b70 con 0x7ff11c0a84d0 2023-10-14T10:34:33.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.995+0000 7ff122a75640 1 -- 172.21.15.8:0/2594539747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff11c0c0730 con 0x7ff11c0a84d0 2023-10-14T10:34:33.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:33.997+0000 7ff1197fa640 1 -- 172.21.15.8:0/2594539747 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16621 (secure 0 0 0) 0x7ff10c034090 con 0x7ff11c0a84d0 2023-10-14T10:34:34.000 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:34.001 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":22,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:34:33.598870+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:34.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.000+0000 7ff122a75640 1 -- 172.21.15.8:0/2594539747 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff10806ae70 msgr2=0x7ff10806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:34.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.000+0000 7ff122a75640 1 --2- 172.21.15.8:0/2594539747 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff10806ae70 0x7ff10806d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0aa180 tx=0x7ff110007cd0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.000+0000 7ff122a75640 1 -- 172.21.15.8:0/2594539747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11c0a84d0 msgr2=0x7ff11c153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:34.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.000+0000 7ff122a75640 1 --2- 172.21.15.8:0/2594539747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11c0a84d0 0x7ff11c153f70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009870 tx=0x7ff10c004730 comp rx=0 tx=0).stop 2023-10-14T10:34:34.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.000+0000 7ff122a75640 1 -- 172.21.15.8:0/2594539747 shutdown_connections 2023-10-14T10:34:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.000+0000 7ff122a75640 1 --2- 172.21.15.8:0/2594539747 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff10806ae70 0x7ff10806d330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.000+0000 7ff122a75640 1 --2- 172.21.15.8:0/2594539747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff11c14e640 0x7ff11c0c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.000+0000 7ff122a75640 1 --2- 172.21.15.8:0/2594539747 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff11c0c1720 0x7ff11c1ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.000+0000 7ff122a75640 1 --2- 172.21.15.8:0/2594539747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff11c0a84d0 0x7ff11c153f70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.000+0000 7ff122a75640 1 -- 172.21.15.8:0/2594539747 >> 172.21.15.8:0/2594539747 conn(0x7ff11c0a74d0 msgr2=0x7ff11c073430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:34.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.001+0000 7ff122a75640 1 -- 172.21.15.8:0/2594539747 shutdown_connections 2023-10-14T10:34:34.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.001+0000 7ff122a75640 1 -- 172.21.15.8:0/2594539747 wait complete. 2023-10-14T10:34:34.020 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T10:34:34.021 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:34:34.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.238+0000 7f78d6047640 1 Processor -- start 2023-10-14T10:34:34.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.238+0000 7f78d6047640 1 -- start start 2023-10-14T10:34:34.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.240+0000 7f78d6047640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d0152670 0x7f78d00c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:34.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.240+0000 7f78d6047640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f78d00c2650 0x7f78d01555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:34.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.240+0000 7f78d6047640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d0151bf0 con 0x7f78d006b6e0 2023-10-14T10:34:34.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.240+0000 7f78d6047640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d00bffd0 con 0x7f78d00c2650 2023-10-14T10:34:34.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.240+0000 7f78d6047640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00c02b0 con 0x7f78d0152670 2023-10-14T10:34:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.240+0000 7f78d4844640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f78d00c2650 0x7f78d01555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.240+0000 7f78d4844640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f78d00c2650 0x7f78d01555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60700/0 (socket says 172.21.15.8:60700) 2023-10-14T10:34:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.240+0000 7f78d4844640 1 -- 172.21.15.8:0/2324303554 learned_addr learned my addr 172.21.15.8:0/2324303554 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.241+0000 7f78d5045640 1 --2- 172.21.15.8:0/2324303554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d0152670 0x7f78d00c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.241+0000 7f78d4844640 1 -- 172.21.15.8:0/2324303554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d0152670 msgr2=0x7f78d00c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.241+0000 7f78d4844640 1 --2- 172.21.15.8:0/2324303554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d0152670 0x7f78d00c2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.241+0000 7f78d4844640 1 -- 172.21.15.8:0/2324303554 >> v1:172.21.15.92:6789/0 conn(0x7f78d006b6e0 legacy=0x7f78d0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.241+0000 7f78d4844640 1 -- 172.21.15.8:0/2324303554 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d00c0590 con 0x7f78d00c2650 2023-10-14T10:34:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.242+0000 7f78d4844640 1 --2- 172.21.15.8:0/2324303554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78d00c2650 0x7f78d01555c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009870 tx=0x7f78c002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d586db453b335e1b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.242+0000 7f78c7fff640 1 -- 172.21.15.8:0/2324303554 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c00317c0 con 0x7f78d00c2650 2023-10-14T10:34:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.242+0000 7f78c7fff640 1 -- 172.21.15.8:0/2324303554 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c0031920 con 0x7f78d00c2650 2023-10-14T10:34:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.242+0000 7f78c7fff640 1 -- 172.21.15.8:0/2324303554 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0031cb0 con 0x7f78d00c2650 2023-10-14T10:34:34.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.243+0000 7f78d6047640 1 -- 172.21.15.8:0/2324303554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78d00c2650 msgr2=0x7f78d01555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:34.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.243+0000 7f78d6047640 1 --2- 172.21.15.8:0/2324303554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78d00c2650 0x7f78d01555c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009870 tx=0x7f78c002b860 comp rx=0 tx=0).stop 2023-10-14T10:34:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.243+0000 7f78d6047640 1 -- 172.21.15.8:0/2324303554 shutdown_connections 2023-10-14T10:34:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.243+0000 7f78d6047640 1 --2- 172.21.15.8:0/2324303554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78d00c2650 0x7f78d01555c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.243+0000 7f78d6047640 1 --2- 172.21.15.8:0/2324303554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d0152670 0x7f78d00c2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.243+0000 7f78d6047640 1 -- 172.21.15.8:0/2324303554 >> 172.21.15.8:0/2324303554 conn(0x7f78d006a200 msgr2=0x7f78d006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.243+0000 7f78d6047640 1 -- 172.21.15.8:0/2324303554 shutdown_connections 2023-10-14T10:34:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.243+0000 7f78d6047640 1 -- 172.21.15.8:0/2324303554 wait complete. 2023-10-14T10:34:34.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.246+0000 7f78d6047640 1 Processor -- start 2023-10-14T10:34:34.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.246+0000 7f78d6047640 1 -- start start 2023-10-14T10:34:34.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.247+0000 7f78d6047640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d006b6e0 0x7f78d014bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:34.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.247+0000 7f78d6047640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00c2650 0x7f78d0153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:34.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.247+0000 7f78d6047640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78d0152670 0x7f78d014a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:34.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.247+0000 7f78d6047640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d014c570 con 0x7f78d0152670 2023-10-14T10:34:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.247+0000 7f78d6047640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d014cdd0 con 0x7f78d006b6e0 2023-10-14T10:34:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.247+0000 7f78d6047640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00bdad0 con 0x7f78d00c2650 2023-10-14T10:34:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.248+0000 7f78d5846640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78d0152670 0x7f78d014a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.248+0000 7f78d5846640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78d0152670 0x7f78d014a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60708/0 (socket says 172.21.15.8:60708) 2023-10-14T10:34:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.248+0000 7f78d5846640 1 -- 172.21.15.8:0/3194537132 learned_addr learned my addr 172.21.15.8:0/3194537132 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:34.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.248+0000 7f78d4844640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00c2650 0x7f78d0153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:34.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.248+0000 7f78d5045640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d006b6e0 0x7f78d014bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:34.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.248+0000 7f78d5846640 1 -- 172.21.15.8:0/3194537132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00c2650 msgr2=0x7f78d0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:34.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.248+0000 7f78d5846640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00c2650 0x7f78d0153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.248+0000 7f78d5846640 1 -- 172.21.15.8:0/3194537132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d006b6e0 msgr2=0x7f78d014bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:34.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.248+0000 7f78d5846640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d006b6e0 0x7f78d014bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.248+0000 7f78d5846640 1 -- 172.21.15.8:0/3194537132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c00094d0 con 0x7f78d0152670 2023-10-14T10:34:34.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.248+0000 7f78d5045640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d006b6e0 0x7f78d014bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:34.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.249+0000 7f78d5846640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78d0152670 0x7f78d014a740 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f78c800c780 tx=0x7f78c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:34.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.249+0000 7f78c5ffb640 1 -- 172.21.15.8:0/3194537132 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8004b60 con 0x7f78d0152670 2023-10-14T10:34:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.249+0000 7f78c5ffb640 1 -- 172.21.15.8:0/3194537132 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c800ce90 con 0x7f78d0152670 2023-10-14T10:34:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.249+0000 7f78c5ffb640 1 -- 172.21.15.8:0/3194537132 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c800a850 con 0x7f78d0152670 2023-10-14T10:34:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.249+0000 7f78d6047640 1 -- 172.21.15.8:0/3194537132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d014c780 con 0x7f78d0152670 2023-10-14T10:34:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.249+0000 7f78d6047640 1 -- 172.21.15.8:0/3194537132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d0154120 con 0x7f78d0152670 2023-10-14T10:34:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.250+0000 7f78d6047640 1 -- 172.21.15.8:0/3194537132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d014a460 con 0x7f78d0152670 2023-10-14T10:34:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.251+0000 7f78c5ffb640 1 -- 172.21.15.8:0/3194537132 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78c800a9b0 con 0x7f78d0152670 2023-10-14T10:34:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.252+0000 7f78c5ffb640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f78b406aea0 0x7f78b406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.253+0000 7f78c5ffb640 1 -- 172.21.15.8:0/3194537132 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f78c8089810 con 0x7f78d0152670 2023-10-14T10:34:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.253+0000 7f78d5045640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f78b406aea0 0x7f78b406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.253+0000 7f78d5045640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f78b406aea0 0x7f78b406d360 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f78cc006fd0 tx=0x7f78cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:34.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.259+0000 7f78c5ffb640 1 -- 172.21.15.8:0/3194537132 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78d014a460 con 0x7f78d0152670 2023-10-14T10:34:34.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.494+0000 7f78d6047640 1 -- 172.21.15.8:0/3194537132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78d014a460 con 0x7f78d0152670 2023-10-14T10:34:34.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.495+0000 7f78c5ffb640 1 -- 172.21.15.8:0/3194537132 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4898 (secure 0 0 0) 0x7f78d014a460 con 0x7f78d0152670 2023-10-14T10:34:34.498 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:34.498 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3003490368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3003490368},{"type":"v1","addr":"172.21.15.92:6834","nonce":3003490368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3352501671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":3352501671},{"type":"v1","addr":"172.21.15.92:6835","nonce":3352501671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4157669185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4157669185},{"type":"v1","addr":"172.21.15.8:6837","nonce":4157669185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:33:47.398252+0000","modified":"2023-10-14T10:33:50.442698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6835/524862170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":524862170},{"type":"v1","addr":"172.21.15.8:6835","nonce":524862170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T10:34:34.498 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T10:34:34.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.498+0000 7f78d6047640 1 -- 172.21.15.8:0/3194537132 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f78b406aea0 msgr2=0x7f78b406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:34.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.498+0000 7f78d6047640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f78b406aea0 0x7f78b406d360 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f78cc006fd0 tx=0x7f78cc008040 comp rx=0 tx=0).stop 2023-10-14T10:34:34.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.498+0000 7f78d6047640 1 -- 172.21.15.8:0/3194537132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78d0152670 msgr2=0x7f78d014a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:34.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.498+0000 7f78d6047640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78d0152670 0x7f78d014a740 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f78c800c780 tx=0x7f78c800cc40 comp rx=0 tx=0).stop 2023-10-14T10:34:34.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.498+0000 7f78d6047640 1 -- 172.21.15.8:0/3194537132 shutdown_connections 2023-10-14T10:34:34.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.498+0000 7f78d6047640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f78b406aea0 0x7f78b406d360 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.498+0000 7f78d6047640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78d0152670 0x7f78d014a740 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.498+0000 7f78d6047640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00c2650 0x7f78d0153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.498+0000 7f78d6047640 1 --2- 172.21.15.8:0/3194537132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d006b6e0 0x7f78d014bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.498+0000 7f78d6047640 1 -- 172.21.15.8:0/3194537132 >> 172.21.15.8:0/3194537132 conn(0x7f78d006a200 msgr2=0x7f78d006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:34.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.498+0000 7f78d6047640 1 -- 172.21.15.8:0/3194537132 shutdown_connections 2023-10-14T10:34:34.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.498+0000 7f78d6047640 1 -- 172.21.15.8:0/3194537132 wait complete. 2023-10-14T10:34:34.520 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:34:34.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.747+0000 7f9e8a2a3640 1 Processor -- start 2023-10-14T10:34:34.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.748+0000 7f9e8a2a3640 1 -- start start 2023-10-14T10:34:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.749+0000 7f9e8a2a3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e84071550 0x7f9e84070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.749+0000 7f9e8a2a3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e840c06f0 0x7f9e841511a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:34.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.749+0000 7f9e8a2a3640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e840719e0 con 0x7f9e840c2380 2023-10-14T10:34:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.749+0000 7f9e8a2a3640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e84071190 con 0x7f9e84071550 2023-10-14T10:34:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.749+0000 7f9e8a2a3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84071cc0 con 0x7f9e840c06f0 2023-10-14T10:34:34.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.750+0000 7f9e88aa0640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e84071550 0x7f9e84070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.750+0000 7f9e88aa0640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e84071550 0x7f9e84070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60720/0 (socket says 172.21.15.8:60720) 2023-10-14T10:34:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.750+0000 7f9e88aa0640 1 -- 172.21.15.8:0/3548696982 learned_addr learned my addr 172.21.15.8:0/3548696982 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:34.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.750+0000 7f9e89aa2640 1 --2- 172.21.15.8:0/3548696982 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e840c06f0 0x7f9e841511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.750+0000 7f9e88aa0640 1 -- 172.21.15.8:0/3548696982 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e840c06f0 msgr2=0x7f9e841511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:34.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.750+0000 7f9e88aa0640 1 --2- 172.21.15.8:0/3548696982 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e840c06f0 0x7f9e841511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.750+0000 7f9e88aa0640 1 -- 172.21.15.8:0/3548696982 >> v1:172.21.15.8:6789/0 conn(0x7f9e840c2380 legacy=0x7f9e840a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:34.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.750+0000 7f9e88aa0640 1 -- 172.21.15.8:0/3548696982 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e84071fa0 con 0x7f9e84071550 2023-10-14T10:34:34.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.751+0000 7f9e88aa0640 1 --2- 172.21.15.8:0/3548696982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e84071550 0x7f9e84070c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009870 tx=0x7f9e7402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3461787d0507c75 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.751+0000 7f9e7bfff640 1 -- 172.21.15.8:0/3548696982 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74030840 con 0x7f9e84071550 2023-10-14T10:34:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.752+0000 7f9e7bfff640 1 -- 172.21.15.8:0/3548696982 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e740309a0 con 0x7f9e84071550 2023-10-14T10:34:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.752+0000 7f9e7bfff640 1 -- 172.21.15.8:0/3548696982 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74030d30 con 0x7f9e84071550 2023-10-14T10:34:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.752+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/3548696982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e84071550 msgr2=0x7f9e84070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.752+0000 7f9e8a2a3640 1 --2- 172.21.15.8:0/3548696982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e84071550 0x7f9e84070c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009870 tx=0x7f9e7402b980 comp rx=0 tx=0).stop 2023-10-14T10:34:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.752+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/3548696982 shutdown_connections 2023-10-14T10:34:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.752+0000 7f9e8a2a3640 1 --2- 172.21.15.8:0/3548696982 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e840c06f0 0x7f9e841511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.752+0000 7f9e8a2a3640 1 --2- 172.21.15.8:0/3548696982 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e84071550 0x7f9e84070c50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.752+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/3548696982 >> 172.21.15.8:0/3548696982 conn(0x7f9e8406a200 msgr2=0x7f9e8406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.752+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/3548696982 shutdown_connections 2023-10-14T10:34:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.752+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/3548696982 wait complete. 2023-10-14T10:34:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.754+0000 7f9e8a2a3640 1 Processor -- start 2023-10-14T10:34:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.754+0000 7f9e8a2a3640 1 -- start start 2023-10-14T10:34:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.755+0000 7f9e8a2a3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e840c06f0 0x7f9e8406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.755+0000 7f9e8a2a3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e840c2380 0x7f9e841499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.755+0000 7f9e8a2a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e840c2e40 0x7f9e84143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.755+0000 7f9e8a2a3640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8406d9d0 con 0x7f9e840c06f0 2023-10-14T10:34:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.755+0000 7f9e8a2a3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e841504a0 con 0x7f9e840c2e40 2023-10-14T10:34:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.755+0000 7f9e8a2a3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84150780 con 0x7f9e840c2380 2023-10-14T10:34:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.755+0000 7f9e892a1640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e840c06f0 0x7f9e8406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.756+0000 7f9e892a1640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e840c06f0 0x7f9e8406b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60724/0 (socket says 172.21.15.8:60724) 2023-10-14T10:34:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.756+0000 7f9e892a1640 1 -- 172.21.15.8:0/836204713 learned_addr learned my addr 172.21.15.8:0/836204713 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.756+0000 7f9e88aa0640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e840c2380 0x7f9e841499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.756+0000 7f9e89aa2640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e840c2e40 0x7f9e84143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.756+0000 7f9e892a1640 1 -- 172.21.15.8:0/836204713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e840c2380 msgr2=0x7f9e841499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.756+0000 7f9e892a1640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e840c2380 0x7f9e841499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.756+0000 7f9e892a1640 1 -- 172.21.15.8:0/836204713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e840c2e40 msgr2=0x7f9e84143d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.756+0000 7f9e892a1640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e840c2e40 0x7f9e84143d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.756+0000 7f9e892a1640 1 -- 172.21.15.8:0/836204713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e740094d0 con 0x7f9e840c06f0 2023-10-14T10:34:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.756+0000 7f9e892a1640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e840c06f0 0x7f9e8406b6e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000c450 tx=0x7f9e8000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.757+0000 7f9e79ffb640 1 -- 172.21.15.8:0/836204713 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e800052d0 con 0x7f9e840c06f0 2023-10-14T10:34:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.757+0000 7f9e79ffb640 1 -- 172.21.15.8:0/836204713 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e80005430 con 0x7f9e840c06f0 2023-10-14T10:34:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.757+0000 7f9e79ffb640 1 -- 172.21.15.8:0/836204713 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e80003830 con 0x7f9e840c06f0 2023-10-14T10:34:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.757+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/836204713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e840c4d40 con 0x7f9e840c06f0 2023-10-14T10:34:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.757+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/836204713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e84149f20 con 0x7f9e840c06f0 2023-10-14T10:34:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.758+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/836204713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8404e9b0 con 0x7f9e840c06f0 2023-10-14T10:34:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.759+0000 7f9e79ffb640 1 -- 172.21.15.8:0/836204713 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9e80003990 con 0x7f9e840c06f0 2023-10-14T10:34:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.760+0000 7f9e79ffb640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9e6806aea0 0x7f9e6806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.760+0000 7f9e79ffb640 1 -- 172.21.15.8:0/836204713 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9e80088c50 con 0x7f9e840c06f0 2023-10-14T10:34:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.760+0000 7f9e88aa0640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9e6806aea0 0x7f9e6806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:34.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.761+0000 7f9e88aa0640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9e6806aea0 0x7f9e6806d360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9e74036000 tx=0x7f9e7403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:34.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:34.764+0000 7f9e79ffb640 1 -- 172.21.15.8:0/836204713 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e80053c70 con 0x7f9e840c06f0 2023-10-14T10:34:35.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.001+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/836204713 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e840bfaf0 con 0x7f9e840c06f0 2023-10-14T10:34:35.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.002+0000 7f9e79ffb640 1 -- 172.21.15.8:0/836204713 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4898 (secure 0 0 0) 0x7f9e80057290 con 0x7f9e840c06f0 2023-10-14T10:34:35.005 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:35.005 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3003490368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3003490368},{"type":"v1","addr":"172.21.15.92:6834","nonce":3003490368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3352501671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":3352501671},{"type":"v1","addr":"172.21.15.92:6835","nonce":3352501671}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4246,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4157669185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4157669185},{"type":"v1","addr":"172.21.15.8:6837","nonce":4157669185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:33:47.398252+0000","modified":"2023-10-14T10:33:50.442698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6835/524862170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":524862170},{"type":"v1","addr":"172.21.15.8:6835","nonce":524862170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T10:34:35.006 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T10:34:35.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.005+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/836204713 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9e6806aea0 msgr2=0x7f9e6806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.005+0000 7f9e8a2a3640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9e6806aea0 0x7f9e6806d360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9e74036000 tx=0x7f9e7403b040 comp rx=0 tx=0).stop 2023-10-14T10:34:35.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.005+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/836204713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e840c06f0 msgr2=0x7f9e8406b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.005+0000 7f9e8a2a3640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e840c06f0 0x7f9e8406b6e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000c450 tx=0x7f9e8000c910 comp rx=0 tx=0).stop 2023-10-14T10:34:35.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.005+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/836204713 shutdown_connections 2023-10-14T10:34:35.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.005+0000 7f9e8a2a3640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9e6806aea0 0x7f9e6806d360 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.005+0000 7f9e8a2a3640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e840c2e40 0x7f9e84143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.005+0000 7f9e8a2a3640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e840c2380 0x7f9e841499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.005+0000 7f9e8a2a3640 1 --2- 172.21.15.8:0/836204713 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e840c06f0 0x7f9e8406b6e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.005+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/836204713 >> 172.21.15.8:0/836204713 conn(0x7f9e8406a200 msgr2=0x7f9e8414c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:35.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.005+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/836204713 shutdown_connections 2023-10-14T10:34:35.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.006+0000 7f9e8a2a3640 1 -- 172.21.15.8:0/836204713 wait complete. 2023-10-14T10:34:35.026 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.243+0000 7f0315aa3640 1 Processor -- start 2023-10-14T10:34:35.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.243+0000 7f0315aa3640 1 -- start start 2023-10-14T10:34:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.245+0000 7f0315aa3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f031006b6e0 0x7f03101555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.245+0000 7f0315aa3640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0310151bf0 con 0x7f0310155b00 2023-10-14T10:34:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.245+0000 7f0315aa3640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03100bffd0 con 0x7f0310152670 2023-10-14T10:34:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.245+0000 7f0315aa3640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03100c02b0 con 0x7f031006b6e0 2023-10-14T10:34:35.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.245+0000 7f0307fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f031006b6e0 0x7f03101555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.245+0000 7f0307fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f031006b6e0 0x7f03101555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60736/0 (socket says 172.21.15.8:60736) 2023-10-14T10:34:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.245+0000 7f0307fff640 1 -- 172.21.15.8:0/2019677453 learned_addr learned my addr 172.21.15.8:0/2019677453 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.246+0000 7f0307fff640 1 -- 172.21.15.8:0/2019677453 >> v1:172.21.15.92:6789/0 conn(0x7f0310152670 legacy=0x7f03100c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.246+0000 7f0307fff640 1 -- 172.21.15.8:0/2019677453 >> v1:172.21.15.8:6789/0 conn(0x7f0310155b00 legacy=0x7f031015c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.246+0000 7f0307fff640 1 -- 172.21.15.8:0/2019677453 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03100c0590 con 0x7f031006b6e0 2023-10-14T10:34:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.247+0000 7f0307fff640 1 --2- 172.21.15.8:0/2019677453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f031006b6e0 0x7f03101555c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0300009870 tx=0x7f030002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3471d79f6a75c79 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.247+0000 7f03077fe640 1 -- 172.21.15.8:0/2019677453 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0300030860 con 0x7f031006b6e0 2023-10-14T10:34:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.248+0000 7f03077fe640 1 -- 172.21.15.8:0/2019677453 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03000309c0 con 0x7f031006b6e0 2023-10-14T10:34:35.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.248+0000 7f03077fe640 1 -- 172.21.15.8:0/2019677453 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0300030d50 con 0x7f031006b6e0 2023-10-14T10:34:35.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.248+0000 7f0315aa3640 1 -- 172.21.15.8:0/2019677453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f031006b6e0 msgr2=0x7f03101555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.248+0000 7f0315aa3640 1 --2- 172.21.15.8:0/2019677453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f031006b6e0 0x7f03101555c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0300009870 tx=0x7f030002b9a0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.248+0000 7f0315aa3640 1 -- 172.21.15.8:0/2019677453 shutdown_connections 2023-10-14T10:34:35.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.248+0000 7f0315aa3640 1 --2- 172.21.15.8:0/2019677453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f031006b6e0 0x7f03101555c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.248+0000 7f0315aa3640 1 -- 172.21.15.8:0/2019677453 >> 172.21.15.8:0/2019677453 conn(0x7f031006a200 msgr2=0x7f031006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:35.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.248+0000 7f0315aa3640 1 -- 172.21.15.8:0/2019677453 shutdown_connections 2023-10-14T10:34:35.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.249+0000 7f0315aa3640 1 -- 172.21.15.8:0/2019677453 wait complete. 2023-10-14T10:34:35.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.250+0000 7f0315aa3640 1 Processor -- start 2023-10-14T10:34:35.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.250+0000 7f0315aa3640 1 -- start start 2023-10-14T10:34:35.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.251+0000 7f0315aa3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f031006b6e0 0x7f03101497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.251+0000 7f0315aa3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0310152670 0x7f03101ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.251+0000 7f0315aa3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0310155b00 0x7f0310145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.251+0000 7f0315aa3640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0310149430 con 0x7f0310155b00 2023-10-14T10:34:35.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.251+0000 7f0315aa3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03101f0b60 con 0x7f031006b6e0 2023-10-14T10:34:35.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.251+0000 7f0315aa3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03101ee540 con 0x7f0310152670 2023-10-14T10:34:35.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.251+0000 7f03152a2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0310155b00 0x7f0310145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:35.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.252+0000 7f03152a2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0310155b00 0x7f0310145e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60744/0 (socket says 172.21.15.8:60744) 2023-10-14T10:34:35.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.252+0000 7f03152a2640 1 -- 172.21.15.8:0/55049822 learned_addr learned my addr 172.21.15.8:0/55049822 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:35.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.252+0000 7f0307fff640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0310152670 0x7f03101ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:35.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.252+0000 7f0314aa1640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f031006b6e0 0x7f03101497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.252+0000 7f03152a2640 1 -- 172.21.15.8:0/55049822 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0310152670 msgr2=0x7f03101ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.252+0000 7f03152a2640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0310152670 0x7f03101ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.252+0000 7f03152a2640 1 -- 172.21.15.8:0/55049822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f031006b6e0 msgr2=0x7f03101497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.252+0000 7f03152a2640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f031006b6e0 0x7f03101497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.252+0000 7f03152a2640 1 -- 172.21.15.8:0/55049822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03000094d0 con 0x7f0310155b00 2023-10-14T10:34:35.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.252+0000 7f0307fff640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0310152670 0x7f03101ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:35.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.252+0000 7f0314aa1640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f031006b6e0 0x7f03101497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:35.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.252+0000 7f03152a2640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0310155b00 0x7f0310145e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f030800c390 tx=0x7f030800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:35.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.253+0000 7f03057fa640 1 -- 172.21.15.8:0/55049822 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03080052d0 con 0x7f0310155b00 2023-10-14T10:34:35.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.253+0000 7f03057fa640 1 -- 172.21.15.8:0/55049822 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0308005430 con 0x7f0310155b00 2023-10-14T10:34:35.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.253+0000 7f0315aa3640 1 -- 172.21.15.8:0/55049822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03100c3e90 con 0x7f0310155b00 2023-10-14T10:34:35.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.253+0000 7f03057fa640 1 -- 172.21.15.8:0/55049822 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308003810 con 0x7f0310155b00 2023-10-14T10:34:35.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.253+0000 7f0315aa3640 1 -- 172.21.15.8:0/55049822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03100c4450 con 0x7f0310155b00 2023-10-14T10:34:35.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.254+0000 7f0315aa3640 1 -- 172.21.15.8:0/55049822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031004e9b0 con 0x7f0310155b00 2023-10-14T10:34:35.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.255+0000 7f03057fa640 1 -- 172.21.15.8:0/55049822 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0308003970 con 0x7f0310155b00 2023-10-14T10:34:35.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.256+0000 7f03057fa640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f02fc06ae70 0x7f02fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.256+0000 7f03057fa640 1 -- 172.21.15.8:0/55049822 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0308088b20 con 0x7f0310155b00 2023-10-14T10:34:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.256+0000 7f0314aa1640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f02fc06ae70 0x7f02fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.257+0000 7f0314aa1640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f02fc06ae70 0x7f02fc06d330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f03100c2550 tx=0x7f030c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.260+0000 7f03057fa640 1 -- 172.21.15.8:0/55049822 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0308053be0 con 0x7f0310155b00 2023-10-14T10:34:35.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.462+0000 7f0315aa3640 1 -- 172.21.15.8:0/55049822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03100c18c0 con 0x7f0310155b00 2023-10-14T10:34:35.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.465+0000 7f03057fa640 1 -- 172.21.15.8:0/55049822 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16621 (secure 0 0 0) 0x7f0308017090 con 0x7f0310155b00 2023-10-14T10:34:35.468 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:35.468 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:34:34.607700+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T10:33:44.913451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T10:33:46.397320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:35.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.468+0000 7f0315aa3640 1 -- 172.21.15.8:0/55049822 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f02fc06ae70 msgr2=0x7f02fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.468+0000 7f0315aa3640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f02fc06ae70 0x7f02fc06d330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f03100c2550 tx=0x7f030c009040 comp rx=0 tx=0).stop 2023-10-14T10:34:35.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.468+0000 7f0315aa3640 1 -- 172.21.15.8:0/55049822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0310155b00 msgr2=0x7f0310145e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.468+0000 7f0315aa3640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0310155b00 0x7f0310145e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f030800c390 tx=0x7f030800c850 comp rx=0 tx=0).stop 2023-10-14T10:34:35.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.468+0000 7f0315aa3640 1 -- 172.21.15.8:0/55049822 shutdown_connections 2023-10-14T10:34:35.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.468+0000 7f0315aa3640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f02fc06ae70 0x7f02fc06d330 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.468+0000 7f0315aa3640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0310155b00 0x7f0310145e50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.468+0000 7f0315aa3640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0310152670 0x7f03101ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.468+0000 7f0315aa3640 1 --2- 172.21.15.8:0/55049822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f031006b6e0 0x7f03101497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.468+0000 7f0315aa3640 1 -- 172.21.15.8:0/55049822 >> 172.21.15.8:0/55049822 conn(0x7f031006a200 msgr2=0x7f03100714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:35.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.468+0000 7f0315aa3640 1 -- 172.21.15.8:0/55049822 shutdown_connections 2023-10-14T10:34:35.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.469+0000 7f0315aa3640 1 -- 172.21.15.8:0/55049822 wait complete. 2023-10-14T10:34:35.493 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T10:34:35.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.714+0000 7fb2eb59e640 1 Processor -- start 2023-10-14T10:34:35.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.715+0000 7fb2eb59e640 1 -- start start 2023-10-14T10:34:35.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.717+0000 7fb2eb59e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb2ec13af90 0x7fb2ec0a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.717+0000 7fb2eb59e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec152ac0 con 0x7fb2ec0bfc10 2023-10-14T10:34:35.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.717+0000 7fb2eb59e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec151eb0 con 0x7fb2ec06fb10 2023-10-14T10:34:35.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.717+0000 7fb2eb59e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec152190 con 0x7fb2ec13af90 2023-10-14T10:34:35.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.717+0000 7fb2ead9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb2ec0bfc10 0x7fb2ec0c0080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51640/0 (socket says 172.21.15.8:51640) 2023-10-14T10:34:35.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.717+0000 7fb2ead9d640 1 -- 172.21.15.8:0/1327714755 learned_addr learned my addr 172.21.15.8:0/1327714755 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:35.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2ea59c640 1 --2- 172.21.15.8:0/1327714755 >> v2:172.21.15.92:3300/0 conn(0x7fb2ec13af90 0x7fb2ec0a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:35.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110658860 0 0) 0x7fb2ec152ac0 con 0x7fb2ec0bfc10 2023-10-14T10:34:35.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d8003520 con 0x7fb2ec0bfc10 2023-10-14T10:34:35.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 493266454 0 0) 0x7fb2d8003520 con 0x7fb2ec0bfc10 2023-10-14T10:34:35.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 >> v2:172.21.15.92:3300/0 conn(0x7fb2ec13af90 msgr2=0x7fb2ec0a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:35.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 --2- 172.21.15.8:0/1327714755 >> v2:172.21.15.92:3300/0 conn(0x7fb2ec13af90 0x7fb2ec0a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 >> v1:172.21.15.92:6789/0 conn(0x7fb2ec06fb10 legacy=0x7fb2ec0c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec152470 con 0x7fb2ec0bfc10 2023-10-14T10:34:35.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fb2e40019f0 con 0x7fb2ec0bfc10 2023-10-14T10:34:35.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 >> v1:172.21.15.8:6789/0 conn(0x7fb2ec0bfc10 legacy=0x7fb2ec0c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 --2- 172.21.15.8:0/1327714755 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2d80039c0 0x7fb2d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 --2- 172.21.15.8:0/1327714755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2d80047c0 0x7fb2d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 --2- 172.21.15.8:0/1327714755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2d80051d0 0x7fb2d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec152190 con 0x7fb2d80047c0 2023-10-14T10:34:35.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d800c120 con 0x7fb2d80051d0 2023-10-14T10:34:35.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.718+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d800c2e0 con 0x7fb2d80039c0 2023-10-14T10:34:35.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.719+0000 7fb2e3fff640 1 --2- 172.21.15.8:0/1327714755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2d80047c0 0x7fb2d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:35.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.719+0000 7fb2e3fff640 1 -- 172.21.15.8:0/1327714755 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2d80039c0 msgr2=0x7fb2d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:35.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.719+0000 7fb2e3fff640 1 --2- 172.21.15.8:0/1327714755 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2d80039c0 0x7fb2d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.719+0000 7fb2e3fff640 1 -- 172.21.15.8:0/1327714755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2d80051d0 msgr2=0x7fb2d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:35.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.719+0000 7fb2e3fff640 1 --2- 172.21.15.8:0/1327714755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2d80051d0 0x7fb2d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.719+0000 7fb2e3fff640 1 -- 172.21.15.8:0/1327714755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8003520 con 0x7fb2d80047c0 2023-10-14T10:34:35.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.719+0000 7fb2ead9d640 1 -- 172.21.15.8:0/1327714755 reap_dead start 2023-10-14T10:34:35.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.720+0000 7fb2e3fff640 1 --2- 172.21.15.8:0/1327714755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2d80047c0 0x7fb2d8004c40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec06ff70 tx=0x7fb2d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf4e0930db78637 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:35.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.721+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40052d0 con 0x7fb2d80047c0 2023-10-14T10:34:35.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.721+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d402e050 con 0x7fb2d80047c0 2023-10-14T10:34:35.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.721+0000 7fb2e9d9b640 1 -- 172.21.15.8:0/1327714755 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4003830 con 0x7fb2d80047c0 2023-10-14T10:34:35.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.721+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1327714755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2d80047c0 msgr2=0x7fb2d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.721+0000 7fb2eb59e640 1 --2- 172.21.15.8:0/1327714755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2d80047c0 0x7fb2d8004c40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec06ff70 tx=0x7fb2d80057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.721+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1327714755 shutdown_connections 2023-10-14T10:34:35.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.721+0000 7fb2eb59e640 1 --2- 172.21.15.8:0/1327714755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2d80047c0 0x7fb2d8004c40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.721+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1327714755 >> 172.21.15.8:0/1327714755 conn(0x7fb2ec06a200 msgr2=0x7fb2ec06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:35.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.721+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1327714755 shutdown_connections 2023-10-14T10:34:35.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.721+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1327714755 wait complete. 2023-10-14T10:34:35.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.723+0000 7fb2eb59e640 1 Processor -- start 2023-10-14T10:34:35.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.723+0000 7fb2eb59e640 1 -- start start 2023-10-14T10:34:35.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.724+0000 7fb2eb59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2d80047c0 0x7fb2ec1e91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.724+0000 7fb2eb59e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2ec0bf160 0x7fb2ec1e9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.724+0000 7fb2eb59e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec1e0a60 0x7fb2ec1e0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.724+0000 7fb2eb59e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec1558d0 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.724+0000 7fb2eb59e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0be360 con 0x7fb2d80047c0 2023-10-14T10:34:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.724+0000 7fb2eb59e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec1ec860 con 0x7fb2ec0bf160 2023-10-14T10:34:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.725+0000 7fb2ead9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec1e0a60 0x7fb2ec1e0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.725+0000 7fb2e3fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2ec0bf160 0x7fb2ec1e9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:35.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.725+0000 7fb2e3fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2ec0bf160 0x7fb2ec1e9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:35210/0 (socket says 172.21.15.8:35210) 2023-10-14T10:34:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.725+0000 7fb2e3fff640 1 -- 172.21.15.8:0/1934442054 learned_addr learned my addr 172.21.15.8:0/1934442054 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.725+0000 7fb2ea59c640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2d80047c0 0x7fb2ec1e91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.725+0000 7fb2ead9d640 1 -- 172.21.15.8:0/1934442054 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2ec0bf160 msgr2=0x7fb2ec1e9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.725+0000 7fb2ead9d640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2ec0bf160 0x7fb2ec1e9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.725+0000 7fb2ead9d640 1 -- 172.21.15.8:0/1934442054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2d80047c0 msgr2=0x7fb2ec1e91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.725+0000 7fb2ead9d640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2d80047c0 0x7fb2ec1e91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.725+0000 7fb2ead9d640 1 -- 172.21.15.8:0/1934442054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec1ecb00 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.726+0000 7fb2ead9d640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec1e0a60 0x7fb2ec1e0ee0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0c2c30 tx=0x7fb2e400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.726+0000 7fb2e2ffd640 1 -- 172.21.15.8:0/1934442054 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4004d60 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.726+0000 7fb2e2ffd640 1 -- 172.21.15.8:0/1934442054 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e400a610 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.726+0000 7fb2e2ffd640 1 -- 172.21.15.8:0/1934442054 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400a9c0 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.726+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1934442054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec1ecde0 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.726+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1934442054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec1ed3a0 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.728+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1934442054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec0619f0 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.728+0000 7fb2e2ffd640 1 -- 172.21.15.8:0/1934442054 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb2e400ab20 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.729+0000 7fb2e2ffd640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb2cc06aea0 0x7fb2cc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:35.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.729+0000 7fb2e2ffd640 1 -- 172.21.15.8:0/1934442054 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb2e4088c70 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.730+0000 7fb2ea59c640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb2cc06aea0 0x7fb2cc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:35.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.730+0000 7fb2ea59c640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb2cc06aea0 0x7fb2cc06d360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec04f3d0 tx=0x7fb2dc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:35.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.734+0000 7fb2e2ffd640 1 -- 172.21.15.8:0/1934442054 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2e4053de0 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.965+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1934442054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb2ec0bf8f0 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.968 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-14T10:34:35.966+0000 7fe3273a6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T10:34:35.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.969+0000 7fb2e2ffd640 1 -- 172.21.15.8:0/1934442054 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb2e401a070 con 0x7fb2ec1e0a60 2023-10-14T10:34:35.972 INFO:teuthology.orchestra.run.smithi008.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T10:34:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.972+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1934442054 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb2cc06aea0 msgr2=0x7fb2cc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.972+0000 7fb2eb59e640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb2cc06aea0 0x7fb2cc06d360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec04f3d0 tx=0x7fb2dc009190 comp rx=0 tx=0).stop 2023-10-14T10:34:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.972+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1934442054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec1e0a60 msgr2=0x7fb2ec1e0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:35.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.972+0000 7fb2eb59e640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec1e0a60 0x7fb2ec1e0ee0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0c2c30 tx=0x7fb2e400cb60 comp rx=0 tx=0).stop 2023-10-14T10:34:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.973+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1934442054 shutdown_connections 2023-10-14T10:34:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.973+0000 7fb2eb59e640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb2cc06aea0 0x7fb2cc06d360 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.973+0000 7fb2eb59e640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2ec1e0a60 0x7fb2ec1e0ee0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.973+0000 7fb2eb59e640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2ec0bf160 0x7fb2ec1e9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.973+0000 7fb2eb59e640 1 --2- 172.21.15.8:0/1934442054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2d80047c0 0x7fb2ec1e91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.973+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1934442054 >> 172.21.15.8:0/1934442054 conn(0x7fb2ec06a200 msgr2=0x7fb2ec1386f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.973+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1934442054 shutdown_connections 2023-10-14T10:34:35.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:35.973+0000 7fb2eb59e640 1 -- 172.21.15.8:0/1934442054 wait complete. 2023-10-14T10:34:35.988 INFO:tasks.ceph.mds.a.smithi008.stderr: -5283> 2023-10-14T10:33:49.807+0000 7ff12e7ef640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T10:34:35.996 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T10:34:36.051 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2023-10-14T10:34:36.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.192+0000 7ff04f232640 1 Processor -- start 2023-10-14T10:34:36.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.192+0000 7ff04f232640 1 -- start start 2023-10-14T10:34:36.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.193+0000 7ff04f232640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0480aa690 0x7ff0480bff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:36.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.193+0000 7ff04f232640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0480bfc30 con 0x7ff048157cf0 2023-10-14T10:34:36.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.193+0000 7ff04f232640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0480bf370 con 0x7ff0481540b0 2023-10-14T10:34:36.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.193+0000 7ff04f232640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480bf670 con 0x7ff0480aa690 2023-10-14T10:34:36.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.194+0000 7ff04d7cf640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff048157cf0 0x7ff04815ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51658/0 (socket says 172.21.15.8:51658) 2023-10-14T10:34:36.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.194+0000 7ff04d7cf640 1 -- 172.21.15.8:0/753930493 learned_addr learned my addr 172.21.15.8:0/753930493 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:36.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.194+0000 7ff04cfce640 1 --2- 172.21.15.8:0/753930493 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0480aa690 0x7ff0480bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:36.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.194+0000 7ff0477fe640 1 -- 172.21.15.8:0/753930493 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798261198 0 0) 0x7ff0480bfc30 con 0x7ff048157cf0 2023-10-14T10:34:36.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.195+0000 7ff0477fe640 1 -- 172.21.15.8:0/753930493 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff030003520 con 0x7ff048157cf0 2023-10-14T10:34:36.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.195+0000 7ff0477fe640 1 -- 172.21.15.8:0/753930493 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1736041400 0 0) 0x7ff030003520 con 0x7ff048157cf0 2023-10-14T10:34:36.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.195+0000 7ff04cfce640 1 -- 172.21.15.8:0/753930493 >> v1:172.21.15.92:6789/0 conn(0x7ff0481540b0 legacy=0x7ff0480c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:36.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.195+0000 7ff04cfce640 1 -- 172.21.15.8:0/753930493 >> v1:172.21.15.8:6789/0 conn(0x7ff048157cf0 legacy=0x7ff04815ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:36.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.195+0000 7ff04cfce640 1 -- 172.21.15.8:0/753930493 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0480bf950 con 0x7ff0480aa690 2023-10-14T10:34:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.196+0000 7ff04cfce640 1 --2- 172.21.15.8:0/753930493 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0480aa690 0x7ff0480bff50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009800 tx=0x7ff03c02b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33b98fea684951a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.197+0000 7ff0477fe640 1 -- 172.21.15.8:0/753930493 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400019f0 con 0x7ff0480aa690 2023-10-14T10:34:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.197+0000 7ff0477fe640 1 -- 172.21.15.8:0/753930493 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c02e050 con 0x7ff0480aa690 2023-10-14T10:34:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.197+0000 7ff0477fe640 1 -- 172.21.15.8:0/753930493 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c030730 con 0x7ff0480aa690 2023-10-14T10:34:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.198+0000 7ff04f232640 1 -- 172.21.15.8:0/753930493 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0480aa690 msgr2=0x7ff0480bff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.198+0000 7ff04f232640 1 --2- 172.21.15.8:0/753930493 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0480aa690 0x7ff0480bff50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009800 tx=0x7ff03c02b6d0 comp rx=0 tx=0).stop 2023-10-14T10:34:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.198+0000 7ff04f232640 1 -- 172.21.15.8:0/753930493 shutdown_connections 2023-10-14T10:34:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.198+0000 7ff04f232640 1 --2- 172.21.15.8:0/753930493 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff0480aa690 0x7ff0480bff50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.198+0000 7ff04f232640 1 -- 172.21.15.8:0/753930493 >> 172.21.15.8:0/753930493 conn(0x7ff0480a74d0 msgr2=0x7ff0480a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.198+0000 7ff04f232640 1 -- 172.21.15.8:0/753930493 shutdown_connections 2023-10-14T10:34:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.198+0000 7ff04f232640 1 -- 172.21.15.8:0/753930493 wait complete. 2023-10-14T10:34:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.200+0000 7ff04f232640 1 Processor -- start 2023-10-14T10:34:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.200+0000 7ff04f232640 1 -- start start 2023-10-14T10:34:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.201+0000 7ff04f232640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0480aa690 0x7ff04814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:36.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.201+0000 7ff04f232640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff048157cf0 0x7ff0480c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:36.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.201+0000 7ff04f232640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff04814c100 0x7ff04814c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:36.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.201+0000 7ff04f232640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04814cac0 con 0x7ff0480aa690 2023-10-14T10:34:36.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.201+0000 7ff04f232640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480c3360 con 0x7ff048157cf0 2023-10-14T10:34:36.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.201+0000 7ff04f232640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0481e9f60 con 0x7ff04814c100 2023-10-14T10:34:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.201+0000 7ff04cfce640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0480aa690 0x7ff04814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.201+0000 7ff04cfce640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0480aa690 0x7ff04814e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60772/0 (socket says 172.21.15.8:60772) 2023-10-14T10:34:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.201+0000 7ff04cfce640 1 -- 172.21.15.8:0/3215750971 learned_addr learned my addr 172.21.15.8:0/3215750971 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.202+0000 7ff047fff640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff048157cf0 0x7ff0480c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.202+0000 7ff04d7cf640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff04814c100 0x7ff04814c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.202+0000 7ff04cfce640 1 -- 172.21.15.8:0/3215750971 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff04814c100 msgr2=0x7ff04814c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.202+0000 7ff04cfce640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff04814c100 0x7ff04814c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.202+0000 7ff04cfce640 1 -- 172.21.15.8:0/3215750971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff048157cf0 msgr2=0x7ff0480c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.202+0000 7ff04cfce640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff048157cf0 0x7ff0480c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:36.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.202+0000 7ff04cfce640 1 -- 172.21.15.8:0/3215750971 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c009400 con 0x7ff0480aa690 2023-10-14T10:34:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.202+0000 7ff04d7cf640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff04814c100 0x7ff04814c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.202+0000 7ff04cfce640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0480aa690 0x7ff04814e1d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff03c000c00 tx=0x7ff03c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:36.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.202+0000 7ff0457fa640 1 -- 172.21.15.8:0/3215750971 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c004230 con 0x7ff0480aa690 2023-10-14T10:34:36.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.203+0000 7ff0457fa640 1 -- 172.21.15.8:0/3215750971 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c004390 con 0x7ff0480aa690 2023-10-14T10:34:36.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.203+0000 7ff0457fa640 1 -- 172.21.15.8:0/3215750971 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c003850 con 0x7ff0480aa690 2023-10-14T10:34:36.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.203+0000 7ff04f232640 1 -- 172.21.15.8:0/3215750971 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0481ea240 con 0x7ff0480aa690 2023-10-14T10:34:36.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.203+0000 7ff04f232640 1 -- 172.21.15.8:0/3215750971 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0480c2c90 con 0x7ff0480aa690 2023-10-14T10:34:36.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.204+0000 7ff04f232640 1 -- 172.21.15.8:0/3215750971 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0480c2810 con 0x7ff0480aa690 2023-10-14T10:34:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.205+0000 7ff0457fa640 1 -- 172.21.15.8:0/3215750971 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff03c043030 con 0x7ff0480aa690 2023-10-14T10:34:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.206+0000 7ff0457fa640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff03406ae70 0x7ff03406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.206+0000 7ff0457fa640 1 -- 172.21.15.8:0/3215750971 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7ff03c041070 con 0x7ff0480aa690 2023-10-14T10:34:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.207+0000 7ff047fff640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff03406ae70 0x7ff03406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.207+0000 7ff047fff640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff03406ae70 0x7ff03406d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff048071fb0 tx=0x7ff038009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:36.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.211+0000 7ff0457fa640 1 -- 172.21.15.8:0/3215750971 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0480c2810 con 0x7ff0480aa690 2023-10-14T10:34:36.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.449+0000 7ff04f232640 1 -- 172.21.15.8:0/3215750971 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff0480c2810 con 0x7ff0480aa690 2023-10-14T10:34:36.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.973+0000 7ff0457fa640 1 -- 172.21.15.8:0/3215750971 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff0480c2810 con 0x7ff0480aa690 2023-10-14T10:34:36.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.977+0000 7ff04f232640 1 -- 172.21.15.8:0/3215750971 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff03406ae70 msgr2=0x7ff03406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:36.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.977+0000 7ff04f232640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff03406ae70 0x7ff03406d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff048071fb0 tx=0x7ff038009040 comp rx=0 tx=0).stop 2023-10-14T10:34:36.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.977+0000 7ff04f232640 1 -- 172.21.15.8:0/3215750971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0480aa690 msgr2=0x7ff04814e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:36.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.977+0000 7ff04f232640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0480aa690 0x7ff04814e1d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff03c000c00 tx=0x7ff03c0046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:36.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.978+0000 7ff04f232640 1 -- 172.21.15.8:0/3215750971 shutdown_connections 2023-10-14T10:34:36.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.978+0000 7ff04f232640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff03406ae70 0x7ff03406d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:36.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.978+0000 7ff04f232640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff04814c100 0x7ff04814c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:36.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.978+0000 7ff04f232640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff048157cf0 0x7ff0480c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:36.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.978+0000 7ff04f232640 1 --2- 172.21.15.8:0/3215750971 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0480aa690 0x7ff04814e1d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:36.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.978+0000 7ff04f232640 1 -- 172.21.15.8:0/3215750971 >> 172.21.15.8:0/3215750971 conn(0x7ff0480a74d0 msgr2=0x7ff048069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:36.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.978+0000 7ff04f232640 1 -- 172.21.15.8:0/3215750971 shutdown_connections 2023-10-14T10:34:36.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:36.978+0000 7ff04f232640 1 -- 172.21.15.8:0/3215750971 wait complete. 2023-10-14T10:34:37.000 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T10:34:37.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.219+0000 7faa21613640 1 Processor -- start 2023-10-14T10:34:37.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.219+0000 7faa21613640 1 -- start start 2023-10-14T10:34:37.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.221+0000 7faa21613640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faa1c154070 0x7faa1c154450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:37.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.221+0000 7faa21613640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c06d020 con 0x7faa1c06d750 2023-10-14T10:34:37.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.221+0000 7faa21613640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c06d4b0 con 0x7faa1c1526b0 2023-10-14T10:34:37.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.221+0000 7faa21613640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c13a340 con 0x7faa1c154070 2023-10-14T10:34:37.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.221+0000 7faa1bfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faa1c154070 0x7faa1c154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:37.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.221+0000 7faa137fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7faa1c06d750 0x7faa1c151fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35372/0 (socket says 172.21.15.8:35372) 2023-10-14T10:34:37.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.221+0000 7faa137fe640 1 -- 172.21.15.8:0/629323185 learned_addr learned my addr 172.21.15.8:0/629323185 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:37.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.222+0000 7faa1bfff640 1 -- 172.21.15.8:0/629323185 >> v1:172.21.15.92:6789/0 conn(0x7faa1c1526b0 legacy=0x7faa1c15b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:37.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.222+0000 7faa1bfff640 1 -- 172.21.15.8:0/629323185 >> v1:172.21.15.8:6789/0 conn(0x7faa1c06d750 legacy=0x7faa1c151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:37.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.222+0000 7faa1bfff640 1 -- 172.21.15.8:0/629323185 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c06c130 con 0x7faa1c154070 2023-10-14T10:34:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.223+0000 7faa1bfff640 1 --2- 172.21.15.8:0/629323185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c154070 0x7faa1c154450 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009d90 tx=0x7faa0c02de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9825b643c72de344 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.223+0000 7faa1b7fe640 1 -- 172.21.15.8:0/629323185 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c02eba0 con 0x7faa1c154070 2023-10-14T10:34:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.223+0000 7faa1b7fe640 1 -- 172.21.15.8:0/629323185 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c02ed00 con 0x7faa1c154070 2023-10-14T10:34:37.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.223+0000 7faa1b7fe640 1 -- 172.21.15.8:0/629323185 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c036660 con 0x7faa1c154070 2023-10-14T10:34:37.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.224+0000 7faa21613640 1 -- 172.21.15.8:0/629323185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c154070 msgr2=0x7faa1c154450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:37.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.224+0000 7faa21613640 1 --2- 172.21.15.8:0/629323185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c154070 0x7faa1c154450 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009d90 tx=0x7faa0c02de70 comp rx=0 tx=0).stop 2023-10-14T10:34:37.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.224+0000 7faa21613640 1 -- 172.21.15.8:0/629323185 shutdown_connections 2023-10-14T10:34:37.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.224+0000 7faa21613640 1 --2- 172.21.15.8:0/629323185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c154070 0x7faa1c154450 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:37.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.224+0000 7faa21613640 1 -- 172.21.15.8:0/629323185 >> 172.21.15.8:0/629323185 conn(0x7faa1c0c52a0 msgr2=0x7faa1c0c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:37.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.224+0000 7faa21613640 1 -- 172.21.15.8:0/629323185 shutdown_connections 2023-10-14T10:34:37.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.224+0000 7faa21613640 1 -- 172.21.15.8:0/629323185 wait complete. 2023-10-14T10:34:37.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.226+0000 7faa21613640 1 Processor -- start 2023-10-14T10:34:37.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.226+0000 7faa21613640 1 -- start start 2023-10-14T10:34:37.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa21613640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c06d750 0x7faa1c070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa21613640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa1c1526b0 0x7faa1c1347e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa21613640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa1c154070 0x7faa1c0be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa21613640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c136e10 con 0x7faa1c06d750 2023-10-14T10:34:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa21613640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c1e9a60 con 0x7faa1c1526b0 2023-10-14T10:34:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa21613640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c134d20 con 0x7faa1c154070 2023-10-14T10:34:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa1bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c06d750 0x7faa1c070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa1bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c06d750 0x7faa1c070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45882/0 (socket says 172.21.15.8:45882) 2023-10-14T10:34:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa1bfff640 1 -- 172.21.15.8:0/1546980512 learned_addr learned my addr 172.21.15.8:0/1546980512 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa1bfff640 1 -- 172.21.15.8:0/1546980512 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa1c154070 msgr2=0x7faa1c0be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa1bfff640 1 --2- 172.21.15.8:0/1546980512 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa1c154070 0x7faa1c0be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa1bfff640 1 -- 172.21.15.8:0/1546980512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa1c1526b0 msgr2=0x7faa1c1347e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa1bfff640 1 --2- 172.21.15.8:0/1546980512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa1c1526b0 0x7faa1c1347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.227+0000 7faa1bfff640 1 -- 172.21.15.8:0/1546980512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c009a70 con 0x7faa1c06d750 2023-10-14T10:34:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.228+0000 7faa1bfff640 1 --2- 172.21.15.8:0/1546980512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c06d750 0x7faa1c070e60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009eb0 tx=0x7faa0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.228+0000 7faa197fa640 1 -- 172.21.15.8:0/1546980512 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c041670 con 0x7faa1c06d750 2023-10-14T10:34:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.228+0000 7faa197fa640 1 -- 172.21.15.8:0/1546980512 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c0417d0 con 0x7faa1c06d750 2023-10-14T10:34:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.228+0000 7faa197fa640 1 -- 172.21.15.8:0/1546980512 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c041b80 con 0x7faa1c06d750 2023-10-14T10:34:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.228+0000 7faa21613640 1 -- 172.21.15.8:0/1546980512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c1e9f90 con 0x7faa1c06d750 2023-10-14T10:34:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.228+0000 7faa21613640 1 -- 172.21.15.8:0/1546980512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c1e9cb0 con 0x7faa1c06d750 2023-10-14T10:34:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.229+0000 7faa21613640 1 -- 172.21.15.8:0/1546980512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c1e9cb0 con 0x7faa1c06d750 2023-10-14T10:34:37.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.230+0000 7faa197fa640 1 -- 172.21.15.8:0/1546980512 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faa0c03d070 con 0x7faa1c06d750 2023-10-14T10:34:37.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.231+0000 7faa197fa640 1 --2- 172.21.15.8:0/1546980512 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa9fc06ae70 0x7fa9fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:37.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.231+0000 7faa197fa640 1 -- 172.21.15.8:0/1546980512 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7faa0c0abdf0 con 0x7faa1c06d750 2023-10-14T10:34:37.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.232+0000 7faa137fe640 1 --2- 172.21.15.8:0/1546980512 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa9fc06ae70 0x7fa9fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:37.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.232+0000 7faa137fe640 1 --2- 172.21.15.8:0/1546980512 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa9fc06ae70 0x7fa9fc06d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faa04007fd0 tx=0x7faa04007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:37.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.235+0000 7faa197fa640 1 -- 172.21.15.8:0/1546980512 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa0c076dd0 con 0x7faa1c06d750 2023-10-14T10:34:37.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.433+0000 7faa21613640 1 -- 172.21.15.8:0/1546980512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faa1c1e9cb0 con 0x7faa1c06d750 2023-10-14T10:34:37.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.976+0000 7faa197fa640 1 -- 172.21.15.8:0/1546980512 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7faa0c03b020 con 0x7faa1c06d750 2023-10-14T10:34:37.979 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' removed 2023-10-14T10:34:37.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.981+0000 7faa21613640 1 -- 172.21.15.8:0/1546980512 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa9fc06ae70 msgr2=0x7fa9fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:37.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.981+0000 7faa21613640 1 --2- 172.21.15.8:0/1546980512 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa9fc06ae70 0x7fa9fc06d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faa04007fd0 tx=0x7faa04007980 comp rx=0 tx=0).stop 2023-10-14T10:34:37.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.981+0000 7faa21613640 1 -- 172.21.15.8:0/1546980512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c06d750 msgr2=0x7faa1c070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:37.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.981+0000 7faa21613640 1 --2- 172.21.15.8:0/1546980512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c06d750 0x7faa1c070e60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009eb0 tx=0x7faa0c004a40 comp rx=0 tx=0).stop 2023-10-14T10:34:37.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.982+0000 7faa21613640 1 -- 172.21.15.8:0/1546980512 shutdown_connections 2023-10-14T10:34:37.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.982+0000 7faa21613640 1 --2- 172.21.15.8:0/1546980512 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa9fc06ae70 0x7fa9fc06d330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:37.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.982+0000 7faa21613640 1 --2- 172.21.15.8:0/1546980512 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faa1c154070 0x7faa1c0be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:37.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.982+0000 7faa21613640 1 --2- 172.21.15.8:0/1546980512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa1c1526b0 0x7faa1c1347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:37.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.982+0000 7faa21613640 1 --2- 172.21.15.8:0/1546980512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa1c06d750 0x7faa1c070e60 secure :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009eb0 tx=0x7faa0c004a40 comp rx=0 tx=0).stop 2023-10-14T10:34:37.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.982+0000 7faa21613640 1 -- 172.21.15.8:0/1546980512 >> 172.21.15.8:0/1546980512 conn(0x7faa1c0c52a0 msgr2=0x7faa1c0aaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:37.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.985+0000 7faa21613640 1 -- 172.21.15.8:0/1546980512 shutdown_connections 2023-10-14T10:34:37.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:37.985+0000 7faa21613640 1 -- 172.21.15.8:0/1546980512 wait complete. 2023-10-14T10:34:38.008 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T10:34:38.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.218+0000 7f0c0f59e640 1 Processor -- start 2023-10-14T10:34:38.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.219+0000 7f0c0f59e640 1 -- start start 2023-10-14T10:34:38.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.220+0000 7f0c0f59e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0c101549a0 0x7f0c1006b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:38.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.220+0000 7f0c0f59e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c1006b660 0x7f0c100c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:38.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.220+0000 7f0c0f59e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c10153f20 con 0x7f0c10151540 2023-10-14T10:34:38.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.220+0000 7f0c0f59e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c100c5a30 con 0x7f0c101549a0 2023-10-14T10:34:38.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.220+0000 7f0c0f59e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c100c5d10 con 0x7f0c1006b660 2023-10-14T10:34:38.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.220+0000 7f0c0dd9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0c101549a0 0x7f0c1006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:38.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.221+0000 7f0c0dd9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0c101549a0 0x7f0c1006b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45886/0 (socket says 172.21.15.8:45886) 2023-10-14T10:34:38.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.221+0000 7f0c0dd9b640 1 -- 172.21.15.8:0/221800138 learned_addr learned my addr 172.21.15.8:0/221800138 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:38.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.221+0000 7f0c0ed9d640 1 --2- 172.21.15.8:0/221800138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c1006b660 0x7f0c100c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:38.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.221+0000 7f0c0dd9b640 1 -- 172.21.15.8:0/221800138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c1006b660 msgr2=0x7f0c100c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:38.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.221+0000 7f0c0dd9b640 1 --2- 172.21.15.8:0/221800138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c1006b660 0x7f0c100c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:38.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.221+0000 7f0c0dd9b640 1 -- 172.21.15.8:0/221800138 >> v1:172.21.15.92:6789/0 conn(0x7f0c10151540 legacy=0x7f0c100c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:38.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.221+0000 7f0c0dd9b640 1 -- 172.21.15.8:0/221800138 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c101541a0 con 0x7f0c101549a0 2023-10-14T10:34:38.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.222+0000 7f0c0dd9b640 1 --2- 172.21.15.8:0/221800138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c101549a0 0x7f0c1006b120 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009870 tx=0x7f0bf802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9cfe60db8ef31b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:38.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.223+0000 7f0c0d59a640 1 -- 172.21.15.8:0/221800138 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8031640 con 0x7f0c101549a0 2023-10-14T10:34:38.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.223+0000 7f0c0d59a640 1 -- 172.21.15.8:0/221800138 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf80317a0 con 0x7f0c101549a0 2023-10-14T10:34:38.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.223+0000 7f0c0d59a640 1 -- 172.21.15.8:0/221800138 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8031b30 con 0x7f0c101549a0 2023-10-14T10:34:38.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.223+0000 7f0c0f59e640 1 -- 172.21.15.8:0/221800138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c101549a0 msgr2=0x7f0c1006b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:38.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.223+0000 7f0c0f59e640 1 --2- 172.21.15.8:0/221800138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c101549a0 0x7f0c1006b120 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009870 tx=0x7f0bf802b8f0 comp rx=0 tx=0).stop 2023-10-14T10:34:38.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.224+0000 7f0c0f59e640 1 -- 172.21.15.8:0/221800138 shutdown_connections 2023-10-14T10:34:38.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.224+0000 7f0c0f59e640 1 --2- 172.21.15.8:0/221800138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c1006b660 0x7f0c100c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:38.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.224+0000 7f0c0f59e640 1 --2- 172.21.15.8:0/221800138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c101549a0 0x7f0c1006b120 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:38.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.224+0000 7f0c0f59e640 1 -- 172.21.15.8:0/221800138 >> 172.21.15.8:0/221800138 conn(0x7f0c100ab110 msgr2=0x7f0c100ab520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:38.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.224+0000 7f0c0f59e640 1 -- 172.21.15.8:0/221800138 shutdown_connections 2023-10-14T10:34:38.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.224+0000 7f0c0f59e640 1 -- 172.21.15.8:0/221800138 wait complete. 2023-10-14T10:34:38.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.225+0000 7f0c0f59e640 1 Processor -- start 2023-10-14T10:34:38.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.226+0000 7f0c0f59e640 1 -- start start 2023-10-14T10:34:38.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.226+0000 7f0c0f59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1006b660 0x7f0c1014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:38.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.226+0000 7f0c0f59e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c10151540 0x7f0c10147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:38.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.226+0000 7f0c0f59e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c101549a0 0x7f0c101476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:38.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.226+0000 7f0c0f59e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c10148990 con 0x7f0c101549a0 2023-10-14T10:34:38.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.226+0000 7f0c0f59e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c101e9b50 con 0x7f0c1006b660 2023-10-14T10:34:38.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.226+0000 7f0c0f59e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c101e9e30 con 0x7f0c10151540 2023-10-14T10:34:38.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.227+0000 7f0c0ed9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c101549a0 0x7f0c101476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:38.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.227+0000 7f0c0ed9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c101549a0 0x7f0c101476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45898/0 (socket says 172.21.15.8:45898) 2023-10-14T10:34:38.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.227+0000 7f0c0ed9d640 1 -- 172.21.15.8:0/2486610664 learned_addr learned my addr 172.21.15.8:0/2486610664 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:38.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.227+0000 7f0c0dd9b640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c10151540 0x7f0c10147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:38.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.227+0000 7f0c0e59c640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1006b660 0x7f0c1014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:38.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.227+0000 7f0c0ed9d640 1 -- 172.21.15.8:0/2486610664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c10151540 msgr2=0x7f0c10147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:38.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.227+0000 7f0c0ed9d640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c10151540 0x7f0c10147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:38.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.227+0000 7f0c0ed9d640 1 -- 172.21.15.8:0/2486610664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1006b660 msgr2=0x7f0c1014ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:38.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.227+0000 7f0c0ed9d640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1006b660 0x7f0c1014ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:38.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.227+0000 7f0c0ed9d640 1 -- 172.21.15.8:0/2486610664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80094d0 con 0x7f0c101549a0 2023-10-14T10:34:38.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.228+0000 7f0c0ed9d640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c101549a0 0x7f0c101476a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800e7f0 tx=0x7f0c0800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:38.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.228+0000 7f0c06ffd640 1 -- 172.21.15.8:0/2486610664 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08009510 con 0x7f0c101549a0 2023-10-14T10:34:38.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.228+0000 7f0c06ffd640 1 -- 172.21.15.8:0/2486610664 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0800ee40 con 0x7f0c101549a0 2023-10-14T10:34:38.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.228+0000 7f0c0f59e640 1 -- 172.21.15.8:0/2486610664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c10146c40 con 0x7f0c101549a0 2023-10-14T10:34:38.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.228+0000 7f0c06ffd640 1 -- 172.21.15.8:0/2486610664 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0800cb80 con 0x7f0c101549a0 2023-10-14T10:34:38.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.228+0000 7f0c0f59e640 1 -- 172.21.15.8:0/2486610664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c101464b0 con 0x7f0c101549a0 2023-10-14T10:34:38.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.229+0000 7f0c0f59e640 1 -- 172.21.15.8:0/2486610664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c10146e80 con 0x7f0c101549a0 2023-10-14T10:34:38.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.230+0000 7f0c06ffd640 1 -- 172.21.15.8:0/2486610664 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0c0800cce0 con 0x7f0c101549a0 2023-10-14T10:34:38.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.231+0000 7f0c06ffd640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0bf006ae70 0x7f0bf006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:38.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.231+0000 7f0c06ffd640 1 -- 172.21.15.8:0/2486610664 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f0c080895b0 con 0x7f0c101549a0 2023-10-14T10:34:38.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.231+0000 7f0c0e59c640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0bf006ae70 0x7f0bf006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:38.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.232+0000 7f0c0e59c640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0bf006ae70 0x7f0bf006d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c00007fd0 tx=0x7f0c00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:38.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.236+0000 7f0c06ffd640 1 -- 172.21.15.8:0/2486610664 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c10146e80 con 0x7f0c101549a0 2023-10-14T10:34:38.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.435+0000 7f0c0f59e640 1 -- 172.21.15.8:0/2486610664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c10146e80 con 0x7f0c101549a0 2023-10-14T10:34:38.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.988+0000 7f0c06ffd640 1 -- 172.21.15.8:0/2486610664 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0c10146e80 con 0x7f0c101549a0 2023-10-14T10:34:38.991 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' removed 2023-10-14T10:34:38.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.992+0000 7f0c0f59e640 1 -- 172.21.15.8:0/2486610664 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0bf006ae70 msgr2=0x7f0bf006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.992+0000 7f0c0f59e640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0bf006ae70 0x7f0bf006d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c00007fd0 tx=0x7f0c00009040 comp rx=0 tx=0).stop 2023-10-14T10:34:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.992+0000 7f0c0f59e640 1 -- 172.21.15.8:0/2486610664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c101549a0 msgr2=0x7f0c101476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:38.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.992+0000 7f0c0f59e640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c101549a0 0x7f0c101476a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800e7f0 tx=0x7f0c0800ebf0 comp rx=0 tx=0).stop 2023-10-14T10:34:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.993+0000 7f0c0f59e640 1 -- 172.21.15.8:0/2486610664 shutdown_connections 2023-10-14T10:34:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.993+0000 7f0c0f59e640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0bf006ae70 0x7f0bf006d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:38.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.993+0000 7f0c0f59e640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c101549a0 0x7f0c101476a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:38.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.993+0000 7f0c0f59e640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c10151540 0x7f0c10147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:38.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.993+0000 7f0c0f59e640 1 --2- 172.21.15.8:0/2486610664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1006b660 0x7f0c1014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:38.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.993+0000 7f0c0f59e640 1 -- 172.21.15.8:0/2486610664 >> 172.21.15.8:0/2486610664 conn(0x7f0c100ab110 msgr2=0x7f0c100733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:38.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.993+0000 7f0c0f59e640 1 -- 172.21.15.8:0/2486610664 shutdown_connections 2023-10-14T10:34:38.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:38.993+0000 7f0c0f59e640 1 -- 172.21.15.8:0/2486610664 wait complete. 2023-10-14T10:34:39.022 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T10:34:39.022 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T10:34:39.023 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T10:34:39.023 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:34:39.023 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T10:34:39.023 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T10:34:39.024 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T10:34:39.024 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:34:39.024 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T10:34:39.025 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T10:34:39.025 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T10:34:39.025 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:34:39.025 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T10:34:39.026 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T10:34:39.026 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T10:34:39.026 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:34:39.040 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T10:34:39.041 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T10:34:39.044 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T10:34:39.044 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T10:34:39.045 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T10:34:39.046 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T10:34:39.047 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T10:34:39.047 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T10:34:39.090 INFO:tasks.ceph.mds.a:Started 2023-10-14T10:34:39.090 DEBUG:teuthology.parallel:result is None 2023-10-14T10:34:39.094 INFO:tasks.ceph.mds.b:Started 2023-10-14T10:34:39.094 DEBUG:teuthology.parallel:result is None 2023-10-14T10:34:39.095 INFO:tasks.ceph.mds.c:Started 2023-10-14T10:34:39.096 DEBUG:teuthology.parallel:result is None 2023-10-14T10:34:39.097 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:34:39.101 INFO:tasks.ceph.mds.d:Started 2023-10-14T10:34:39.101 DEBUG:teuthology.parallel:result is None 2023-10-14T10:34:39.102 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T10:34:39.103 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:34:39.249 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2023-10-14T10:34:39.251 INFO:tasks.ceph.mds.b.smithi092.stdout:starting mds.b at 2023-10-14T10:34:39.253 INFO:tasks.ceph.mds.d.smithi092.stdout:starting mds.d at 2023-10-14T10:34:39.255 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2023-10-14T10:34:39.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.296+0000 7f4e1bdd7640 1 Processor -- start 2023-10-14T10:34:39.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.296+0000 7f4e1bdd7640 1 -- start start 2023-10-14T10:34:39.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.297+0000 7f4e1bdd7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4e14155470 0x7f4e14157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:39.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.297+0000 7f4e1bdd7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e140ca6c0 con 0x7f4e14151590 2023-10-14T10:34:39.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.297+0000 7f4e1bdd7640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e14157a10 con 0x7f4e140c4210 2023-10-14T10:34:39.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.297+0000 7f4e1bdd7640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140c4f70 con 0x7f4e14155470 2023-10-14T10:34:39.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.297+0000 7f4e19b73640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4e14151590 0x7f4e14154a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35402/0 (socket says 172.21.15.8:35402) 2023-10-14T10:34:39.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.297+0000 7f4e19b73640 1 -- 172.21.15.8:0/231729299 learned_addr learned my addr 172.21.15.8:0/231729299 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:39.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.297+0000 7f4e19372640 1 --2- 172.21.15.8:0/231729299 >> v2:172.21.15.8:3300/0 conn(0x7f4e14155470 0x7f4e14157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:39.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.298+0000 7f4e19372640 1 -- 172.21.15.8:0/231729299 >> v1:172.21.15.92:6789/0 conn(0x7f4e140c4210 legacy=0x7f4e1415e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:39.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.298+0000 7f4e19372640 1 -- 172.21.15.8:0/231729299 >> v1:172.21.15.8:6789/0 conn(0x7f4e14151590 legacy=0x7f4e14154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:39.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.298+0000 7f4e19372640 1 -- 172.21.15.8:0/231729299 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e141558b0 con 0x7f4e14155470 2023-10-14T10:34:39.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.299+0000 7f4e19372640 1 --2- 172.21.15.8:0/231729299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e14155470 0x7f4e14157ea0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4e040097a0 tx=0x7f4e0402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703c8005e701cf1b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:39.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.299+0000 7f4e18b71640 1 -- 172.21.15.8:0/231729299 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0402e070 con 0x7f4e14155470 2023-10-14T10:34:39.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.300+0000 7f4e18b71640 1 -- 172.21.15.8:0/231729299 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e040315a0 con 0x7f4e14155470 2023-10-14T10:34:39.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.300+0000 7f4e18b71640 1 -- 172.21.15.8:0/231729299 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04031930 con 0x7f4e14155470 2023-10-14T10:34:39.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.300+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/231729299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e14155470 msgr2=0x7f4e14157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:39.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.300+0000 7f4e1bdd7640 1 --2- 172.21.15.8:0/231729299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e14155470 0x7f4e14157ea0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4e040097a0 tx=0x7f4e0402b840 comp rx=0 tx=0).stop 2023-10-14T10:34:39.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.300+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/231729299 shutdown_connections 2023-10-14T10:34:39.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.300+0000 7f4e1bdd7640 1 --2- 172.21.15.8:0/231729299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e14155470 0x7f4e14157ea0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:39.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.300+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/231729299 >> 172.21.15.8:0/231729299 conn(0x7f4e14065ed0 msgr2=0x7f4e140662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:39.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.300+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/231729299 shutdown_connections 2023-10-14T10:34:39.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.300+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/231729299 wait complete. 2023-10-14T10:34:39.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.302+0000 7f4e1bdd7640 1 Processor -- start 2023-10-14T10:34:39.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.302+0000 7f4e1bdd7640 1 -- start start 2023-10-14T10:34:39.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.303+0000 7f4e1bdd7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e140c4210 0x7f4e141ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:39.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.303+0000 7f4e1bdd7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e14151590 0x7f4e140c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:39.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.303+0000 7f4e1bdd7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e14155470 0x7f4e141e9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:39.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.303+0000 7f4e1bdd7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140bf3f0 con 0x7f4e140c4210 2023-10-14T10:34:39.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.303+0000 7f4e1bdd7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e141eca70 con 0x7f4e14151590 2023-10-14T10:34:39.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.303+0000 7f4e1bdd7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e141ecd50 con 0x7f4e14155470 2023-10-14T10:34:39.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.303+0000 7f4e19b73640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e140c4210 0x7f4e141ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:39.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.303+0000 7f4e19b73640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e140c4210 0x7f4e141ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45946/0 (socket says 172.21.15.8:45946) 2023-10-14T10:34:39.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.303+0000 7f4e19b73640 1 -- 172.21.15.8:0/2312562803 learned_addr learned my addr 172.21.15.8:0/2312562803 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:39.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.303+0000 7f4e1a374640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e14155470 0x7f4e141e9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:39.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.303+0000 7f4e19372640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e14151590 0x7f4e140c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:39.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.304+0000 7f4e19b73640 1 -- 172.21.15.8:0/2312562803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e14155470 msgr2=0x7f4e141e9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:39.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.304+0000 7f4e19b73640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e14155470 0x7f4e141e9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:39.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.304+0000 7f4e19b73640 1 -- 172.21.15.8:0/2312562803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e14151590 msgr2=0x7f4e140c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:39.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.304+0000 7f4e19b73640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e14151590 0x7f4e140c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:39.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.304+0000 7f4e19b73640 1 -- 172.21.15.8:0/2312562803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e04009400 con 0x7f4e140c4210 2023-10-14T10:34:39.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.304+0000 7f4e1a374640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e14155470 0x7f4e141e9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:39.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.304+0000 7f4e19b73640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e140c4210 0x7f4e141ed550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000c480 tx=0x7f4e1000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:39.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.304+0000 7f4e0a7fc640 1 -- 172.21.15.8:0/2312562803 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10005ce0 con 0x7f4e140c4210 2023-10-14T10:34:39.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.304+0000 7f4e0a7fc640 1 -- 172.21.15.8:0/2312562803 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e10005e40 con 0x7f4e140c4210 2023-10-14T10:34:39.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.304+0000 7f4e0a7fc640 1 -- 172.21.15.8:0/2312562803 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e100072f0 con 0x7f4e140c4210 2023-10-14T10:34:39.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.304+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/2312562803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e141ed030 con 0x7f4e140c4210 2023-10-14T10:34:39.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.304+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/2312562803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e140bf6d0 con 0x7f4e140c4210 2023-10-14T10:34:39.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.305+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/2312562803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1404e9b0 con 0x7f4e140c4210 2023-10-14T10:34:39.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.307+0000 7f4e0a7fc640 1 -- 172.21.15.8:0/2312562803 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4e10007510 con 0x7f4e140c4210 2023-10-14T10:34:39.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.308+0000 7f4e0a7fc640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4df806ae70 0x7f4df806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:39.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.308+0000 7f4e0a7fc640 1 -- 172.21.15.8:0/2312562803 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4e100887e0 con 0x7f4e140c4210 2023-10-14T10:34:39.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.308+0000 7f4e19372640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4df806ae70 0x7f4df806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:39.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.309+0000 7f4e19372640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4df806ae70 0x7f4df806d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4e04036000 tx=0x7f4e0403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:39.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.312+0000 7f4e0a7fc640 1 -- 172.21.15.8:0/2312562803 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e10053c30 con 0x7f4e140c4210 2023-10-14T10:34:39.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:39.521+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/2312562803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4e1406cb50 con 0x7f4e140c4210 2023-10-14T10:34:40.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.011+0000 7f4e0a7fc640 1 -- 172.21.15.8:0/2312562803 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4e10017080 con 0x7f4e140c4210 2023-10-14T10:34:40.014 INFO:teuthology.orchestra.run.smithi008.stderr: removed all blocklist entries 2023-10-14T10:34:40.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.015+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/2312562803 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4df806ae70 msgr2=0x7f4df806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.015+0000 7f4e1bdd7640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4df806ae70 0x7f4df806d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4e04036000 tx=0x7f4e0403d040 comp rx=0 tx=0).stop 2023-10-14T10:34:40.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.015+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/2312562803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e140c4210 msgr2=0x7f4e141ed550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.015+0000 7f4e1bdd7640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e140c4210 0x7f4e141ed550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000c480 tx=0x7f4e1000c940 comp rx=0 tx=0).stop 2023-10-14T10:34:40.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.015+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/2312562803 shutdown_connections 2023-10-14T10:34:40.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.015+0000 7f4e1bdd7640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4df806ae70 0x7f4df806d330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.015+0000 7f4e1bdd7640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e14155470 0x7f4e141e9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.015+0000 7f4e1bdd7640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e14151590 0x7f4e140c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.015+0000 7f4e1bdd7640 1 --2- 172.21.15.8:0/2312562803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e140c4210 0x7f4e141ed550 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.015+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/2312562803 >> 172.21.15.8:0/2312562803 conn(0x7f4e14065ed0 msgr2=0x7f4e14156930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:40.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.015+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/2312562803 shutdown_connections 2023-10-14T10:34:40.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.016+0000 7f4e1bdd7640 1 -- 172.21.15.8:0/2312562803 wait complete. 2023-10-14T10:34:40.041 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T10:34:40.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.249+0000 7f9e76321640 1 Processor -- start 2023-10-14T10:34:40.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.249+0000 7f9e76321640 1 -- start start 2023-10-14T10:34:40.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.251+0000 7f9e76321640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e700c2380 0x7f9e70070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.251+0000 7f9e76321640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e700719e0 con 0x7f9e700c06f0 2023-10-14T10:34:40.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.251+0000 7f9e76321640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e70071cc0 con 0x7f9e70071550 2023-10-14T10:34:40.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.251+0000 7f9e76321640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e70071190 con 0x7f9e700c2380 2023-10-14T10:34:40.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.251+0000 7f9e7531f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e700c2380 0x7f9e70070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:40.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.251+0000 7f9e7531f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e700c2380 0x7f9e70070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45958/0 (socket says 172.21.15.8:45958) 2023-10-14T10:34:40.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.251+0000 7f9e75b20640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9e700c06f0 0x7f9e701511a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35408/0 (socket says 172.21.15.8:35408) 2023-10-14T10:34:40.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.251+0000 7f9e7531f640 1 -- 172.21.15.8:0/3210539068 learned_addr learned my addr 172.21.15.8:0/3210539068 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:40.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.252+0000 7f9e7531f640 1 -- 172.21.15.8:0/3210539068 >> v1:172.21.15.92:6789/0 conn(0x7f9e70071550 legacy=0x7f9e700a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:40.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.252+0000 7f9e7531f640 1 -- 172.21.15.8:0/3210539068 >> v1:172.21.15.8:6789/0 conn(0x7f9e700c06f0 legacy=0x7f9e701511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.252+0000 7f9e7531f640 1 -- 172.21.15.8:0/3210539068 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e70071fa0 con 0x7f9e700c2380 2023-10-14T10:34:40.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.253+0000 7f9e7531f640 1 --2- 172.21.15.8:0/3210539068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e700c2380 0x7f9e70070c50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009870 tx=0x7f9e6c02b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f3bbbf318ac038 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:40.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.253+0000 7f9e67fff640 1 -- 172.21.15.8:0/3210539068 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c030850 con 0x7f9e700c2380 2023-10-14T10:34:40.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.253+0000 7f9e67fff640 1 -- 172.21.15.8:0/3210539068 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c0309b0 con 0x7f9e700c2380 2023-10-14T10:34:40.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.253+0000 7f9e67fff640 1 -- 172.21.15.8:0/3210539068 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c030d40 con 0x7f9e700c2380 2023-10-14T10:34:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.254+0000 7f9e76321640 1 -- 172.21.15.8:0/3210539068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e700c2380 msgr2=0x7f9e70070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.254+0000 7f9e76321640 1 --2- 172.21.15.8:0/3210539068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e700c2380 0x7f9e70070c50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009870 tx=0x7f9e6c02b990 comp rx=0 tx=0).stop 2023-10-14T10:34:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.254+0000 7f9e76321640 1 -- 172.21.15.8:0/3210539068 shutdown_connections 2023-10-14T10:34:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.254+0000 7f9e76321640 1 --2- 172.21.15.8:0/3210539068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e700c2380 0x7f9e70070c50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.254+0000 7f9e76321640 1 -- 172.21.15.8:0/3210539068 >> 172.21.15.8:0/3210539068 conn(0x7f9e7006a200 msgr2=0x7f9e7006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:40.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.254+0000 7f9e76321640 1 -- 172.21.15.8:0/3210539068 shutdown_connections 2023-10-14T10:34:40.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.254+0000 7f9e76321640 1 -- 172.21.15.8:0/3210539068 wait complete. 2023-10-14T10:34:40.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.256+0000 7f9e76321640 1 Processor -- start 2023-10-14T10:34:40.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.256+0000 7f9e76321640 1 -- start start 2023-10-14T10:34:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e76321640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e700c06f0 0x7f9e7014fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e76321640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e700c2380 0x7f9e701e6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e76321640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e70154ba0 0x7f9e701e68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e76321640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e70152920 con 0x7f9e70154ba0 2023-10-14T10:34:40.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e76321640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e701e6e00 con 0x7f9e700c06f0 2023-10-14T10:34:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e76321640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e701e9b70 con 0x7f9e700c2380 2023-10-14T10:34:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e75b20640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e70154ba0 0x7f9e701e68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e75b20640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e70154ba0 0x7f9e701e68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45974/0 (socket says 172.21.15.8:45974) 2023-10-14T10:34:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e75b20640 1 -- 172.21.15.8:0/4017280365 learned_addr learned my addr 172.21.15.8:0/4017280365 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:40.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e7531f640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e700c06f0 0x7f9e7014fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:40.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e75b20640 1 -- 172.21.15.8:0/4017280365 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e700c2380 msgr2=0x7f9e701e6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e75b20640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e700c2380 0x7f9e701e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e75b20640 1 -- 172.21.15.8:0/4017280365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e700c06f0 msgr2=0x7f9e7014fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e75b20640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e700c06f0 0x7f9e7014fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.257+0000 7f9e75b20640 1 -- 172.21.15.8:0/4017280365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c0094d0 con 0x7f9e70154ba0 2023-10-14T10:34:40.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.258+0000 7f9e75b20640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e70154ba0 0x7f9e701e68c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800c780 tx=0x7f9e6800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:40.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.258+0000 7f9e65ffb640 1 -- 172.21.15.8:0/4017280365 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6800ce90 con 0x7f9e70154ba0 2023-10-14T10:34:40.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.258+0000 7f9e65ffb640 1 -- 172.21.15.8:0/4017280365 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6800a5e0 con 0x7f9e70154ba0 2023-10-14T10:34:40.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.258+0000 7f9e65ffb640 1 -- 172.21.15.8:0/4017280365 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6800a990 con 0x7f9e70154ba0 2023-10-14T10:34:40.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.258+0000 7f9e76321640 1 -- 172.21.15.8:0/4017280365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7006d7b0 con 0x7f9e70154ba0 2023-10-14T10:34:40.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.258+0000 7f9e76321640 1 -- 172.21.15.8:0/4017280365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e700c4f50 con 0x7f9e70154ba0 2023-10-14T10:34:40.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.259+0000 7f9e76321640 1 -- 172.21.15.8:0/4017280365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e701e9ce0 con 0x7f9e70154ba0 2023-10-14T10:34:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.260+0000 7f9e65ffb640 1 -- 172.21.15.8:0/4017280365 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9e6800aaf0 con 0x7f9e70154ba0 2023-10-14T10:34:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.261+0000 7f9e65ffb640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9e5406ae70 0x7f9e5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.261+0000 7f9e65ffb640 1 -- 172.21.15.8:0/4017280365 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9e680889a0 con 0x7f9e70154ba0 2023-10-14T10:34:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.261+0000 7f9e7531f640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9e5406ae70 0x7f9e5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.262+0000 7f9e7531f640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9e5406ae70 0x7f9e5406d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c036000 tx=0x7f9e6c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:40.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.265+0000 7f9e65ffb640 1 -- 172.21.15.8:0/4017280365 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e68053e40 con 0x7f9e70154ba0 2023-10-14T10:34:40.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.528+0000 7f9e76321640 1 -- 172.21.15.8:0/4017280365 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9e7004e9b0 con 0x7f9e70154ba0 2023-10-14T10:34:40.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.529+0000 7f9e65ffb640 1 -- 172.21.15.8:0/4017280365 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f9e68017020 con 0x7f9e70154ba0 2023-10-14T10:34:40.531 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:40.532 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:34:40.532 INFO:teuthology.orchestra.run.smithi008.stdout: "auth_dump": [ 2023-10-14T10:34:40.532 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.532 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.a", 2023-10-14T10:34:40.533 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBKbiplIfZ0ORAAzxvyFvrMMtE4TZo5N6G02A==", 2023-10-14T10:34:40.533 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.533 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-14T10:34:40.533 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-10-14T10:34:40.533 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-10-14T10:34:40.534 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.534 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.534 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.534 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.b", 2023-10-14T10:34:40.535 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBLbiplfHerHRAACauumrzP2V67TiqmBsYYyw==", 2023-10-14T10:34:40.535 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.535 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-14T10:34:40.535 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-10-14T10:34:40.535 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-10-14T10:34:40.536 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.536 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.536 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.536 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.c", 2023-10-14T10:34:40.537 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBLbiplIqAoDRAAjxtn5CLFYxRk/saVH1hCsw==", 2023-10-14T10:34:40.537 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.537 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-14T10:34:40.537 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-10-14T10:34:40.537 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-10-14T10:34:40.538 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.538 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.538 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.538 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.d", 2023-10-14T10:34:40.539 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBLbiplznWrLRAAJLhxw+3FKycDGT7WlRe7kQ==", 2023-10-14T10:34:40.539 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.539 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-14T10:34:40.539 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-10-14T10:34:40.539 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-10-14T10:34:40.539 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.540 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.540 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.540 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.0", 2023-10-14T10:34:40.540 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBObipleVjlBhAAJ9li83jkhcTmES65Gmvy2A==", 2023-10-14T10:34:40.541 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.541 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-14T10:34:40.541 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-14T10:34:40.541 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.541 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.542 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.542 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.1", 2023-10-14T10:34:40.542 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBRbiplK8XiIBAA5Fd7lWuAKH2ZByZSAWEMxA==", 2023-10-14T10:34:40.542 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.543 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-14T10:34:40.543 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-14T10:34:40.543 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.543 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.544 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.544 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.2", 2023-10-14T10:34:40.544 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBUbipl3ZuJOhAAo5GZgRoXSGAvj4JKrGvp2Q==", 2023-10-14T10:34:40.544 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.544 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-14T10:34:40.545 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-14T10:34:40.545 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.545 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.545 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.3", 2023-10-14T10:34:40.546 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBYbiplNVJUFxAAwx4hcnN+XZzBUc7J14d+jw==", 2023-10-14T10:34:40.546 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.546 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-14T10:34:40.546 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-14T10:34:40.546 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.547 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.547 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.547 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.4", 2023-10-14T10:34:40.547 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBfbipl9aeiJRAAaxnuP8mRSVGbRlwgOaHwHA==", 2023-10-14T10:34:40.548 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.548 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-14T10:34:40.548 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-14T10:34:40.548 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.548 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.549 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.549 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.549 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.5", 2023-10-14T10:34:40.549 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBjbiplh3G+AxAA5mMOlOgWGHeYj9aPXJ89iw==", 2023-10-14T10:34:40.549 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.549 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-14T10:34:40.550 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-14T10:34:40.550 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.550 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.550 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.551 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.6", 2023-10-14T10:34:40.551 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBmbiplUPG5GxAAYbxO3vvKYD8Y1b/oa8+jig==", 2023-10-14T10:34:40.551 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.551 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-14T10:34:40.551 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-14T10:34:40.552 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.552 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.552 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.552 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.7", 2023-10-14T10:34:40.552 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBpbiplJ1ibNxAAmewjPrVbOVUubYa+vPH2kg==", 2023-10-14T10:34:40.553 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.553 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2023-10-14T10:34:40.553 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2023-10-14T10:34:40.553 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.553 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.554 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.554 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.554 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.0", 2023-10-14T10:34:40.554 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBLbiplEpMMOxAAFJoRo9wSqT02h3Z28vhhgQ==", 2023-10-14T10:34:40.554 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.555 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-14T10:34:40.555 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2023-10-14T10:34:40.555 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2023-10-14T10:34:40.555 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2023-10-14T10:34:40.555 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.556 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.556 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.1", 2023-10-14T10:34:40.556 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBMbiplL295ChAAx54HRTAqn5jA5DhVcC1MnQ==", 2023-10-14T10:34:40.556 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.557 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2023-10-14T10:34:40.557 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2023-10-14T10:34:40.557 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2023-10-14T10:34:40.557 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2023-10-14T10:34:40.557 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.558 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.558 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.admin", 2023-10-14T10:34:40.558 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBJbiplfo7aKxAAjxvpBs5bt4vjWehjpUZQkw==", 2023-10-14T10:34:40.558 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.559 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2023-10-14T10:34:40.559 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2023-10-14T10:34:40.559 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2023-10-14T10:34:40.559 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.559 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.560 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.560 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-mds", 2023-10-14T10:34:40.560 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB3biplHq6rHBAAA6dMOB9BCWBf3nJTP/20tA==", 2023-10-14T10:34:40.560 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.560 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-mds" 2023-10-14T10:34:40.561 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.561 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.561 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-mgr", 2023-10-14T10:34:40.561 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB3biplBMyrHBAAO+/cNEbJPvzo1dJvDiUT2g==", 2023-10-14T10:34:40.562 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.562 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-14T10:34:40.562 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.562 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.563 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-osd", 2023-10-14T10:34:40.563 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB3bipl8OSrHBAAqTrWCeww769TCmzTNudivA==", 2023-10-14T10:34:40.563 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.563 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-osd" 2023-10-14T10:34:40.563 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.564 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.564 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-rbd", 2023-10-14T10:34:40.564 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB3biplc2CsHBAAg+NkeJkrNKRG3GGeE9e4sQ==", 2023-10-14T10:34:40.564 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.565 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-14T10:34:40.565 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.565 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.565 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-14T10:34:40.565 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB3biplAn6sHBAAc1JjT2qR6w7VOSbc7YchTA==", 2023-10-14T10:34:40.566 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.566 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-14T10:34:40.566 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.566 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.566 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.567 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-rgw", 2023-10-14T10:34:40.567 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB3biplr5esHBAASXBzhC7LuDGZHtphYwpgRw==", 2023-10-14T10:34:40.567 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.567 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-14T10:34:40.567 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.568 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.568 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mgr.x", 2023-10-14T10:34:40.568 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBKbiplZ7dyLhAAx2sk5bhKg1d0xEmNILAbxw==", 2023-10-14T10:34:40.568 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.569 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2023-10-14T10:34:40.569 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile mgr", 2023-10-14T10:34:40.569 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.569 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T10:34:40.569 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:40.570 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mgr.y", 2023-10-14T10:34:40.570 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQBKbiplz3SXIRAAY/z2yYJwA7ebu+XpyDktYw==", 2023-10-14T10:34:40.570 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2023-10-14T10:34:40.570 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2023-10-14T10:34:40.570 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile mgr", 2023-10-14T10:34:40.571 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2023-10-14T10:34:40.571 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.571 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:40.571 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-14T10:34:40.571 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:34:40.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.532+0000 7f9e76321640 1 -- 172.21.15.8:0/4017280365 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9e5406ae70 msgr2=0x7f9e5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.532+0000 7f9e76321640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9e5406ae70 0x7f9e5406d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c036000 tx=0x7f9e6c03b040 comp rx=0 tx=0).stop 2023-10-14T10:34:40.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.532+0000 7f9e76321640 1 -- 172.21.15.8:0/4017280365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e70154ba0 msgr2=0x7f9e701e68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.532+0000 7f9e76321640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e70154ba0 0x7f9e701e68c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800c780 tx=0x7f9e6800cc40 comp rx=0 tx=0).stop 2023-10-14T10:34:40.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.532+0000 7f9e76321640 1 -- 172.21.15.8:0/4017280365 shutdown_connections 2023-10-14T10:34:40.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.532+0000 7f9e76321640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9e5406ae70 0x7f9e5406d330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.532+0000 7f9e76321640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e70154ba0 0x7f9e701e68c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.532+0000 7f9e76321640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9e700c2380 0x7f9e701e6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.532+0000 7f9e76321640 1 --2- 172.21.15.8:0/4017280365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e700c06f0 0x7f9e7014fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.532+0000 7f9e76321640 1 -- 172.21.15.8:0/4017280365 >> 172.21.15.8:0/4017280365 conn(0x7f9e7006a200 msgr2=0x7f9e70150f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.532+0000 7f9e76321640 1 -- 172.21.15.8:0/4017280365 shutdown_connections 2023-10-14T10:34:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.532+0000 7f9e76321640 1 -- 172.21.15.8:0/4017280365 wait complete. 2023-10-14T10:34:40.576 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-14T10:34:40.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.803+0000 7fa19274e640 1 Processor -- start 2023-10-14T10:34:40.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.804+0000 7fa19274e640 1 -- start start 2023-10-14T10:34:40.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.805+0000 7fa19274e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa18c0c43a0 0x7fa18c0c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.805+0000 7fa19274e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18c0c4e30 con 0x7fa18c151420 2023-10-14T10:34:40.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.805+0000 7fa19274e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18c0c5d00 con 0x7fa18c0c5610 2023-10-14T10:34:40.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.805+0000 7fa19274e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c0c5450 con 0x7fa18c0c43a0 2023-10-14T10:34:40.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.805+0000 7fa19174c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa18c151420 0x7fa18c0c75c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35416/0 (socket says 172.21.15.8:35416) 2023-10-14T10:34:40.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.805+0000 7fa19174c640 1 -- 172.21.15.8:0/741401243 learned_addr learned my addr 172.21.15.8:0/741401243 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:40.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972093829 0 0) 0x7fa188001490 con 0x7fa18c151420 2023-10-14T10:34:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa190f4b640 1 --2- 172.21.15.8:0/741401243 >> v2:172.21.15.92:3300/0 conn(0x7fa18c0c43a0 0x7fa18c0c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa178003520 con 0x7fa18c151420 2023-10-14T10:34:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 547476170 0 0) 0x7fa178003520 con 0x7fa18c151420 2023-10-14T10:34:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 >> v2:172.21.15.92:3300/0 conn(0x7fa18c0c43a0 msgr2=0x7fa18c0c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 --2- 172.21.15.8:0/741401243 >> v2:172.21.15.92:3300/0 conn(0x7fa18c0c43a0 0x7fa18c0c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 >> v1:172.21.15.92:6789/0 conn(0x7fa18c0c5610 legacy=0x7fa18c06ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c0c5170 con 0x7fa18c151420 2023-10-14T10:34:40.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fa188001b80 con 0x7fa18c151420 2023-10-14T10:34:40.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa190f4b640 1 --2- 172.21.15.8:0/741401243 >> v2:172.21.15.92:3300/0 conn(0x7fa18c0c43a0 0x7fa18c0c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 >> v1:172.21.15.8:6789/0 conn(0x7fa18c151420 legacy=0x7fa18c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 --2- 172.21.15.8:0/741401243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1780039c0 0x7fa178003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 --2- 172.21.15.8:0/741401243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 0x7fa178004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 --2- 172.21.15.8:0/741401243 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1780052a0 0x7fa17800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0c5450 con 0x7fa1780047c0 2023-10-14T10:34:40.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17800c1c0 con 0x7fa1780039c0 2023-10-14T10:34:40.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.806+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17800c380 con 0x7fa1780052a0 2023-10-14T10:34:40.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.807+0000 7fa190f4b640 1 --2- 172.21.15.8:0/741401243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 0x7fa178004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:40.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.807+0000 7fa19174c640 1 --2- 172.21.15.8:0/741401243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1780039c0 0x7fa178003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:40.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.807+0000 7fa191f4d640 1 --2- 172.21.15.8:0/741401243 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1780052a0 0x7fa17800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:40.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.807+0000 7fa190f4b640 1 -- 172.21.15.8:0/741401243 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1780052a0 msgr2=0x7fa17800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:40.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.807+0000 7fa190f4b640 1 --2- 172.21.15.8:0/741401243 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1780052a0 0x7fa17800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.807+0000 7fa190f4b640 1 -- 172.21.15.8:0/741401243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1780039c0 msgr2=0x7fa178003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:40.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.807+0000 7fa190f4b640 1 --2- 172.21.15.8:0/741401243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1780039c0 0x7fa178003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.807+0000 7fa190f4b640 1 -- 172.21.15.8:0/741401243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa178003520 con 0x7fa1780047c0 2023-10-14T10:34:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.807+0000 7fa191f4d640 1 --2- 172.21.15.8:0/741401243 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1780052a0 0x7fa17800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.807+0000 7fa191f4d640 1 -- 172.21.15.8:0/741401243 reap_dead start 2023-10-14T10:34:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.808+0000 7fa190f4b640 1 --2- 172.21.15.8:0/741401243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 0x7fa178004c40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0098a0 tx=0x7fa1780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4236812b0bdde7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:40.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.809+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c004230 con 0x7fa1780047c0 2023-10-14T10:34:40.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.809+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c004390 con 0x7fa1780047c0 2023-10-14T10:34:40.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.809+0000 7fa183fff640 1 -- 172.21.15.8:0/741401243 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c003830 con 0x7fa1780047c0 2023-10-14T10:34:40.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.809+0000 7fa19274e640 1 -- 172.21.15.8:0/741401243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 msgr2=0x7fa178004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.809+0000 7fa19274e640 1 --2- 172.21.15.8:0/741401243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 0x7fa178004c40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0098a0 tx=0x7fa1780057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.809+0000 7fa19274e640 1 -- 172.21.15.8:0/741401243 shutdown_connections 2023-10-14T10:34:40.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.809+0000 7fa19274e640 1 --2- 172.21.15.8:0/741401243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 0x7fa178004c40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.809+0000 7fa19274e640 1 -- 172.21.15.8:0/741401243 >> 172.21.15.8:0/741401243 conn(0x7fa18c0c96c0 msgr2=0x7fa18c0c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:40.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.809+0000 7fa19274e640 1 -- 172.21.15.8:0/741401243 shutdown_connections 2023-10-14T10:34:40.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.809+0000 7fa19274e640 1 -- 172.21.15.8:0/741401243 wait complete. 2023-10-14T10:34:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.811+0000 7fa19274e640 1 Processor -- start 2023-10-14T10:34:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.811+0000 7fa19274e640 1 -- start start 2023-10-14T10:34:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.812+0000 7fa19274e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 0x7fa18c14c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.812+0000 7fa19274e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa18c158080 0x7fa18c156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.812+0000 7fa19274e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa18c14b8b0 0x7fa18c156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.812+0000 7fa19274e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c14e640 con 0x7fa1780047c0 2023-10-14T10:34:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.812+0000 7fa19274e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0c01c0 con 0x7fa18c14b8b0 2023-10-14T10:34:40.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.812+0000 7fa19274e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0c0430 con 0x7fa18c158080 2023-10-14T10:34:40.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.812+0000 7fa19174c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 0x7fa18c14c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:40.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.812+0000 7fa19174c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 0x7fa18c14c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45990/0 (socket says 172.21.15.8:45990) 2023-10-14T10:34:40.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.812+0000 7fa19174c640 1 -- 172.21.15.8:0/3300166773 learned_addr learned my addr 172.21.15.8:0/3300166773 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:40.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.813+0000 7fa190f4b640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa18c158080 0x7fa18c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:40.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.813+0000 7fa191f4d640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa18c14b8b0 0x7fa18c156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:40.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.813+0000 7fa19174c640 1 -- 172.21.15.8:0/3300166773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa18c158080 msgr2=0x7fa18c156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.813+0000 7fa19174c640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa18c158080 0x7fa18c156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.813+0000 7fa19174c640 1 -- 172.21.15.8:0/3300166773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa18c14b8b0 msgr2=0x7fa18c156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:40.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.813+0000 7fa19174c640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa18c14b8b0 0x7fa18c156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:40.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.813+0000 7fa19174c640 1 -- 172.21.15.8:0/3300166773 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c14cc20 con 0x7fa1780047c0 2023-10-14T10:34:40.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.813+0000 7fa191f4d640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa18c14b8b0 0x7fa18c156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:40.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.813+0000 7fa19174c640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 0x7fa18c14c6e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa188007a40 tx=0x7fa18800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:40.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.814+0000 7fa181ffb640 1 -- 172.21.15.8:0/3300166773 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18800ee50 con 0x7fa1780047c0 2023-10-14T10:34:40.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.814+0000 7fa181ffb640 1 -- 172.21.15.8:0/3300166773 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa188013420 con 0x7fa1780047c0 2023-10-14T10:34:40.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.814+0000 7fa181ffb640 1 -- 172.21.15.8:0/3300166773 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880137d0 con 0x7fa1780047c0 2023-10-14T10:34:40.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.814+0000 7fa19274e640 1 -- 172.21.15.8:0/3300166773 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c14e280 con 0x7fa1780047c0 2023-10-14T10:34:40.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.814+0000 7fa19274e640 1 -- 172.21.15.8:0/3300166773 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c157730 con 0x7fa1780047c0 2023-10-14T10:34:40.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.815+0000 7fa19274e640 1 -- 172.21.15.8:0/3300166773 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18c14e470 con 0x7fa1780047c0 2023-10-14T10:34:40.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.816+0000 7fa181ffb640 1 -- 172.21.15.8:0/3300166773 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa188013930 con 0x7fa1780047c0 2023-10-14T10:34:40.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.817+0000 7fa181ffb640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa17006aea0 0x7fa17006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:40.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.817+0000 7fa181ffb640 1 -- 172.21.15.8:0/3300166773 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa188089940 con 0x7fa1780047c0 2023-10-14T10:34:40.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.817+0000 7fa190f4b640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa17006aea0 0x7fa17006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:40.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.818+0000 7fa190f4b640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa17006aea0 0x7fa17006d360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa17c035000 tx=0x7fa17c03a040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:40.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:40.821+0000 7fa181ffb640 1 -- 172.21.15.8:0/3300166773 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1880587c0 con 0x7fa1780047c0 2023-10-14T10:34:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.096+0000 7fa19274e640 1 -- 172.21.15.8:0/3300166773 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fa18c0c4e30 con 0x7fa1780047c0 2023-10-14T10:34:41.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.101+0000 7fa181ffb640 1 -- 172.21.15.8:0/3300166773 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa18c0c4e30 con 0x7fa1780047c0 2023-10-14T10:34:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.103+0000 7fa19274e640 1 -- 172.21.15.8:0/3300166773 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa17006aea0 msgr2=0x7fa17006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.103+0000 7fa19274e640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa17006aea0 0x7fa17006d360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa17c035000 tx=0x7fa17c03a040 comp rx=0 tx=0).stop 2023-10-14T10:34:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.103+0000 7fa19274e640 1 -- 172.21.15.8:0/3300166773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 msgr2=0x7fa18c14c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:41.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.103+0000 7fa19274e640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 0x7fa18c14c6e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa188007a40 tx=0x7fa18800e530 comp rx=0 tx=0).stop 2023-10-14T10:34:41.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.104+0000 7fa19274e640 1 -- 172.21.15.8:0/3300166773 shutdown_connections 2023-10-14T10:34:41.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.104+0000 7fa19274e640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa17006aea0 0x7fa17006d360 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.104+0000 7fa19274e640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa18c14b8b0 0x7fa18c156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.104+0000 7fa19274e640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa18c158080 0x7fa18c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.104+0000 7fa19274e640 1 --2- 172.21.15.8:0/3300166773 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1780047c0 0x7fa18c14c6e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.104+0000 7fa19274e640 1 -- 172.21.15.8:0/3300166773 >> 172.21.15.8:0/3300166773 conn(0x7fa18c0c96c0 msgr2=0x7fa18c14ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:41.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.104+0000 7fa19274e640 1 -- 172.21.15.8:0/3300166773 shutdown_connections 2023-10-14T10:34:41.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.104+0000 7fa19274e640 1 -- 172.21.15.8:0/3300166773 wait complete. 2023-10-14T10:34:41.126 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-14T10:34:41.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.348+0000 7fb833fff640 1 Processor -- start 2023-10-14T10:34:41.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.348+0000 7fb833fff640 1 -- start start 2023-10-14T10:34:41.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.349+0000 7fb833fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb8340c43a0 0x7fb8340c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:41.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.349+0000 7fb833fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb8340c5610 0x7fb83406ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.349+0000 7fb833fff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8340c4e30 con 0x7fb834151420 2023-10-14T10:34:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.349+0000 7fb833fff640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8340c5450 con 0x7fb8340c43a0 2023-10-14T10:34:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.349+0000 7fb833fff640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb834154950 con 0x7fb8340c5610 2023-10-14T10:34:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.349+0000 7fb8327fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb8340c43a0 0x7fb8340c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.349+0000 7fb832ffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb834151420 0x7fb8340c75c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35428/0 (socket says 172.21.15.8:35428) 2023-10-14T10:34:41.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.349+0000 7fb832ffd640 1 -- 172.21.15.8:0/3190650708 learned_addr learned my addr 172.21.15.8:0/3190650708 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:41.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.349+0000 7fb8327fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb8340c43a0 0x7fb8340c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46004/0 (socket says 172.21.15.8:46004) 2023-10-14T10:34:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.350+0000 7fb8337fe640 1 --2- 172.21.15.8:0/3190650708 >> v2:172.21.15.92:3300/0 conn(0x7fb8340c5610 0x7fb83406ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:41.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.350+0000 7fb8327fc640 1 -- 172.21.15.8:0/3190650708 >> v2:172.21.15.92:3300/0 conn(0x7fb8340c5610 msgr2=0x7fb83406ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.350+0000 7fb8327fc640 1 --2- 172.21.15.8:0/3190650708 >> v2:172.21.15.92:3300/0 conn(0x7fb8340c5610 0x7fb83406ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.350+0000 7fb8327fc640 1 -- 172.21.15.8:0/3190650708 >> v1:172.21.15.8:6789/0 conn(0x7fb834151420 legacy=0x7fb8340c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.350+0000 7fb8327fc640 1 -- 172.21.15.8:0/3190650708 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8340c5d00 con 0x7fb8340c43a0 2023-10-14T10:34:41.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.350+0000 7fb831ffb640 1 -- 172.21.15.8:0/3190650708 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832448605 0 0) 0x7fb824001110 con 0x7fb834151420 2023-10-14T10:34:41.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.351+0000 7fb8327fc640 1 --2- 172.21.15.8:0/3190650708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8340c43a0 0x7fb8340c48f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb83406c480 tx=0x7fb81c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be63664ce617c9bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:41.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.352+0000 7fb831ffb640 1 -- 172.21.15.8:0/3190650708 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c02cbf0 con 0x7fb8340c43a0 2023-10-14T10:34:41.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.352+0000 7fb831ffb640 1 -- 172.21.15.8:0/3190650708 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c02cd50 con 0x7fb8340c43a0 2023-10-14T10:34:41.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.352+0000 7fb831ffb640 1 -- 172.21.15.8:0/3190650708 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c034660 con 0x7fb8340c43a0 2023-10-14T10:34:41.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.352+0000 7fb833fff640 1 -- 172.21.15.8:0/3190650708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8340c43a0 msgr2=0x7fb8340c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.352+0000 7fb833fff640 1 --2- 172.21.15.8:0/3190650708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8340c43a0 0x7fb8340c48f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb83406c480 tx=0x7fb81c02be40 comp rx=0 tx=0).stop 2023-10-14T10:34:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.352+0000 7fb833fff640 1 -- 172.21.15.8:0/3190650708 shutdown_connections 2023-10-14T10:34:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.352+0000 7fb833fff640 1 --2- 172.21.15.8:0/3190650708 >> v2:172.21.15.92:3300/0 conn(0x7fb8340c5610 0x7fb83406ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.352+0000 7fb833fff640 1 --2- 172.21.15.8:0/3190650708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8340c43a0 0x7fb8340c48f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.352+0000 7fb833fff640 1 -- 172.21.15.8:0/3190650708 >> 172.21.15.8:0/3190650708 conn(0x7fb8340c96c0 msgr2=0x7fb8340c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:41.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.352+0000 7fb833fff640 1 -- 172.21.15.8:0/3190650708 shutdown_connections 2023-10-14T10:34:41.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.353+0000 7fb833fff640 1 -- 172.21.15.8:0/3190650708 wait complete. 2023-10-14T10:34:41.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.354+0000 7fb833fff640 1 Processor -- start 2023-10-14T10:34:41.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.354+0000 7fb833fff640 1 -- start start 2023-10-14T10:34:41.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.355+0000 7fb833fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8340c43a0 0x7fb834157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:41.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.355+0000 7fb833fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8340c5610 0x7fb834157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:41.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.355+0000 7fb833fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb834151420 0x7fb8341ec850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:41.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.355+0000 7fb833fff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340aca20 con 0x7fb8340c5610 2023-10-14T10:34:41.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.355+0000 7fb833fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83414d110 con 0x7fb8340c43a0 2023-10-14T10:34:41.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.355+0000 7fb833fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83414d3d0 con 0x7fb834151420 2023-10-14T10:34:41.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.355+0000 7fb8327fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8340c5610 0x7fb834157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:41.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.356+0000 7fb8327fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8340c5610 0x7fb834157f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46008/0 (socket says 172.21.15.8:46008) 2023-10-14T10:34:41.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.356+0000 7fb8327fc640 1 -- 172.21.15.8:0/301647849 learned_addr learned my addr 172.21.15.8:0/301647849 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:41.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.356+0000 7fb832ffd640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8340c43a0 0x7fb834157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:41.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.356+0000 7fb8337fe640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb834151420 0x7fb8341ec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:41.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.356+0000 7fb8327fc640 1 -- 172.21.15.8:0/301647849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb834151420 msgr2=0x7fb8341ec850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:41.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.356+0000 7fb8327fc640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb834151420 0x7fb8341ec850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.356+0000 7fb8327fc640 1 -- 172.21.15.8:0/301647849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8340c43a0 msgr2=0x7fb834157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:41.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.356+0000 7fb8327fc640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8340c43a0 0x7fb834157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.356+0000 7fb8327fc640 1 -- 172.21.15.8:0/301647849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c009a70 con 0x7fb8340c5610 2023-10-14T10:34:41.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.356+0000 7fb8327fc640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8340c5610 0x7fb834157f70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb81c037040 tx=0x7fb81c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:41.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.357+0000 7fb82b7fe640 1 -- 172.21.15.8:0/301647849 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c040650 con 0x7fb8340c5610 2023-10-14T10:34:41.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.357+0000 7fb82b7fe640 1 -- 172.21.15.8:0/301647849 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c0407b0 con 0x7fb8340c5610 2023-10-14T10:34:41.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.357+0000 7fb82b7fe640 1 -- 172.21.15.8:0/301647849 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c040b60 con 0x7fb8340c5610 2023-10-14T10:34:41.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.357+0000 7fb833fff640 1 -- 172.21.15.8:0/301647849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83414d6b0 con 0x7fb8340c5610 2023-10-14T10:34:41.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.357+0000 7fb833fff640 1 -- 172.21.15.8:0/301647849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83414dc70 con 0x7fb8340c5610 2023-10-14T10:34:41.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.358+0000 7fb833fff640 1 -- 172.21.15.8:0/301647849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8340619f0 con 0x7fb8340c5610 2023-10-14T10:34:41.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.359+0000 7fb82b7fe640 1 -- 172.21.15.8:0/301647849 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb81c040cc0 con 0x7fb8340c5610 2023-10-14T10:34:41.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.360+0000 7fb82b7fe640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb81406ae70 0x7fb81406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:41.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.360+0000 7fb82b7fe640 1 -- 172.21.15.8:0/301647849 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb81c0ac220 con 0x7fb8340c5610 2023-10-14T10:34:41.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.360+0000 7fb832ffd640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb81406ae70 0x7fb81406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:41.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.361+0000 7fb832ffd640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb81406ae70 0x7fb81406d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb824000f60 tx=0x7fb824007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:41.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.364+0000 7fb82b7fe640 1 -- 172.21.15.8:0/301647849 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb81c077580 con 0x7fb8340c5610 2023-10-14T10:34:41.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.629+0000 7fb833fff640 1 -- 172.21.15.8:0/301647849 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fb8340c4180 con 0x7fb8340c5610 2023-10-14T10:34:41.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.634+0000 7fb82b7fe640 1 -- 172.21.15.8:0/301647849 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb81c07aba0 con 0x7fb8340c5610 2023-10-14T10:34:41.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.637+0000 7fb833fff640 1 -- 172.21.15.8:0/301647849 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb81406ae70 msgr2=0x7fb81406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:41.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.637+0000 7fb833fff640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb81406ae70 0x7fb81406d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb824000f60 tx=0x7fb824007c00 comp rx=0 tx=0).stop 2023-10-14T10:34:41.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.637+0000 7fb833fff640 1 -- 172.21.15.8:0/301647849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8340c5610 msgr2=0x7fb834157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:41.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.637+0000 7fb833fff640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8340c5610 0x7fb834157f70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb81c037040 tx=0x7fb81c004a40 comp rx=0 tx=0).stop 2023-10-14T10:34:41.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.637+0000 7fb833fff640 1 -- 172.21.15.8:0/301647849 shutdown_connections 2023-10-14T10:34:41.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.637+0000 7fb833fff640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb81406ae70 0x7fb81406d330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.637+0000 7fb833fff640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb834151420 0x7fb8341ec850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.637+0000 7fb833fff640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8340c5610 0x7fb834157f70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.637+0000 7fb833fff640 1 --2- 172.21.15.8:0/301647849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8340c43a0 0x7fb834157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.637+0000 7fb833fff640 1 -- 172.21.15.8:0/301647849 >> 172.21.15.8:0/301647849 conn(0x7fb8340c96c0 msgr2=0x7fb83414ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:41.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.637+0000 7fb833fff640 1 -- 172.21.15.8:0/301647849 shutdown_connections 2023-10-14T10:34:41.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.637+0000 7fb833fff640 1 -- 172.21.15.8:0/301647849 wait complete. 2023-10-14T10:34:41.659 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-14T10:34:41.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.868+0000 7f7b59d43640 1 Processor -- start 2023-10-14T10:34:41.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.868+0000 7f7b59d43640 1 -- start start 2023-10-14T10:34:41.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.870+0000 7f7b59d43640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7b5406fb10 0x7f7b540c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:41.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.870+0000 7f7b59d43640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b540c2670 0x7f7b540bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:41.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.870+0000 7f7b59d43640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b54152ac0 con 0x7f7b5413af90 2023-10-14T10:34:41.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.870+0000 7f7b59d43640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b54151eb0 con 0x7f7b5406fb10 2023-10-14T10:34:41.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.870+0000 7f7b59d43640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b54152190 con 0x7f7b540c2670 2023-10-14T10:34:41.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.870+0000 7f7b53fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7b5406fb10 0x7f7b540c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:41.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.870+0000 7f7b53fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7b5406fb10 0x7f7b540c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46024/0 (socket says 172.21.15.8:46024) 2023-10-14T10:34:41.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.870+0000 7f7b53fff640 1 -- 172.21.15.8:0/781638024 learned_addr learned my addr 172.21.15.8:0/781638024 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:41.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.870+0000 7f7b53fff640 1 -- 172.21.15.8:0/781638024 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b540c2670 msgr2=0x7f7b540bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:41.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.870+0000 7f7b53fff640 1 --2- 172.21.15.8:0/781638024 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b540c2670 0x7f7b540bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.870+0000 7f7b53fff640 1 -- 172.21.15.8:0/781638024 >> v1:172.21.15.8:6789/0 conn(0x7f7b5413af90 legacy=0x7f7b540a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:41.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.870+0000 7f7b53fff640 1 -- 172.21.15.8:0/781638024 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b54152470 con 0x7f7b5406fb10 2023-10-14T10:34:41.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.872+0000 7f7b53fff640 1 --2- 172.21.15.8:0/781638024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b5406fb10 0x7f7b540c2130 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009870 tx=0x7f7b4002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7591783aec94b2e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:41.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.872+0000 7f7b537fe640 1 -- 172.21.15.8:0/781638024 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40031640 con 0x7f7b5406fb10 2023-10-14T10:34:41.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.872+0000 7f7b537fe640 1 -- 172.21.15.8:0/781638024 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b400317a0 con 0x7f7b5406fb10 2023-10-14T10:34:41.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.872+0000 7f7b537fe640 1 -- 172.21.15.8:0/781638024 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40031b30 con 0x7f7b5406fb10 2023-10-14T10:34:41.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.872+0000 7f7b59d43640 1 -- 172.21.15.8:0/781638024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b5406fb10 msgr2=0x7f7b540c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:41.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.872+0000 7f7b59d43640 1 --2- 172.21.15.8:0/781638024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b5406fb10 0x7f7b540c2130 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009870 tx=0x7f7b4002b8f0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.873+0000 7f7b59d43640 1 -- 172.21.15.8:0/781638024 shutdown_connections 2023-10-14T10:34:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.873+0000 7f7b59d43640 1 --2- 172.21.15.8:0/781638024 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b540c2670 0x7f7b540bfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.873+0000 7f7b59d43640 1 --2- 172.21.15.8:0/781638024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b5406fb10 0x7f7b540c2130 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.873+0000 7f7b59d43640 1 -- 172.21.15.8:0/781638024 >> 172.21.15.8:0/781638024 conn(0x7f7b5406a200 msgr2=0x7f7b5406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:41.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.873+0000 7f7b59d43640 1 -- 172.21.15.8:0/781638024 shutdown_connections 2023-10-14T10:34:41.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.873+0000 7f7b59d43640 1 -- 172.21.15.8:0/781638024 wait complete. 2023-10-14T10:34:41.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.874+0000 7f7b59d43640 1 Processor -- start 2023-10-14T10:34:41.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.875+0000 7f7b59d43640 1 -- start start 2023-10-14T10:34:41.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.875+0000 7f7b59d43640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b5406fb10 0x7f7b541ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:41.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.875+0000 7f7b59d43640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b540c2670 0x7f7b541e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:41.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.875+0000 7f7b59d43640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b5413af90 0x7f7b540c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:41.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.875+0000 7f7b59d43640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540bb210 con 0x7f7b540c2670 2023-10-14T10:34:41.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.875+0000 7f7b59d43640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b541eab30 con 0x7f7b5413af90 2023-10-14T10:34:41.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.875+0000 7f7b59d43640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b541ed810 con 0x7f7b5406fb10 2023-10-14T10:34:41.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.876+0000 7f7b53fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b540c2670 0x7f7b541e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:41.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.876+0000 7f7b53fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b540c2670 0x7f7b541e9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46030/0 (socket says 172.21.15.8:46030) 2023-10-14T10:34:41.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.876+0000 7f7b53fff640 1 -- 172.21.15.8:0/3515972646 learned_addr learned my addr 172.21.15.8:0/3515972646 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:41.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.876+0000 7f7b53fff640 1 -- 172.21.15.8:0/3515972646 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b5406fb10 msgr2=0x7f7b541ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:41.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.876+0000 7f7b53fff640 1 --2- 172.21.15.8:0/3515972646 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b5406fb10 0x7f7b541ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.876+0000 7f7b53fff640 1 -- 172.21.15.8:0/3515972646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b5413af90 msgr2=0x7f7b540c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.876+0000 7f7b53fff640 1 --2- 172.21.15.8:0/3515972646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b5413af90 0x7f7b540c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.876+0000 7f7b53fff640 1 -- 172.21.15.8:0/3515972646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b400094d0 con 0x7f7b540c2670 2023-10-14T10:34:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.876+0000 7f7b53fff640 1 --2- 172.21.15.8:0/3515972646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b540c2670 0x7f7b541e9b70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009870 tx=0x7f7b400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.877+0000 7f7b517fa640 1 -- 172.21.15.8:0/3515972646 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4003ac60 con 0x7f7b540c2670 2023-10-14T10:34:41.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.877+0000 7f7b517fa640 1 -- 172.21.15.8:0/3515972646 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4003ade0 con 0x7f7b540c2670 2023-10-14T10:34:41.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.877+0000 7f7b59d43640 1 -- 172.21.15.8:0/3515972646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b540bb4b0 con 0x7f7b540c2670 2023-10-14T10:34:41.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.877+0000 7f7b517fa640 1 -- 172.21.15.8:0/3515972646 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40044630 con 0x7f7b540c2670 2023-10-14T10:34:41.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.877+0000 7f7b59d43640 1 -- 172.21.15.8:0/3515972646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b540bba70 con 0x7f7b540c2670 2023-10-14T10:34:41.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.878+0000 7f7b59d43640 1 -- 172.21.15.8:0/3515972646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b540619f0 con 0x7f7b540c2670 2023-10-14T10:34:41.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.879+0000 7f7b517fa640 1 -- 172.21.15.8:0/3515972646 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7b4002f050 con 0x7f7b540c2670 2023-10-14T10:34:41.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.880+0000 7f7b517fa640 1 --2- 172.21.15.8:0/3515972646 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7b3806ae70 0x7f7b3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:41.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.880+0000 7f7b517fa640 1 -- 172.21.15.8:0/3515972646 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7b400ab480 con 0x7f7b540c2670 2023-10-14T10:34:41.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.880+0000 7f7b58d41640 1 --2- 172.21.15.8:0/3515972646 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7b3806ae70 0x7f7b3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:41.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.881+0000 7f7b58d41640 1 --2- 172.21.15.8:0/3515972646 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7b3806ae70 0x7f7b3806d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b48000f60 tx=0x7f7b480079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:41.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:41.884+0000 7f7b517fa640 1 -- 172.21.15.8:0/3515972646 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b40076870 con 0x7f7b540c2670 2023-10-14T10:34:42.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.137+0000 7f7b59d43640 1 -- 172.21.15.8:0/3515972646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f7b540bf8f0 con 0x7f7b540c2670 2023-10-14T10:34:42.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.141+0000 7f7b517fa640 1 -- 172.21.15.8:0/3515972646 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7b40079e90 con 0x7f7b540c2670 2023-10-14T10:34:42.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.144+0000 7f7b59d43640 1 -- 172.21.15.8:0/3515972646 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7b3806ae70 msgr2=0x7f7b3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.144+0000 7f7b59d43640 1 --2- 172.21.15.8:0/3515972646 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7b3806ae70 0x7f7b3806d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b48000f60 tx=0x7f7b480079b0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.144+0000 7f7b59d43640 1 -- 172.21.15.8:0/3515972646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b540c2670 msgr2=0x7f7b541e9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.144+0000 7f7b59d43640 1 --2- 172.21.15.8:0/3515972646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b540c2670 0x7f7b541e9b70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009870 tx=0x7f7b400046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.144+0000 7f7b59d43640 1 -- 172.21.15.8:0/3515972646 shutdown_connections 2023-10-14T10:34:42.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.144+0000 7f7b59d43640 1 --2- 172.21.15.8:0/3515972646 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7b3806ae70 0x7f7b3806d330 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.144+0000 7f7b59d43640 1 --2- 172.21.15.8:0/3515972646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b5413af90 0x7f7b540c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.144+0000 7f7b59d43640 1 --2- 172.21.15.8:0/3515972646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b540c2670 0x7f7b541e9b70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.144+0000 7f7b59d43640 1 --2- 172.21.15.8:0/3515972646 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b5406fb10 0x7f7b541ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.144+0000 7f7b59d43640 1 -- 172.21.15.8:0/3515972646 >> 172.21.15.8:0/3515972646 conn(0x7f7b5406a200 msgr2=0x7f7b54138620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:42.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.144+0000 7f7b59d43640 1 -- 172.21.15.8:0/3515972646 shutdown_connections 2023-10-14T10:34:42.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.144+0000 7f7b59d43640 1 -- 172.21.15.8:0/3515972646 wait complete. 2023-10-14T10:34:42.164 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-14T10:34:42.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.375+0000 7f7cb759e640 1 Processor -- start 2023-10-14T10:34:42.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.376+0000 7f7cb759e640 1 -- start start 2023-10-14T10:34:42.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.377+0000 7f7cb759e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7cb80c43a0 0x7f7cb80c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.377+0000 7f7cb759e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80c4e30 con 0x7f7cb80c5610 2023-10-14T10:34:42.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.377+0000 7f7cb759e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80c5d00 con 0x7f7cb8151420 2023-10-14T10:34:42.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.377+0000 7f7cb759e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb80c5450 con 0x7f7cb80c43a0 2023-10-14T10:34:42.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.378+0000 7f7cb6d9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7cb80c5610 0x7f7cb806ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35440/0 (socket says 172.21.15.8:35440) 2023-10-14T10:34:42.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.378+0000 7f7cb6d9d640 1 -- 172.21.15.8:0/2764283271 learned_addr learned my addr 172.21.15.8:0/2764283271 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:42.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.378+0000 7f7cb5d9b640 1 --2- 172.21.15.8:0/2764283271 >> v2:172.21.15.92:3300/0 conn(0x7f7cb80c43a0 0x7f7cb80c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:42.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.378+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136664920 0 0) 0x7f7cb0001110 con 0x7f7cb80c5610 2023-10-14T10:34:42.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.378+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca4003520 con 0x7f7cb80c5610 2023-10-14T10:34:42.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.378+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1076209064 0 0) 0x7f7ca4003520 con 0x7f7cb80c5610 2023-10-14T10:34:42.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.378+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 >> v2:172.21.15.92:3300/0 conn(0x7f7cb80c43a0 msgr2=0x7f7cb80c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:42.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.378+0000 7f7cb559a640 1 --2- 172.21.15.8:0/2764283271 >> v2:172.21.15.92:3300/0 conn(0x7f7cb80c43a0 0x7f7cb80c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.378+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 >> v1:172.21.15.92:6789/0 conn(0x7f7cb8151420 legacy=0x7f7cb80c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80c5170 con 0x7f7cb80c5610 2023-10-14T10:34:42.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f7cb0001800 con 0x7f7cb80c5610 2023-10-14T10:34:42.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 >> v1:172.21.15.8:6789/0 conn(0x7f7cb80c5610 legacy=0x7f7cb806ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb559a640 1 --2- 172.21.15.8:0/2764283271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ca4003970 0x7f7ca4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb559a640 1 --2- 172.21.15.8:0/2764283271 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7ca40047c0 0x7f7ca4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb559a640 1 --2- 172.21.15.8:0/2764283271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca4005180 0x7f7ca400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80c5450 con 0x7f7ca4005180 2023-10-14T10:34:42.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca400c120 con 0x7f7ca4003970 2023-10-14T10:34:42.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca400c2e0 con 0x7f7ca40047c0 2023-10-14T10:34:42.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb6d9d640 1 --2- 172.21.15.8:0/2764283271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca4005180 0x7f7ca400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:42.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb6d9d640 1 -- 172.21.15.8:0/2764283271 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7ca40047c0 msgr2=0x7f7ca4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:42.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb6d9d640 1 --2- 172.21.15.8:0/2764283271 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7ca40047c0 0x7f7ca4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb659c640 1 --2- 172.21.15.8:0/2764283271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ca4003970 0x7f7ca4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:42.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb6d9d640 1 -- 172.21.15.8:0/2764283271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ca4003970 msgr2=0x7f7ca4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:42.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb6d9d640 1 --2- 172.21.15.8:0/2764283271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ca4003970 0x7f7ca4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.379+0000 7f7cb6d9d640 1 -- 172.21.15.8:0/2764283271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca4003520 con 0x7f7ca4005180 2023-10-14T10:34:42.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.380+0000 7f7cb6d9d640 1 -- 172.21.15.8:0/2764283271 reap_dead start 2023-10-14T10:34:42.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.380+0000 7f7cb6d9d640 1 --2- 172.21.15.8:0/2764283271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca4005180 0x7f7ca400b980 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000c240 tx=0x7f7ca40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fab0e2d8feb592 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:42.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.381+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0005ad0 con 0x7f7ca4005180 2023-10-14T10:34:42.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.381+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb0005c50 con 0x7f7ca4005180 2023-10-14T10:34:42.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.381+0000 7f7cb559a640 1 -- 172.21.15.8:0/2764283271 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb002c8b0 con 0x7f7ca4005180 2023-10-14T10:34:42.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.381+0000 7f7cb759e640 1 -- 172.21.15.8:0/2764283271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca4005180 msgr2=0x7f7ca400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.381+0000 7f7cb759e640 1 --2- 172.21.15.8:0/2764283271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca4005180 0x7f7ca400b980 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000c240 tx=0x7f7ca40057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.381+0000 7f7cb759e640 1 -- 172.21.15.8:0/2764283271 shutdown_connections 2023-10-14T10:34:42.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.381+0000 7f7cb759e640 1 --2- 172.21.15.8:0/2764283271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ca4005180 0x7f7ca400b980 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.381+0000 7f7cb759e640 1 -- 172.21.15.8:0/2764283271 >> 172.21.15.8:0/2764283271 conn(0x7f7cb80c96c0 msgr2=0x7f7cb80c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:42.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.381+0000 7f7cb759e640 1 -- 172.21.15.8:0/2764283271 shutdown_connections 2023-10-14T10:34:42.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.382+0000 7f7cb759e640 1 -- 172.21.15.8:0/2764283271 wait complete. 2023-10-14T10:34:42.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.383+0000 7f7cb759e640 1 Processor -- start 2023-10-14T10:34:42.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.383+0000 7f7cb759e640 1 -- start start 2023-10-14T10:34:42.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.384+0000 7f7cb759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ca4005180 0x7f7cb814eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.384+0000 7f7cb759e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cb8157ff0 0x7f7cb8157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.384+0000 7f7cb759e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7cb8149030 0x7f7cb81576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.384+0000 7f7cb759e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb81ed340 con 0x7f7cb8157ff0 2023-10-14T10:34:42.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.384+0000 7f7cb759e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8157be0 con 0x7f7ca4005180 2023-10-14T10:34:42.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.384+0000 7f7cb759e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb81ed060 con 0x7f7cb8149030 2023-10-14T10:34:42.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.385+0000 7f7cb5d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cb8157ff0 0x7f7cb8157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:42.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.385+0000 7f7cb5d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cb8157ff0 0x7f7cb8157160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46050/0 (socket says 172.21.15.8:46050) 2023-10-14T10:34:42.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.385+0000 7f7cb5d9b640 1 -- 172.21.15.8:0/715236815 learned_addr learned my addr 172.21.15.8:0/715236815 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:42.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.385+0000 7f7cb659c640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ca4005180 0x7f7cb814eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:42.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.385+0000 7f7cb6d9d640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7cb8149030 0x7f7cb81576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:42.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.385+0000 7f7cb5d9b640 1 -- 172.21.15.8:0/715236815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7cb8149030 msgr2=0x7f7cb81576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.385+0000 7f7cb5d9b640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7cb8149030 0x7f7cb81576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.385+0000 7f7cb5d9b640 1 -- 172.21.15.8:0/715236815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ca4005180 msgr2=0x7f7cb814eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.385+0000 7f7cb5d9b640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ca4005180 0x7f7cb814eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.385+0000 7f7cb5d9b640 1 -- 172.21.15.8:0/715236815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80aaa90 con 0x7f7cb8157ff0 2023-10-14T10:34:42.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.385+0000 7f7cb5d9b640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cb8157ff0 0x7f7cb8157160 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000e7a0 tx=0x7f7ca000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:42.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.386+0000 7f7caeffd640 1 -- 172.21.15.8:0/715236815 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000eeb0 con 0x7f7cb8157ff0 2023-10-14T10:34:42.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.386+0000 7f7caeffd640 1 -- 172.21.15.8:0/715236815 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca000c940 con 0x7f7cb8157ff0 2023-10-14T10:34:42.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.386+0000 7f7caeffd640 1 -- 172.21.15.8:0/715236815 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000cd10 con 0x7f7cb8157ff0 2023-10-14T10:34:42.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.386+0000 7f7cb759e640 1 -- 172.21.15.8:0/715236815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb80aad70 con 0x7f7cb8157ff0 2023-10-14T10:34:42.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.386+0000 7f7cb759e640 1 -- 172.21.15.8:0/715236815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb81ecd30 con 0x7f7cb8157ff0 2023-10-14T10:34:42.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.387+0000 7f7cb759e640 1 -- 172.21.15.8:0/715236815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb80619f0 con 0x7f7cb8157ff0 2023-10-14T10:34:42.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.388+0000 7f7caeffd640 1 -- 172.21.15.8:0/715236815 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7ca0013470 con 0x7f7cb8157ff0 2023-10-14T10:34:42.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.389+0000 7f7caeffd640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7c9806ae70 0x7f7c9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.389+0000 7f7caeffd640 1 -- 172.21.15.8:0/715236815 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ca0089390 con 0x7f7cb8157ff0 2023-10-14T10:34:42.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.389+0000 7f7cb659c640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7c9806ae70 0x7f7c9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:42.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.390+0000 7f7cb659c640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7c9806ae70 0x7f7c9806d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8007fd0 tx=0x7f7ca8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:42.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.393+0000 7f7caeffd640 1 -- 172.21.15.8:0/715236815 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ca0054780 con 0x7f7cb8157ff0 2023-10-14T10:34:42.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.657+0000 7f7cb759e640 1 -- 172.21.15.8:0/715236815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7cb806c520 con 0x7f7cb8157ff0 2023-10-14T10:34:42.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.661+0000 7f7caeffd640 1 -- 172.21.15.8:0/715236815 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7ca0057da0 con 0x7f7cb8157ff0 2023-10-14T10:34:42.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.665+0000 7f7cb759e640 1 -- 172.21.15.8:0/715236815 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7c9806ae70 msgr2=0x7f7c9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.665+0000 7f7cb759e640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7c9806ae70 0x7f7c9806d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8007fd0 tx=0x7f7ca8009040 comp rx=0 tx=0).stop 2023-10-14T10:34:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.665+0000 7f7cb759e640 1 -- 172.21.15.8:0/715236815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cb8157ff0 msgr2=0x7f7cb8157160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.665+0000 7f7cb759e640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cb8157ff0 0x7f7cb8157160 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000e7a0 tx=0x7f7ca000ec60 comp rx=0 tx=0).stop 2023-10-14T10:34:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.665+0000 7f7cb759e640 1 -- 172.21.15.8:0/715236815 shutdown_connections 2023-10-14T10:34:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.665+0000 7f7cb759e640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7c9806ae70 0x7f7c9806d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.665+0000 7f7cb759e640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7cb8149030 0x7f7cb81576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.665+0000 7f7cb759e640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7cb8157ff0 0x7f7cb8157160 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.665+0000 7f7cb759e640 1 --2- 172.21.15.8:0/715236815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ca4005180 0x7f7cb814eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.665+0000 7f7cb759e640 1 -- 172.21.15.8:0/715236815 >> 172.21.15.8:0/715236815 conn(0x7f7cb80c96c0 msgr2=0x7f7cb80c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:42.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.665+0000 7f7cb759e640 1 -- 172.21.15.8:0/715236815 shutdown_connections 2023-10-14T10:34:42.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.665+0000 7f7cb759e640 1 -- 172.21.15.8:0/715236815 wait complete. 2023-10-14T10:34:42.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-14T10:34:42.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.910+0000 7fb643fff640 1 Processor -- start 2023-10-14T10:34:42.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.910+0000 7fb643fff640 1 -- start start 2023-10-14T10:34:42.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.912+0000 7fb643fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb644155a80 0x7fb6440719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.912+0000 7fb643fff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb644072060 con 0x7fb64415b940 2023-10-14T10:34:42.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.912+0000 7fb643fff640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6441584f0 con 0x7fb6440ba3e0 2023-10-14T10:34:42.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.912+0000 7fb643fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb644159270 con 0x7fb644155a80 2023-10-14T10:34:42.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.912+0000 7fb6437fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb64415b940 0x7fb64415bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35442/0 (socket says 172.21.15.8:35442) 2023-10-14T10:34:42.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.912+0000 7fb6437fe640 1 -- 172.21.15.8:0/4256851660 learned_addr learned my addr 172.21.15.8:0/4256851660 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:42.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.912+0000 7fb642ffd640 1 --2- 172.21.15.8:0/4256851660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb644155a80 0x7fb6440719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:42.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.913+0000 7fb6427fc640 1 -- 172.21.15.8:0/4256851660 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276519747 0 0) 0x7fb644072060 con 0x7fb64415b940 2023-10-14T10:34:42.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.913+0000 7fb6427fc640 1 -- 172.21.15.8:0/4256851660 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb630003520 con 0x7fb64415b940 2023-10-14T10:34:42.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.913+0000 7fb642ffd640 1 -- 172.21.15.8:0/4256851660 >> v1:172.21.15.92:6789/0 conn(0x7fb6440ba3e0 legacy=0x7fb6440c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.913+0000 7fb6427fc640 1 -- 172.21.15.8:0/4256851660 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361583241 0 0) 0x7fb6441584f0 con 0x7fb6440ba3e0 2023-10-14T10:34:42.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.913+0000 7fb642ffd640 1 -- 172.21.15.8:0/4256851660 >> v1:172.21.15.8:6789/0 conn(0x7fb64415b940 legacy=0x7fb64415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.913+0000 7fb642ffd640 1 -- 172.21.15.8:0/4256851660 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644158790 con 0x7fb644155a80 2023-10-14T10:34:42.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.914+0000 7fb642ffd640 1 --2- 172.21.15.8:0/4256851660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb644155a80 0x7fb6440719f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6340097d0 tx=0x7fb63402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c534fbe11e449bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:42.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.915+0000 7fb6427fc640 1 -- 172.21.15.8:0/4256851660 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63402d040 con 0x7fb644155a80 2023-10-14T10:34:42.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.915+0000 7fb6427fc640 1 -- 172.21.15.8:0/4256851660 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634031810 con 0x7fb644155a80 2023-10-14T10:34:42.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.915+0000 7fb6427fc640 1 -- 172.21.15.8:0/4256851660 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634031ba0 con 0x7fb644155a80 2023-10-14T10:34:42.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.915+0000 7fb643fff640 1 -- 172.21.15.8:0/4256851660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb644155a80 msgr2=0x7fb6440719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.915+0000 7fb643fff640 1 --2- 172.21.15.8:0/4256851660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb644155a80 0x7fb6440719f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6340097d0 tx=0x7fb63402b8b0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.916+0000 7fb643fff640 1 -- 172.21.15.8:0/4256851660 shutdown_connections 2023-10-14T10:34:42.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.916+0000 7fb643fff640 1 --2- 172.21.15.8:0/4256851660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb644155a80 0x7fb6440719f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.916+0000 7fb643fff640 1 -- 172.21.15.8:0/4256851660 >> 172.21.15.8:0/4256851660 conn(0x7fb64406a200 msgr2=0x7fb64406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:42.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.916+0000 7fb643fff640 1 -- 172.21.15.8:0/4256851660 shutdown_connections 2023-10-14T10:34:42.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.916+0000 7fb643fff640 1 -- 172.21.15.8:0/4256851660 wait complete. 2023-10-14T10:34:42.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.917+0000 7fb643fff640 1 Processor -- start 2023-10-14T10:34:42.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.918+0000 7fb643fff640 1 -- start start 2023-10-14T10:34:42.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb643fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6440ba3e0 0x7fb6440a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb643fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644155a80 0x7fb6440bb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb643fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb64415b940 0x7fb6440a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb643fff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440aa390 con 0x7fb644155a80 2023-10-14T10:34:42.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb643fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb644151ce0 con 0x7fb6440ba3e0 2023-10-14T10:34:42.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb643fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440a9f00 con 0x7fb64415b940 2023-10-14T10:34:42.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb63bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644155a80 0x7fb6440bb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:42.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb63bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644155a80 0x7fb6440bb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46054/0 (socket says 172.21.15.8:46054) 2023-10-14T10:34:42.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb63bfff640 1 -- 172.21.15.8:0/2280977222 learned_addr learned my addr 172.21.15.8:0/2280977222 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:42.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb642ffd640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6440ba3e0 0x7fb6440a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:42.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb63bfff640 1 -- 172.21.15.8:0/2280977222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb64415b940 msgr2=0x7fb6440a81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb63bfff640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb64415b940 0x7fb6440a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb63bfff640 1 -- 172.21.15.8:0/2280977222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6440ba3e0 msgr2=0x7fb6440a9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:42.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb63bfff640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6440ba3e0 0x7fb6440a9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:42.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.919+0000 7fb63bfff640 1 -- 172.21.15.8:0/2280977222 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb634009400 con 0x7fb644155a80 2023-10-14T10:34:42.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.920+0000 7fb63bfff640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644155a80 0x7fb6440bb180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00c4b0 tx=0x7fb62c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:42.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.920+0000 7fb63b7fe640 1 -- 172.21.15.8:0/2280977222 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c005480 con 0x7fb644155a80 2023-10-14T10:34:42.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.920+0000 7fb63b7fe640 1 -- 172.21.15.8:0/2280977222 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c0035f0 con 0x7fb644155a80 2023-10-14T10:34:42.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.920+0000 7fb643fff640 1 -- 172.21.15.8:0/2280977222 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb644151a00 con 0x7fb644155a80 2023-10-14T10:34:42.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.920+0000 7fb63b7fe640 1 -- 172.21.15.8:0/2280977222 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c0039e0 con 0x7fb644155a80 2023-10-14T10:34:42.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.920+0000 7fb643fff640 1 -- 172.21.15.8:0/2280977222 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6440bc600 con 0x7fb644155a80 2023-10-14T10:34:42.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.921+0000 7fb643fff640 1 -- 172.21.15.8:0/2280977222 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6440aa070 con 0x7fb644155a80 2023-10-14T10:34:42.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.922+0000 7fb63b7fe640 1 -- 172.21.15.8:0/2280977222 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb62c003b40 con 0x7fb644155a80 2023-10-14T10:34:42.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.923+0000 7fb63b7fe640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb62406ae70 0x7fb62406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:42.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.924+0000 7fb63b7fe640 1 -- 172.21.15.8:0/2280977222 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb62c088810 con 0x7fb644155a80 2023-10-14T10:34:42.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.924+0000 7fb642ffd640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb62406ae70 0x7fb62406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:42.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.925+0000 7fb642ffd640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb62406ae70 0x7fb62406d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb634036000 tx=0x7fb63403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:42.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:42.928+0000 7fb63b7fe640 1 -- 172.21.15.8:0/2280977222 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb62c053ca0 con 0x7fb644155a80 2023-10-14T10:34:43.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.192+0000 7fb643fff640 1 -- 172.21.15.8:0/2280977222 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fb6440baec0 con 0x7fb644155a80 2023-10-14T10:34:43.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.197+0000 7fb63b7fe640 1 -- 172.21.15.8:0/2280977222 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb62c017070 con 0x7fb644155a80 2023-10-14T10:34:43.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.200+0000 7fb643fff640 1 -- 172.21.15.8:0/2280977222 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb62406ae70 msgr2=0x7fb62406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.200+0000 7fb643fff640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb62406ae70 0x7fb62406d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb634036000 tx=0x7fb63403c040 comp rx=0 tx=0).stop 2023-10-14T10:34:43.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.200+0000 7fb643fff640 1 -- 172.21.15.8:0/2280977222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644155a80 msgr2=0x7fb6440bb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.200+0000 7fb643fff640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644155a80 0x7fb6440bb180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00c4b0 tx=0x7fb62c00c970 comp rx=0 tx=0).stop 2023-10-14T10:34:43.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.200+0000 7fb643fff640 1 -- 172.21.15.8:0/2280977222 shutdown_connections 2023-10-14T10:34:43.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.200+0000 7fb643fff640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb62406ae70 0x7fb62406d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.200+0000 7fb643fff640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb64415b940 0x7fb6440a81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.200+0000 7fb643fff640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb644155a80 0x7fb6440bb180 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.200+0000 7fb643fff640 1 --2- 172.21.15.8:0/2280977222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6440ba3e0 0x7fb6440a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.200+0000 7fb643fff640 1 -- 172.21.15.8:0/2280977222 >> 172.21.15.8:0/2280977222 conn(0x7fb64406a200 msgr2=0x7fb644154330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:43.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.201+0000 7fb643fff640 1 -- 172.21.15.8:0/2280977222 shutdown_connections 2023-10-14T10:34:43.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.201+0000 7fb643fff640 1 -- 172.21.15.8:0/2280977222 wait complete. 2023-10-14T10:34:43.223 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-14T10:34:43.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.452+0000 7f0c4d7b6640 1 Processor -- start 2023-10-14T10:34:43.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.453+0000 7f0c4d7b6640 1 -- start start 2023-10-14T10:34:43.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.454+0000 7f0c4d7b6640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0c480bfee0 0x7f0c48071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.454+0000 7f0c4d7b6640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c480c57a0 con 0x7f0c4814f3a0 2023-10-14T10:34:43.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.454+0000 7f0c4d7b6640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c480c59f0 con 0x7f0c48155440 2023-10-14T10:34:43.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.454+0000 7f0c4d7b6640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4806cee0 con 0x7f0c480bfee0 2023-10-14T10:34:43.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.455+0000 7f0c46ffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0c4814f3a0 0x7f0c4806d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35444/0 (socket says 172.21.15.8:35444) 2023-10-14T10:34:43.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.455+0000 7f0c46ffd640 1 -- 172.21.15.8:0/966785069 learned_addr learned my addr 172.21.15.8:0/966785069 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:43.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.455+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030012262 0 0) 0x7f0c480c57a0 con 0x7f0c4814f3a0 2023-10-14T10:34:43.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.455+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c30003520 con 0x7f0c4814f3a0 2023-10-14T10:34:43.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.455+0000 7f0c477fe640 1 --2- 172.21.15.8:0/966785069 >> v2:172.21.15.92:3300/0 conn(0x7f0c480bfee0 0x7f0c48071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.455+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 155017468 0 0) 0x7f0c30003520 con 0x7f0c4814f3a0 2023-10-14T10:34:43.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.455+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 >> v2:172.21.15.92:3300/0 conn(0x7f0c480bfee0 msgr2=0x7f0c48071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:43.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.455+0000 7f0c45ffb640 1 --2- 172.21.15.8:0/966785069 >> v2:172.21.15.92:3300/0 conn(0x7f0c480bfee0 0x7f0c48071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 >> v1:172.21.15.92:6789/0 conn(0x7f0c48155440 legacy=0x7f0c48152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c480c5cd0 con 0x7f0c4814f3a0 2023-10-14T10:34:43.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f0c38001670 con 0x7f0c4814f3a0 2023-10-14T10:34:43.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 >> v1:172.21.15.8:6789/0 conn(0x7f0c4814f3a0 legacy=0x7f0c4806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c45ffb640 1 --2- 172.21.15.8:0/966785069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c300039c0 0x7f0c30003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c45ffb640 1 --2- 172.21.15.8:0/966785069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c300047c0 0x7f0c30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c45ffb640 1 --2- 172.21.15.8:0/966785069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c300052a0 0x7f0c3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4806cee0 con 0x7f0c300047c0 2023-10-14T10:34:43.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3000c1c0 con 0x7f0c300039c0 2023-10-14T10:34:43.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3000c380 con 0x7f0c300052a0 2023-10-14T10:34:43.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c467fc640 1 --2- 172.21.15.8:0/966785069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c300047c0 0x7f0c30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c46ffd640 1 --2- 172.21.15.8:0/966785069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c300039c0 0x7f0c30003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c467fc640 1 -- 172.21.15.8:0/966785069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c300052a0 msgr2=0x7f0c3000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:43.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c467fc640 1 --2- 172.21.15.8:0/966785069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c300052a0 0x7f0c3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c467fc640 1 -- 172.21.15.8:0/966785069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c300039c0 msgr2=0x7f0c30003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:43.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c467fc640 1 --2- 172.21.15.8:0/966785069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c300039c0 0x7f0c30003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c467fc640 1 -- 172.21.15.8:0/966785069 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c30003520 con 0x7f0c300047c0 2023-10-14T10:34:43.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.456+0000 7f0c477fe640 1 -- 172.21.15.8:0/966785069 reap_dead start 2023-10-14T10:34:43.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.458+0000 7f0c467fc640 1 --2- 172.21.15.8:0/966785069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c300047c0 0x7f0c30004c40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c001720 tx=0x7f0c300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5287d905df5428fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:43.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.458+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c0052d0 con 0x7f0c300047c0 2023-10-14T10:34:43.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.458+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c02e050 con 0x7f0c300047c0 2023-10-14T10:34:43.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.458+0000 7f0c45ffb640 1 -- 172.21.15.8:0/966785069 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c003830 con 0x7f0c300047c0 2023-10-14T10:34:43.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.458+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/966785069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c300047c0 msgr2=0x7f0c30004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.458+0000 7f0c4d7b6640 1 --2- 172.21.15.8:0/966785069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c300047c0 0x7f0c30004c40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c001720 tx=0x7f0c300057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.459+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/966785069 shutdown_connections 2023-10-14T10:34:43.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.459+0000 7f0c4d7b6640 1 --2- 172.21.15.8:0/966785069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c300047c0 0x7f0c30004c40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.459+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/966785069 >> 172.21.15.8:0/966785069 conn(0x7f0c480a74d0 msgr2=0x7f0c480a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:43.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.459+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/966785069 shutdown_connections 2023-10-14T10:34:43.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.459+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/966785069 wait complete. 2023-10-14T10:34:43.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.460+0000 7f0c4d7b6640 1 Processor -- start 2023-10-14T10:34:43.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.461+0000 7f0c4d7b6640 1 -- start start 2023-10-14T10:34:43.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.461+0000 7f0c4d7b6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c300047c0 0x7f0c4814cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.461+0000 7f0c4d7b6640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c481ec700 0x7f0c4814bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.461+0000 7f0c4d7b6640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c4814dac0 0x7f0c48148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.461+0000 7f0c4d7b6640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c480c4c10 con 0x7f0c4814dac0 2023-10-14T10:34:43.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.461+0000 7f0c4d7b6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4814d630 con 0x7f0c300047c0 2023-10-14T10:34:43.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.461+0000 7f0c4d7b6640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4814d160 con 0x7f0c481ec700 2023-10-14T10:34:43.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.462+0000 7f0c477fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c4814dac0 0x7f0c48148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.462+0000 7f0c477fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c4814dac0 0x7f0c48148bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46066/0 (socket says 172.21.15.8:46066) 2023-10-14T10:34:43.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.462+0000 7f0c477fe640 1 -- 172.21.15.8:0/4244754662 learned_addr learned my addr 172.21.15.8:0/4244754662 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:43.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.462+0000 7f0c46ffd640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c300047c0 0x7f0c4814cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.462+0000 7f0c477fe640 1 -- 172.21.15.8:0/4244754662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c481ec700 msgr2=0x7f0c4814bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.462+0000 7f0c477fe640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c481ec700 0x7f0c4814bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.462+0000 7f0c477fe640 1 -- 172.21.15.8:0/4244754662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c300047c0 msgr2=0x7f0c4814cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.462+0000 7f0c477fe640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c300047c0 0x7f0c4814cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.462+0000 7f0c477fe640 1 -- 172.21.15.8:0/4244754662 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c480c43b0 con 0x7f0c4814dac0 2023-10-14T10:34:43.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.462+0000 7f0c46ffd640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c300047c0 0x7f0c4814cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:43.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.463+0000 7f0c477fe640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c4814dac0 0x7f0c48148bf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0c48070440 tx=0x7f0c4000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:43.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.463+0000 7f0c2f7fe640 1 -- 172.21.15.8:0/4244754662 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4000ed90 con 0x7f0c4814dac0 2023-10-14T10:34:43.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.463+0000 7f0c2f7fe640 1 -- 172.21.15.8:0/4244754662 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c40014420 con 0x7f0c4814dac0 2023-10-14T10:34:43.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.463+0000 7f0c2f7fe640 1 -- 172.21.15.8:0/4244754662 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c400147d0 con 0x7f0c4814dac0 2023-10-14T10:34:43.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.463+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/4244754662 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c480c4650 con 0x7f0c4814dac0 2023-10-14T10:34:43.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.463+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/4244754662 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4814c430 con 0x7f0c4814dac0 2023-10-14T10:34:43.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.465+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/4244754662 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4804e9b0 con 0x7f0c4814dac0 2023-10-14T10:34:43.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.465+0000 7f0c2f7fe640 1 -- 172.21.15.8:0/4244754662 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0c40014930 con 0x7f0c4814dac0 2023-10-14T10:34:43.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.466+0000 7f0c2f7fe640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0c3406ae70 0x7f0c3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.466+0000 7f0c2f7fe640 1 -- 172.21.15.8:0/4244754662 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0c40089780 con 0x7f0c4814dac0 2023-10-14T10:34:43.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.467+0000 7f0c46ffd640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0c3406ae70 0x7f0c3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.467+0000 7f0c46ffd640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0c3406ae70 0x7f0c3406d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0c380058b0 tx=0x7f0c38000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:43.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.471+0000 7f0c2f7fe640 1 -- 172.21.15.8:0/4244754662 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c40054cc0 con 0x7f0c4814dac0 2023-10-14T10:34:43.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.736+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/4244754662 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f0c4806d470 con 0x7f0c4814dac0 2023-10-14T10:34:43.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.740+0000 7f0c2f7fe640 1 -- 172.21.15.8:0/4244754662 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0c400582e0 con 0x7f0c4814dac0 2023-10-14T10:34:43.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.743+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/4244754662 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0c3406ae70 msgr2=0x7f0c3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.743+0000 7f0c4d7b6640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0c3406ae70 0x7f0c3406d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0c380058b0 tx=0x7f0c38000ed0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.743+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/4244754662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c4814dac0 msgr2=0x7f0c48148bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.743+0000 7f0c4d7b6640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c4814dac0 0x7f0c48148bf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0c48070440 tx=0x7f0c4000e4b0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.743+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/4244754662 shutdown_connections 2023-10-14T10:34:43.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.743+0000 7f0c4d7b6640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0c3406ae70 0x7f0c3406d330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.743+0000 7f0c4d7b6640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c4814dac0 0x7f0c48148bf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.743+0000 7f0c4d7b6640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c481ec700 0x7f0c4814bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.743+0000 7f0c4d7b6640 1 --2- 172.21.15.8:0/4244754662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c300047c0 0x7f0c4814cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.743+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/4244754662 >> 172.21.15.8:0/4244754662 conn(0x7f0c480a74d0 msgr2=0x7f0c48149fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:43.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.743+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/4244754662 shutdown_connections 2023-10-14T10:34:43.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.744+0000 7f0c4d7b6640 1 -- 172.21.15.8:0/4244754662 wait complete. 2023-10-14T10:34:43.764 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:43.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.970+0000 7f178119e640 1 Processor -- start 2023-10-14T10:34:43.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.970+0000 7f178119e640 1 -- start start 2023-10-14T10:34:43.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.972+0000 7f178119e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f177c0c2380 0x7f177c155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.972+0000 7f178119e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c155860 0x7f177c158880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.972+0000 7f178119e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c071d70 con 0x7f177c0a8500 2023-10-14T10:34:43.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.972+0000 7f178119e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c15c230 con 0x7f177c0c2380 2023-10-14T10:34:43.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.972+0000 7f178119e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c15c6c0 con 0x7f177c155860 2023-10-14T10:34:43.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f1773fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f177c0a8500 0x7f177c158170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35460/0 (socket says 172.21.15.8:35460) 2023-10-14T10:34:43.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f1773fff640 1 -- 172.21.15.8:0/2629914395 learned_addr learned my addr 172.21.15.8:0/2629914395 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:43.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f177bfff640 1 --2- 172.21.15.8:0/2629914395 >> v2:172.21.15.92:3300/0 conn(0x7f177c0c2380 0x7f177c155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581443987 0 0) 0x7f177c071d70 con 0x7f177c0a8500 2023-10-14T10:34:43.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1768003520 con 0x7f177c0a8500 2023-10-14T10:34:43.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f178099d640 1 --2- 172.21.15.8:0/2629914395 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c155860 0x7f177c158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2209721394 0 0) 0x7f1768003520 con 0x7f177c0a8500 2023-10-14T10:34:43.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c155860 msgr2=0x7f177c158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:43.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f177b7fe640 1 --2- 172.21.15.8:0/2629914395 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c155860 0x7f177c158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 >> v2:172.21.15.92:3300/0 conn(0x7f177c0c2380 msgr2=0x7f177c155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:43.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f177b7fe640 1 --2- 172.21.15.8:0/2629914395 >> v2:172.21.15.92:3300/0 conn(0x7f177c0c2380 0x7f177c155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c15b900 con 0x7f177c0a8500 2023-10-14T10:34:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f1764001670 con 0x7f177c0a8500 2023-10-14T10:34:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.973+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 >> v1:172.21.15.8:6789/0 conn(0x7f177c0a8500 legacy=0x7f177c158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f177b7fe640 1 --2- 172.21.15.8:0/2629914395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1768003970 0x7f1768003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f177b7fe640 1 --2- 172.21.15.8:0/2629914395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17680047c0 0x7f1768004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f177b7fe640 1 --2- 172.21.15.8:0/2629914395 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c155860 0x7f17680051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c15c230 con 0x7f1768003970 2023-10-14T10:34:43.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c15c6c0 con 0x7f17680047c0 2023-10-14T10:34:43.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176800bb10 con 0x7f177c155860 2023-10-14T10:34:43.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f177bfff640 1 --2- 172.21.15.8:0/2629914395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1768003970 0x7f1768003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f178099d640 1 --2- 172.21.15.8:0/2629914395 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c155860 0x7f17680051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f1773fff640 1 --2- 172.21.15.8:0/2629914395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17680047c0 0x7f1768004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f177bfff640 1 -- 172.21.15.8:0/2629914395 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c155860 msgr2=0x7f17680051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f177bfff640 1 --2- 172.21.15.8:0/2629914395 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c155860 0x7f17680051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f177bfff640 1 -- 172.21.15.8:0/2629914395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17680047c0 msgr2=0x7f1768004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f177bfff640 1 --2- 172.21.15.8:0/2629914395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17680047c0 0x7f1768004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.974+0000 7f177bfff640 1 -- 172.21.15.8:0/2629914395 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1768003520 con 0x7f1768003970 2023-10-14T10:34:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.976+0000 7f177bfff640 1 --2- 172.21.15.8:0/2629914395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1768003970 0x7f1768003d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f176c00ba30 tx=0x7f17680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ae695922550468 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.976+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c032680 con 0x7f1768003970 2023-10-14T10:34:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.976+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c0327e0 con 0x7f1768003970 2023-10-14T10:34:43.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.976+0000 7f177b7fe640 1 -- 172.21.15.8:0/2629914395 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c032b70 con 0x7f1768003970 2023-10-14T10:34:43.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.976+0000 7f178119e640 1 -- 172.21.15.8:0/2629914395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1768003970 msgr2=0x7f1768003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.976+0000 7f178119e640 1 --2- 172.21.15.8:0/2629914395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1768003970 0x7f1768003d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f176c00ba30 tx=0x7f17680057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.976+0000 7f178099d640 1 -- 172.21.15.8:0/2629914395 reap_dead start 2023-10-14T10:34:43.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.977+0000 7f178119e640 1 -- 172.21.15.8:0/2629914395 shutdown_connections 2023-10-14T10:34:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.977+0000 7f178119e640 1 -- 172.21.15.8:0/2629914395 >> 172.21.15.8:0/2629914395 conn(0x7f177c06a200 msgr2=0x7f177c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.977+0000 7f178119e640 1 -- 172.21.15.8:0/2629914395 shutdown_connections 2023-10-14T10:34:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.977+0000 7f178119e640 1 -- 172.21.15.8:0/2629914395 wait complete. 2023-10-14T10:34:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.978+0000 7f178119e640 1 Processor -- start 2023-10-14T10:34:43.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.978+0000 7f178119e640 1 -- start start 2023-10-14T10:34:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.979+0000 7f178119e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768003970 0x7f177c0c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.979+0000 7f178119e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f177c149990 0x7f177c14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.979+0000 7f178119e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c0c5da0 0x7f177c148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.979+0000 7f178119e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c15b260 con 0x7f177c149990 2023-10-14T10:34:43.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.979+0000 7f178119e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0c4e20 con 0x7f1768003970 2023-10-14T10:34:43.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.979+0000 7f178119e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0c4850 con 0x7f177c0c5da0 2023-10-14T10:34:43.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f1773fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f177c149990 0x7f177c14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f1773fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f177c149990 0x7f177c14e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46080/0 (socket says 172.21.15.8:46080) 2023-10-14T10:34:43.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f1773fff640 1 -- 172.21.15.8:0/3199951711 learned_addr learned my addr 172.21.15.8:0/3199951711 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:43.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f177bfff640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768003970 0x7f177c0c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f178099d640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c0c5da0 0x7f177c148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f1773fff640 1 -- 172.21.15.8:0/3199951711 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c0c5da0 msgr2=0x7f177c148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f1773fff640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c0c5da0 0x7f177c148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f1773fff640 1 -- 172.21.15.8:0/3199951711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768003970 msgr2=0x7f177c0c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:43.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f1773fff640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768003970 0x7f177c0c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f1773fff640 1 -- 172.21.15.8:0/3199951711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c1f12c0 con 0x7f177c149990 2023-10-14T10:34:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f178099d640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c0c5da0 0x7f177c148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f177bfff640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768003970 0x7f177c0c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.980+0000 7f1773fff640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f177c149990 0x7f177c14e070 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f176400d7e0 tx=0x7f176400dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.981+0000 7f17797fa640 1 -- 172.21.15.8:0/3199951711 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640074e0 con 0x7f177c149990 2023-10-14T10:34:43.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.981+0000 7f17797fa640 1 -- 172.21.15.8:0/3199951711 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1764007640 con 0x7f177c149990 2023-10-14T10:34:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.981+0000 7f17797fa640 1 -- 172.21.15.8:0/3199951711 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640049e0 con 0x7f177c149990 2023-10-14T10:34:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.981+0000 7f178119e640 1 -- 172.21.15.8:0/3199951711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c0c4ab0 con 0x7f177c149990 2023-10-14T10:34:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.981+0000 7f178119e640 1 -- 172.21.15.8:0/3199951711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c14e5b0 con 0x7f177c149990 2023-10-14T10:34:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.982+0000 7f178119e640 1 -- 172.21.15.8:0/3199951711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177c04e9b0 con 0x7f177c149990 2023-10-14T10:34:43.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.983+0000 7f17797fa640 1 -- 172.21.15.8:0/3199951711 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1764004b40 con 0x7f177c149990 2023-10-14T10:34:43.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.984+0000 7f17797fa640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f175c06aea0 0x7f175c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.985+0000 7f17797fa640 1 -- 172.21.15.8:0/3199951711 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1764088c10 con 0x7f177c149990 2023-10-14T10:34:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.985+0000 7f177bfff640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f175c06aea0 0x7f175c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.986+0000 7f177bfff640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f175c06aea0 0x7f175c06d360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f176c00ba00 tx=0x7f176c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:43.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:43.989+0000 7f17797fa640 1 -- 172.21.15.8:0/3199951711 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1764053f70 con 0x7f177c149990 2023-10-14T10:34:44.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.186+0000 7f178119e640 1 -- 172.21.15.8:0/3199951711 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f177c15bbb0 con 0x7f177c149990 2023-10-14T10:34:44.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.188+0000 7f17797fa640 1 -- 172.21.15.8:0/3199951711 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12725 (secure 0 0 0) 0x7f1764019090 con 0x7f177c149990 2023-10-14T10:34:44.191 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:44.191 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":30,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:34:40.027741+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.191+0000 7f178119e640 1 -- 172.21.15.8:0/3199951711 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f175c06aea0 msgr2=0x7f175c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.191+0000 7f178119e640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f175c06aea0 0x7f175c06d360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f176c00ba00 tx=0x7f176c03d040 comp rx=0 tx=0).stop 2023-10-14T10:34:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.191+0000 7f178119e640 1 -- 172.21.15.8:0/3199951711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f177c149990 msgr2=0x7f177c14e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.191+0000 7f178119e640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f177c149990 0x7f177c14e070 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f176400d7e0 tx=0x7f176400dca0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.191+0000 7f178119e640 1 -- 172.21.15.8:0/3199951711 shutdown_connections 2023-10-14T10:34:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.191+0000 7f178119e640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f175c06aea0 0x7f175c06d360 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.191+0000 7f178119e640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f177c0c5da0 0x7f177c148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.191+0000 7f178119e640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f177c149990 0x7f177c14e070 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.191+0000 7f178119e640 1 --2- 172.21.15.8:0/3199951711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1768003970 0x7f177c0c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.191+0000 7f178119e640 1 -- 172.21.15.8:0/3199951711 >> 172.21.15.8:0/3199951711 conn(0x7f177c06a200 msgr2=0x7f177c153630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.191+0000 7f178119e640 1 -- 172.21.15.8:0/3199951711 shutdown_connections 2023-10-14T10:34:44.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.191+0000 7f178119e640 1 -- 172.21.15.8:0/3199951711 wait complete. 2023-10-14T10:34:44.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:34:44.213 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:34:44.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.439+0000 7f6d28ed7640 1 Processor -- start 2023-10-14T10:34:44.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.440+0000 7f6d28ed7640 1 -- start start 2023-10-14T10:34:44.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.441+0000 7f6d28ed7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6d240c1290 0x7f6d24150d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.441+0000 7f6d28ed7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d24071580 con 0x7f6d240c0080 2023-10-14T10:34:44.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.441+0000 7f6d28ed7640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d24071860 con 0x7f6d2413a2d0 2023-10-14T10:34:44.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.441+0000 7f6d28ed7640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2413a6b0 con 0x7f6d240c1290 2023-10-14T10:34:44.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.441+0000 7f6d21d9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6d240c1290 0x7f6d24150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:44.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.441+0000 7f6d22d9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6d240c0080 0x7f6d240c0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35464/0 (socket says 172.21.15.8:35464) 2023-10-14T10:34:44.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.441+0000 7f6d22d9d640 1 -- 172.21.15.8:0/3332561774 learned_addr learned my addr 172.21.15.8:0/3332561774 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:44.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.442+0000 7f6d21d9b640 1 -- 172.21.15.8:0/3332561774 >> v1:172.21.15.92:6789/0 conn(0x7f6d2413a2d0 legacy=0x7f6d240c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.442+0000 7f6d21d9b640 1 -- 172.21.15.8:0/3332561774 >> v1:172.21.15.8:6789/0 conn(0x7f6d240c0080 legacy=0x7f6d240c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.442+0000 7f6d21d9b640 1 -- 172.21.15.8:0/3332561774 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24071b40 con 0x7f6d240c1290 2023-10-14T10:34:44.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.442+0000 7f6d2159a640 1 -- 172.21.15.8:0/3332561774 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145172789 0 0) 0x7f6d24071580 con 0x7f6d240c0080 2023-10-14T10:34:44.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.443+0000 7f6d21d9b640 1 --2- 172.21.15.8:0/3332561774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d240c1290 0x7f6d24150d30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0097a0 tx=0x7f6d0c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9caf512b016ae53 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:44.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.443+0000 7f6d2159a640 1 -- 172.21.15.8:0/3332561774 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c030610 con 0x7f6d240c1290 2023-10-14T10:34:44.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.444+0000 7f6d2159a640 1 -- 172.21.15.8:0/3332561774 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0c030770 con 0x7f6d240c1290 2023-10-14T10:34:44.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.444+0000 7f6d2159a640 1 -- 172.21.15.8:0/3332561774 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c030b00 con 0x7f6d240c1290 2023-10-14T10:34:44.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.444+0000 7f6d28ed7640 1 -- 172.21.15.8:0/3332561774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d240c1290 msgr2=0x7f6d24150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.444+0000 7f6d28ed7640 1 --2- 172.21.15.8:0/3332561774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d240c1290 0x7f6d24150d30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0097a0 tx=0x7f6d0c02b960 comp rx=0 tx=0).stop 2023-10-14T10:34:44.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.444+0000 7f6d28ed7640 1 -- 172.21.15.8:0/3332561774 shutdown_connections 2023-10-14T10:34:44.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.444+0000 7f6d28ed7640 1 --2- 172.21.15.8:0/3332561774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d240c1290 0x7f6d24150d30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.444+0000 7f6d28ed7640 1 -- 172.21.15.8:0/3332561774 >> 172.21.15.8:0/3332561774 conn(0x7f6d24069de0 msgr2=0x7f6d2406a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:44.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.444+0000 7f6d28ed7640 1 -- 172.21.15.8:0/3332561774 shutdown_connections 2023-10-14T10:34:44.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.444+0000 7f6d28ed7640 1 -- 172.21.15.8:0/3332561774 wait complete. 2023-10-14T10:34:44.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.446+0000 7f6d28ed7640 1 Processor -- start 2023-10-14T10:34:44.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.446+0000 7f6d28ed7640 1 -- start start 2023-10-14T10:34:44.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.447+0000 7f6d28ed7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d240c0080 0x7f6d241dea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.447+0000 7f6d28ed7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d240c1290 0x7f6d240bac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.447+0000 7f6d28ed7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d2413a2d0 0x7f6d240bb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.447+0000 7f6d28ed7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d241eaae0 con 0x7f6d240c0080 2023-10-14T10:34:44.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.447+0000 7f6d28ed7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240ba850 con 0x7f6d2413a2d0 2023-10-14T10:34:44.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.447+0000 7f6d28ed7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2414eed0 con 0x7f6d240c1290 2023-10-14T10:34:44.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.447+0000 7f6d2259c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d240c0080 0x7f6d241dea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:44.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.447+0000 7f6d2259c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d240c0080 0x7f6d241dea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46096/0 (socket says 172.21.15.8:46096) 2023-10-14T10:34:44.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.447+0000 7f6d2259c640 1 -- 172.21.15.8:0/1527517020 learned_addr learned my addr 172.21.15.8:0/1527517020 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:44.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.448+0000 7f6d21d9b640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d240c1290 0x7f6d240bac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:44.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.448+0000 7f6d2259c640 1 -- 172.21.15.8:0/1527517020 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d240c1290 msgr2=0x7f6d240bac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.448+0000 7f6d2259c640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d240c1290 0x7f6d240bac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.448+0000 7f6d2259c640 1 -- 172.21.15.8:0/1527517020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d2413a2d0 msgr2=0x7f6d240bb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.448+0000 7f6d2259c640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d2413a2d0 0x7f6d240bb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.448+0000 7f6d2259c640 1 -- 172.21.15.8:0/1527517020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c009400 con 0x7f6d240c0080 2023-10-14T10:34:44.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.448+0000 7f6d2259c640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d240c0080 0x7f6d241dea10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400c7d0 tx=0x7f6d1400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:44.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.448+0000 7f6d1affd640 1 -- 172.21.15.8:0/1527517020 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d14003b70 con 0x7f6d240c0080 2023-10-14T10:34:44.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.448+0000 7f6d1affd640 1 -- 172.21.15.8:0/1527517020 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d14003cd0 con 0x7f6d240c0080 2023-10-14T10:34:44.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.448+0000 7f6d1affd640 1 -- 172.21.15.8:0/1527517020 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1400aa70 con 0x7f6d240c0080 2023-10-14T10:34:44.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.448+0000 7f6d28ed7640 1 -- 172.21.15.8:0/1527517020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d240ba4e0 con 0x7f6d240c0080 2023-10-14T10:34:44.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.449+0000 7f6d28ed7640 1 -- 172.21.15.8:0/1527517020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d241def50 con 0x7f6d240c0080 2023-10-14T10:34:44.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.450+0000 7f6d28ed7640 1 -- 172.21.15.8:0/1527517020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d240baac0 con 0x7f6d240c0080 2023-10-14T10:34:44.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.451+0000 7f6d1affd640 1 -- 172.21.15.8:0/1527517020 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6d1400abd0 con 0x7f6d240c0080 2023-10-14T10:34:44.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.452+0000 7f6d1affd640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6d0406ae70 0x7f6d0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.452+0000 7f6d1affd640 1 -- 172.21.15.8:0/1527517020 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6d140890a0 con 0x7f6d240c0080 2023-10-14T10:34:44.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.452+0000 7f6d21d9b640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6d0406ae70 0x7f6d0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:44.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.453+0000 7f6d21d9b640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6d0406ae70 0x7f6d0406d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c036000 tx=0x7f6d0c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:44.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.456+0000 7f6d1affd640 1 -- 172.21.15.8:0/1527517020 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d14054530 con 0x7f6d240c0080 2023-10-14T10:34:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.651+0000 7f6d28ed7640 1 -- 172.21.15.8:0/1527517020 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d240c1980 con 0x7f6d240c0080 2023-10-14T10:34:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.651+0000 7f6d1affd640 1 -- 172.21.15.8:0/1527517020 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d14057b50 con 0x7f6d240c0080 2023-10-14T10:34:44.654 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:34:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.654+0000 7f6d28ed7640 1 -- 172.21.15.8:0/1527517020 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6d0406ae70 msgr2=0x7f6d0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.654+0000 7f6d28ed7640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6d0406ae70 0x7f6d0406d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c036000 tx=0x7f6d0c03b040 comp rx=0 tx=0).stop 2023-10-14T10:34:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.654+0000 7f6d28ed7640 1 -- 172.21.15.8:0/1527517020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d240c0080 msgr2=0x7f6d241dea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.654+0000 7f6d28ed7640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d240c0080 0x7f6d241dea10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400c7d0 tx=0x7f6d1400cc90 comp rx=0 tx=0).stop 2023-10-14T10:34:44.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.654+0000 7f6d28ed7640 1 -- 172.21.15.8:0/1527517020 shutdown_connections 2023-10-14T10:34:44.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.654+0000 7f6d28ed7640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6d0406ae70 0x7f6d0406d330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.654+0000 7f6d28ed7640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d2413a2d0 0x7f6d240bb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.654+0000 7f6d28ed7640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d240c1290 0x7f6d240bac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.654+0000 7f6d28ed7640 1 --2- 172.21.15.8:0/1527517020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d240c0080 0x7f6d241dea10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.654+0000 7f6d28ed7640 1 -- 172.21.15.8:0/1527517020 >> 172.21.15.8:0/1527517020 conn(0x7f6d24069de0 msgr2=0x7f6d2406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:44.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.655+0000 7f6d28ed7640 1 -- 172.21.15.8:0/1527517020 shutdown_connections 2023-10-14T10:34:44.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.655+0000 7f6d28ed7640 1 -- 172.21.15.8:0/1527517020 wait complete. 2023-10-14T10:34:44.677 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T10:34:44.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.897+0000 7fb1679a4640 1 Processor -- start 2023-10-14T10:34:44.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.898+0000 7fb1679a4640 1 -- start start 2023-10-14T10:34:44.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.899+0000 7fb1679a4640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb16006b300 0x7fb16015cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.899+0000 7fb1679a4640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb160070c20 con 0x7fb160065d20 2023-10-14T10:34:44.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.899+0000 7fb1679a4640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1600715e0 con 0x7fb16006e470 2023-10-14T10:34:44.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.899+0000 7fb1679a4640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb160071a70 con 0x7fb16006b300 2023-10-14T10:34:44.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.899+0000 7fb165740640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb160065d20 0x7fb160069de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35470/0 (socket says 172.21.15.8:35470) 2023-10-14T10:34:44.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.899+0000 7fb165740640 1 -- 172.21.15.8:0/1945343113 learned_addr learned my addr 172.21.15.8:0/1945343113 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:44.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.900+0000 7fb165f41640 1 --2- 172.21.15.8:0/1945343113 >> v2:172.21.15.92:3300/0 conn(0x7fb16006b300 0x7fb16015cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:44.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.900+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666422057 0 0) 0x7fb160070c20 con 0x7fb160065d20 2023-10-14T10:34:44.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.900+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb14c003520 con 0x7fb160065d20 2023-10-14T10:34:44.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.900+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1522808174 0 0) 0x7fb14c003520 con 0x7fb160065d20 2023-10-14T10:34:44.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.900+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 >> v2:172.21.15.92:3300/0 conn(0x7fb16006b300 msgr2=0x7fb16015cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:44.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.900+0000 7fb157fff640 1 --2- 172.21.15.8:0/1945343113 >> v2:172.21.15.92:3300/0 conn(0x7fb16006b300 0x7fb16015cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.900+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 >> v1:172.21.15.92:6789/0 conn(0x7fb16006e470 legacy=0x7fb16006a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.900+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600709b0 con 0x7fb160065d20 2023-10-14T10:34:44.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.900+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fb15c0019f0 con 0x7fb160065d20 2023-10-14T10:34:44.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.900+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 >> v1:172.21.15.8:6789/0 conn(0x7fb160065d20 legacy=0x7fb160069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.901+0000 7fb157fff640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 0x7fb14c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.901+0000 7fb157fff640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb14c0047c0 0x7fb14c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.901+0000 7fb157fff640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb14c0052a0 0x7fb14c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.901+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb160071a70 con 0x7fb14c0039c0 2023-10-14T10:34:44.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.901+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c00c1a0 con 0x7fb14c0052a0 2023-10-14T10:34:44.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.901+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c00c360 con 0x7fb14c0047c0 2023-10-14T10:34:44.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.901+0000 7fb165740640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 0x7fb14c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:44.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.901+0000 7fb165740640 1 -- 172.21.15.8:0/1945343113 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb14c0047c0 msgr2=0x7fb14c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:44.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.901+0000 7fb164f3f640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb14c0047c0 0x7fb14c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:44.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.901+0000 7fb165f41640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb14c0052a0 0x7fb14c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:44.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.902+0000 7fb165740640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb14c0047c0 0x7fb14c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.902+0000 7fb165740640 1 -- 172.21.15.8:0/1945343113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb14c0052a0 msgr2=0x7fb14c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:44.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.902+0000 7fb165740640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb14c0052a0 0x7fb14c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.902+0000 7fb165740640 1 -- 172.21.15.8:0/1945343113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c003520 con 0x7fb14c0039c0 2023-10-14T10:34:44.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.902+0000 7fb164f3f640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb14c0047c0 0x7fb14c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:44.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.902+0000 7fb165f41640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb14c0052a0 0x7fb14c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:44.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.902+0000 7fb165f41640 1 -- 172.21.15.8:0/1945343113 reap_dead start 2023-10-14T10:34:44.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.903+0000 7fb165740640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 0x7fb14c003de0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00a730 tx=0x7fb14c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36971eff1c8c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:44.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.903+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c034630 con 0x7fb14c0039c0 2023-10-14T10:34:44.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.903+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c02f070 con 0x7fb14c0039c0 2023-10-14T10:34:44.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.903+0000 7fb157fff640 1 -- 172.21.15.8:0/1945343113 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c034a50 con 0x7fb14c0039c0 2023-10-14T10:34:44.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.904+0000 7fb1679a4640 1 -- 172.21.15.8:0/1945343113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 msgr2=0x7fb14c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.904+0000 7fb1679a4640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 0x7fb14c003de0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00a730 tx=0x7fb14c0057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.904+0000 7fb1679a4640 1 -- 172.21.15.8:0/1945343113 shutdown_connections 2023-10-14T10:34:44.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.904+0000 7fb1679a4640 1 --2- 172.21.15.8:0/1945343113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 0x7fb14c003de0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.904+0000 7fb1679a4640 1 -- 172.21.15.8:0/1945343113 >> 172.21.15.8:0/1945343113 conn(0x7fb1600c2770 msgr2=0x7fb1600c2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:44.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.904+0000 7fb1679a4640 1 -- 172.21.15.8:0/1945343113 shutdown_connections 2023-10-14T10:34:44.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.904+0000 7fb1679a4640 1 -- 172.21.15.8:0/1945343113 wait complete. 2023-10-14T10:34:44.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.906+0000 7fb1679a4640 1 Processor -- start 2023-10-14T10:34:44.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.907+0000 7fb1679a4640 1 -- start start 2023-10-14T10:34:44.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.908+0000 7fb1679a4640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 0x7fb1601ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.908+0000 7fb1679a4640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1600a6570 0x7fb16014c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.908+0000 7fb1679a4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb16014d0d0 0x7fb1601e9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.908+0000 7fb1679a4640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600bba20 con 0x7fb14c0039c0 2023-10-14T10:34:44.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.908+0000 7fb1679a4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1601ed9d0 con 0x7fb16014d0d0 2023-10-14T10:34:44.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.908+0000 7fb1679a4640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600a7660 con 0x7fb1600a6570 2023-10-14T10:34:44.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.908+0000 7fb165740640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 0x7fb1601ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:44.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.908+0000 7fb165740640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 0x7fb1601ed490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46104/0 (socket says 172.21.15.8:46104) 2023-10-14T10:34:44.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.908+0000 7fb165740640 1 -- 172.21.15.8:0/262424031 learned_addr learned my addr 172.21.15.8:0/262424031 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:44.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.909+0000 7fb165740640 1 -- 172.21.15.8:0/262424031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1600a6570 msgr2=0x7fb16014c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.909+0000 7fb164f3f640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1600a6570 0x7fb16014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:44.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.909+0000 7fb165740640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1600a6570 0x7fb16014c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.909+0000 7fb165f41640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb16014d0d0 0x7fb1601e9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:44.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.909+0000 7fb165740640 1 -- 172.21.15.8:0/262424031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb16014d0d0 msgr2=0x7fb1601e9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:44.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.909+0000 7fb165740640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb16014d0d0 0x7fb1601e9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:44.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.909+0000 7fb165740640 1 -- 172.21.15.8:0/262424031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1601e9510 con 0x7fb14c0039c0 2023-10-14T10:34:44.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.909+0000 7fb165740640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 0x7fb1601ed490 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb15c02ca70 tx=0x7fb160071550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:44.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.909+0000 7fb155ffb640 1 -- 172.21.15.8:0/262424031 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0348c0 con 0x7fb14c0039c0 2023-10-14T10:34:44.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.909+0000 7fb155ffb640 1 -- 172.21.15.8:0/262424031 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c034a20 con 0x7fb14c0039c0 2023-10-14T10:34:44.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.910+0000 7fb155ffb640 1 -- 172.21.15.8:0/262424031 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c034d90 con 0x7fb14c0039c0 2023-10-14T10:34:44.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.910+0000 7fb1679a4640 1 -- 172.21.15.8:0/262424031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16014ce80 con 0x7fb14c0039c0 2023-10-14T10:34:44.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.910+0000 7fb1679a4640 1 -- 172.21.15.8:0/262424031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb160152610 con 0x7fb14c0039c0 2023-10-14T10:34:44.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.911+0000 7fb1679a4640 1 -- 172.21.15.8:0/262424031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1600bcc90 con 0x7fb14c0039c0 2023-10-14T10:34:44.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.912+0000 7fb155ffb640 1 -- 172.21.15.8:0/262424031 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb15c031030 con 0x7fb14c0039c0 2023-10-14T10:34:44.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.913+0000 7fb155ffb640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb14406ae70 0x7fb14406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:44.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.913+0000 7fb155ffb640 1 -- 172.21.15.8:0/262424031 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb15c0ab950 con 0x7fb14c0039c0 2023-10-14T10:34:44.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.913+0000 7fb164f3f640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb14406ae70 0x7fb14406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:44.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.914+0000 7fb164f3f640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb14406ae70 0x7fb14406d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb150000c00 tx=0x7fb150009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:44.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:44.918+0000 7fb155ffb640 1 -- 172.21.15.8:0/262424031 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1600bcc90 con 0x7fb14c0039c0 2023-10-14T10:34:45.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.114+0000 7fb1679a4640 1 -- 172.21.15.8:0/262424031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb1600bcc90 con 0x7fb14c0039c0 2023-10-14T10:34:45.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.115+0000 7fb155ffb640 1 -- 172.21.15.8:0/262424031 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb1600bcc90 con 0x7fb14c0039c0 2023-10-14T10:34:45.117 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:45.117 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2023-10-14T10:34:45.118 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T10:34:45.118 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2023-10-14T10:34:45.118 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2023-10-14T10:34:45.118 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T10:34:45.119 INFO:teuthology.orchestra.run.smithi008.stdout:] 2023-10-14T10:34:45.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.117+0000 7fb1679a4640 1 -- 172.21.15.8:0/262424031 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb14406ae70 msgr2=0x7fb14406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:45.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.117+0000 7fb1679a4640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb14406ae70 0x7fb14406d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb150000c00 tx=0x7fb150009040 comp rx=0 tx=0).stop 2023-10-14T10:34:45.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.117+0000 7fb1679a4640 1 -- 172.21.15.8:0/262424031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 msgr2=0x7fb1601ed490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:45.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.117+0000 7fb1679a4640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 0x7fb1601ed490 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb15c02ca70 tx=0x7fb160071550 comp rx=0 tx=0).stop 2023-10-14T10:34:45.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.117+0000 7fb1679a4640 1 -- 172.21.15.8:0/262424031 shutdown_connections 2023-10-14T10:34:45.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.117+0000 7fb1679a4640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb14406ae70 0x7fb14406d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:45.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.117+0000 7fb1679a4640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb16014d0d0 0x7fb1601e9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:45.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.117+0000 7fb1679a4640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1600a6570 0x7fb16014c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:45.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.117+0000 7fb1679a4640 1 --2- 172.21.15.8:0/262424031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb14c0039c0 0x7fb1601ed490 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:45.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.117+0000 7fb1679a4640 1 -- 172.21.15.8:0/262424031 >> 172.21.15.8:0/262424031 conn(0x7fb1600c2770 msgr2=0x7fb1600c1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:45.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.118+0000 7fb1679a4640 1 -- 172.21.15.8:0/262424031 shutdown_connections 2023-10-14T10:34:45.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.118+0000 7fb1679a4640 1 -- 172.21.15.8:0/262424031 wait complete. 2023-10-14T10:34:45.138 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-14T10:34:45.139 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-14T10:34:45.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.361+0000 7f090ec6f640 1 Processor -- start 2023-10-14T10:34:45.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.361+0000 7f090ec6f640 1 -- start start 2023-10-14T10:34:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.363+0000 7f090ec6f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f09080c0350 0x7f0908152400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:45.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.363+0000 7f090ec6f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f090806fca0 0x7f0908152940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.363+0000 7f090ec6f640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0908152e80 con 0x7f090814f420 2023-10-14T10:34:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.363+0000 7f090ec6f640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0908151f70 con 0x7f090806fca0 2023-10-14T10:34:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.363+0000 7f090ec6f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09080c1ae0 con 0x7f09080c0350 2023-10-14T10:34:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.363+0000 7f090d20c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f090806fca0 0x7f0908152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:45.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.363+0000 7f090d20c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f090806fca0 0x7f0908152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46108/0 (socket says 172.21.15.8:46108) 2023-10-14T10:34:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.363+0000 7f090d20c640 1 -- 172.21.15.8:0/3332747077 learned_addr learned my addr 172.21.15.8:0/3332747077 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.363+0000 7f08fffff640 1 --2- 172.21.15.8:0/3332747077 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f09080c0350 0x7f0908152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.363+0000 7f090d20c640 1 -- 172.21.15.8:0/3332747077 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f09080c0350 msgr2=0x7f0908152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.363+0000 7f090d20c640 1 --2- 172.21.15.8:0/3332747077 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f09080c0350 0x7f0908152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:45.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.363+0000 7f090d20c640 1 -- 172.21.15.8:0/3332747077 >> v1:172.21.15.92:6789/0 conn(0x7f090814f420 legacy=0x7f09080705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:45.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.364+0000 7f090d20c640 1 -- 172.21.15.8:0/3332747077 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09080c1dc0 con 0x7f090806fca0 2023-10-14T10:34:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.365+0000 7f090d20c640 1 --2- 172.21.15.8:0/3332747077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f090806fca0 0x7f0908152940 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0900009e50 tx=0x7f090002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd257774d92f16d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.365+0000 7f08ff7fe640 1 -- 172.21.15.8:0/3332747077 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090002c9e0 con 0x7f090806fca0 2023-10-14T10:34:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.365+0000 7f08ff7fe640 1 -- 172.21.15.8:0/3332747077 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090002cb40 con 0x7f090806fca0 2023-10-14T10:34:45.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.365+0000 7f08ff7fe640 1 -- 172.21.15.8:0/3332747077 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09000343f0 con 0x7f090806fca0 2023-10-14T10:34:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.366+0000 7f090ec6f640 1 -- 172.21.15.8:0/3332747077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f090806fca0 msgr2=0x7f0908152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.366+0000 7f090ec6f640 1 --2- 172.21.15.8:0/3332747077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f090806fca0 0x7f0908152940 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0900009e50 tx=0x7f090002be40 comp rx=0 tx=0).stop 2023-10-14T10:34:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.366+0000 7f090ec6f640 1 -- 172.21.15.8:0/3332747077 shutdown_connections 2023-10-14T10:34:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.366+0000 7f090ec6f640 1 --2- 172.21.15.8:0/3332747077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f090806fca0 0x7f0908152940 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:45.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.366+0000 7f090ec6f640 1 --2- 172.21.15.8:0/3332747077 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f09080c0350 0x7f0908152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.366+0000 7f090ec6f640 1 -- 172.21.15.8:0/3332747077 >> 172.21.15.8:0/3332747077 conn(0x7f0908069de0 msgr2=0x7f090806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.366+0000 7f090ec6f640 1 -- 172.21.15.8:0/3332747077 shutdown_connections 2023-10-14T10:34:45.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.366+0000 7f090ec6f640 1 -- 172.21.15.8:0/3332747077 wait complete. 2023-10-14T10:34:45.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.368+0000 7f090ec6f640 1 Processor -- start 2023-10-14T10:34:45.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.368+0000 7f090ec6f640 1 -- start start 2023-10-14T10:34:45.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.370+0000 7f090ec6f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f090806fca0 0x7f09081473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:45.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.370+0000 7f090ec6f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09080c0350 0x7f090814af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:45.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.370+0000 7f090ec6f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f090814f420 0x7f09081e7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:45.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.370+0000 7f090ec6f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080a9600 con 0x7f09080c0350 2023-10-14T10:34:45.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.370+0000 7f090ec6f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080c3f40 con 0x7f090814f420 2023-10-14T10:34:45.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.370+0000 7f090ec6f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090806dc60 con 0x7f090806fca0 2023-10-14T10:34:45.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.370+0000 7f08fffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09080c0350 0x7f090814af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:45.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.370+0000 7f08fffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09080c0350 0x7f090814af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46120/0 (socket says 172.21.15.8:46120) 2023-10-14T10:34:45.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.370+0000 7f08fffff640 1 -- 172.21.15.8:0/1383675782 learned_addr learned my addr 172.21.15.8:0/1383675782 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:45.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.370+0000 7f090ca0b640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f090806fca0 0x7f09081473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:45.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f08fffff640 1 -- 172.21.15.8:0/1383675782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f090806fca0 msgr2=0x7f09081473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:45.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f08fffff640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f090806fca0 0x7f09081473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:45.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f08fffff640 1 -- 172.21.15.8:0/1383675782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f090814f420 msgr2=0x7f09081e7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:45.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f090d20c640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f090814f420 0x7f09081e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:45.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f08fffff640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f090814f420 0x7f09081e7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f08fffff640 1 -- 172.21.15.8:0/1383675782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900009b30 con 0x7f09080c0350 2023-10-14T10:34:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f090ca0b640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f090806fca0 0x7f09081473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f090d20c640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f090814f420 0x7f09081e7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f08fffff640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09080c0350 0x7f090814af70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f08f800c7f0 tx=0x7f08f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f08fd7fa640 1 -- 172.21.15.8:0/1383675782 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8004220 con 0x7f09080c0350 2023-10-14T10:34:45.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f08fd7fa640 1 -- 172.21.15.8:0/1383675782 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f80043a0 con 0x7f09080c0350 2023-10-14T10:34:45.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f08fd7fa640 1 -- 172.21.15.8:0/1383675782 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8007860 con 0x7f09080c0350 2023-10-14T10:34:45.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.371+0000 7f090ec6f640 1 -- 172.21.15.8:0/1383675782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09080a8df0 con 0x7f09080c0350 2023-10-14T10:34:45.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.372+0000 7f090ec6f640 1 -- 172.21.15.8:0/1383675782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09080a9320 con 0x7f09080c0350 2023-10-14T10:34:45.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.372+0000 7f090ec6f640 1 -- 172.21.15.8:0/1383675782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0908073b50 con 0x7f09080c0350 2023-10-14T10:34:45.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.374+0000 7f08fd7fa640 1 -- 172.21.15.8:0/1383675782 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f08f8007bd0 con 0x7f09080c0350 2023-10-14T10:34:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.374+0000 7f08fd7fa640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f08f406ae70 0x7f08f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.375+0000 7f08fd7fa640 1 -- 172.21.15.8:0/1383675782 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f08f8089250 con 0x7f09080c0350 2023-10-14T10:34:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.375+0000 7f090ca0b640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f08f406ae70 0x7f08f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.375+0000 7f090ca0b640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f08f406ae70 0x7f08f406d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f09080aa060 tx=0x7f0904008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:45.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.379+0000 7f08fd7fa640 1 -- 172.21.15.8:0/1383675782 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08f8054640 con 0x7f09080c0350 2023-10-14T10:34:45.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:45.564+0000 7f090ec6f640 1 -- 172.21.15.8:0/1383675782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f09080c0130 con 0x7f09080c0350 2023-10-14T10:34:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.047+0000 7f08fd7fa640 1 -- 172.21.15.8:0/1383675782 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v31) v1 ==== 148+0+0 (secure 0 0 0) 0x7f08f8057c60 con 0x7f09080c0350 2023-10-14T10:34:46.049 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'testcephfs1_metadata' created 2023-10-14T10:34:46.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.051+0000 7f090ec6f640 1 -- 172.21.15.8:0/1383675782 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f08f406ae70 msgr2=0x7f08f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:46.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.051+0000 7f090ec6f640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f08f406ae70 0x7f08f406d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f09080aa060 tx=0x7f0904008040 comp rx=0 tx=0).stop 2023-10-14T10:34:46.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.051+0000 7f090ec6f640 1 -- 172.21.15.8:0/1383675782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09080c0350 msgr2=0x7f090814af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:46.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.051+0000 7f090ec6f640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09080c0350 0x7f090814af70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f08f800c7f0 tx=0x7f08f800ccb0 comp rx=0 tx=0).stop 2023-10-14T10:34:46.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.052+0000 7f090ec6f640 1 -- 172.21.15.8:0/1383675782 shutdown_connections 2023-10-14T10:34:46.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.052+0000 7f090ec6f640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f08f406ae70 0x7f08f406d330 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:46.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.052+0000 7f090ec6f640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f090814f420 0x7f09081e7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:46.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.052+0000 7f090ec6f640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09080c0350 0x7f090814af70 secure :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f08f800c7f0 tx=0x7f08f800ccb0 comp rx=0 tx=0).stop 2023-10-14T10:34:46.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.052+0000 7f090ec6f640 1 --2- 172.21.15.8:0/1383675782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f090806fca0 0x7f09081473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:46.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.052+0000 7f090ec6f640 1 -- 172.21.15.8:0/1383675782 >> 172.21.15.8:0/1383675782 conn(0x7f0908069de0 msgr2=0x7f0908152400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:46.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.053+0000 7f090ec6f640 1 -- 172.21.15.8:0/1383675782 shutdown_connections 2023-10-14T10:34:46.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.053+0000 7f090ec6f640 1 -- 172.21.15.8:0/1383675782 wait complete. 2023-10-14T10:34:46.078 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T10:34:46.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.292+0000 7f968a5f4640 1 Processor -- start 2023-10-14T10:34:46.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.292+0000 7f968a5f4640 1 -- start start 2023-10-14T10:34:46.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.294+0000 7f968a5f4640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9684139470 0x7f9684154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:46.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.294+0000 7f968a5f4640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9684152090 0x7f96841515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:46.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.294+0000 7f968a5f4640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96841550e0 con 0x7f968406b740 2023-10-14T10:34:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.294+0000 7f968a5f4640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9684151190 con 0x7f9684139470 2023-10-14T10:34:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.294+0000 7f968a5f4640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9684150ba0 con 0x7f9684152090 2023-10-14T10:34:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.294+0000 7f96895f2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9684139470 0x7f9684154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.294+0000 7f96895f2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9684139470 0x7f9684154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46124/0 (socket says 172.21.15.8:46124) 2023-10-14T10:34:46.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.294+0000 7f96895f2640 1 -- 172.21.15.8:0/21875697 learned_addr learned my addr 172.21.15.8:0/21875697 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:46.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.295+0000 7f9688df1640 1 --2- 172.21.15.8:0/21875697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9684152090 0x7f96841515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:46.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.295+0000 7f96895f2640 1 -- 172.21.15.8:0/21875697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9684152090 msgr2=0x7f96841515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:46.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.295+0000 7f96895f2640 1 --2- 172.21.15.8:0/21875697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9684152090 0x7f96841515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:46.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.295+0000 7f96895f2640 1 -- 172.21.15.8:0/21875697 >> v1:172.21.15.92:6789/0 conn(0x7f968406b740 legacy=0x7f96840bfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:46.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.295+0000 7f96895f2640 1 -- 172.21.15.8:0/21875697 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684139850 con 0x7f9684139470 2023-10-14T10:34:46.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.295+0000 7f9688df1640 1 --2- 172.21.15.8:0/21875697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9684152090 0x7f96841515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:46.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.296+0000 7f96895f2640 1 --2- 172.21.15.8:0/21875697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9684139470 0x7f9684154ba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9680009870 tx=0x7f968002b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4519ccfe2d990df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:46.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.296+0000 7f967bfff640 1 -- 172.21.15.8:0/21875697 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680033620 con 0x7f9684139470 2023-10-14T10:34:46.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.296+0000 7f967bfff640 1 -- 172.21.15.8:0/21875697 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9680033780 con 0x7f9684139470 2023-10-14T10:34:46.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.296+0000 7f967bfff640 1 -- 172.21.15.8:0/21875697 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680033b10 con 0x7f9684139470 2023-10-14T10:34:46.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.297+0000 7f968a5f4640 1 -- 172.21.15.8:0/21875697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9684139470 msgr2=0x7f9684154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:46.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.297+0000 7f968a5f4640 1 --2- 172.21.15.8:0/21875697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9684139470 0x7f9684154ba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9680009870 tx=0x7f968002b7d0 comp rx=0 tx=0).stop 2023-10-14T10:34:46.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.297+0000 7f968a5f4640 1 -- 172.21.15.8:0/21875697 shutdown_connections 2023-10-14T10:34:46.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.297+0000 7f968a5f4640 1 --2- 172.21.15.8:0/21875697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9684152090 0x7f96841515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:46.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.297+0000 7f968a5f4640 1 --2- 172.21.15.8:0/21875697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9684139470 0x7f9684154ba0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:46.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.297+0000 7f968a5f4640 1 -- 172.21.15.8:0/21875697 >> 172.21.15.8:0/21875697 conn(0x7f96840c1d70 msgr2=0x7f96840c2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:46.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.297+0000 7f968a5f4640 1 -- 172.21.15.8:0/21875697 shutdown_connections 2023-10-14T10:34:46.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.297+0000 7f968a5f4640 1 -- 172.21.15.8:0/21875697 wait complete. 2023-10-14T10:34:46.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.299+0000 7f968a5f4640 1 Processor -- start 2023-10-14T10:34:46.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.299+0000 7f968a5f4640 1 -- start start 2023-10-14T10:34:46.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.300+0000 7f968a5f4640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968406b740 0x7f96841537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:46.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.300+0000 7f968a5f4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9684139470 0x7f968412e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:46.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.300+0000 7f968a5f4640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9684152090 0x7f968412ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:46.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.300+0000 7f968a5f4640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968412cb90 con 0x7f968406b740 2023-10-14T10:34:46.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.300+0000 7f968a5f4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96840c4f40 con 0x7f9684139470 2023-10-14T10:34:46.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.300+0000 7f968a5f4640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968412da00 con 0x7f9684152090 2023-10-14T10:34:46.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.301+0000 7f96895f2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968406b740 0x7f96841537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:46.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.301+0000 7f96895f2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968406b740 0x7f96841537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46138/0 (socket says 172.21.15.8:46138) 2023-10-14T10:34:46.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.301+0000 7f96895f2640 1 -- 172.21.15.8:0/1125008071 learned_addr learned my addr 172.21.15.8:0/1125008071 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:46.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.301+0000 7f9688df1640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9684139470 0x7f968412e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:46.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.301+0000 7f9689df3640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9684152090 0x7f968412ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:46.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.301+0000 7f96895f2640 1 -- 172.21.15.8:0/1125008071 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9684152090 msgr2=0x7f968412ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.301+0000 7f96895f2640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9684152090 0x7f968412ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.301+0000 7f96895f2640 1 -- 172.21.15.8:0/1125008071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9684139470 msgr2=0x7f968412e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:46.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.301+0000 7f96895f2640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9684139470 0x7f968412e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.301+0000 7f96895f2640 1 -- 172.21.15.8:0/1125008071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96800094d0 con 0x7f968406b740 2023-10-14T10:34:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.301+0000 7f96895f2640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968406b740 0x7f96841537b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9680009990 tx=0x7f96800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.302+0000 7f9679ffb640 1 -- 172.21.15.8:0/1125008071 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680032c00 con 0x7f968406b740 2023-10-14T10:34:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.302+0000 7f9679ffb640 1 -- 172.21.15.8:0/1125008071 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9680032d80 con 0x7f968406b740 2023-10-14T10:34:46.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.302+0000 7f968a5f4640 1 -- 172.21.15.8:0/1125008071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96841ecd30 con 0x7f968406b740 2023-10-14T10:34:46.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.302+0000 7f9679ffb640 1 -- 172.21.15.8:0/1125008071 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968003d6b0 con 0x7f968406b740 2023-10-14T10:34:46.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.302+0000 7f968a5f4640 1 -- 172.21.15.8:0/1125008071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968412df50 con 0x7f968406b740 2023-10-14T10:34:46.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.303+0000 7f968a5f4640 1 -- 172.21.15.8:0/1125008071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968404e9b0 con 0x7f968406b740 2023-10-14T10:34:46.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.305+0000 7f9679ffb640 1 -- 172.21.15.8:0/1125008071 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f968003a040 con 0x7f968406b740 2023-10-14T10:34:46.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.306+0000 7f9679ffb640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f966806ae70 0x7f966806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:46.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.306+0000 7f9679ffb640 1 -- 172.21.15.8:0/1125008071 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5232+0+0 (secure 0 0 0) 0x7f96800ab8d0 con 0x7f968406b740 2023-10-14T10:34:46.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.306+0000 7f9688df1640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f966806ae70 0x7f966806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.307+0000 7f9688df1640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f966806ae70 0x7f966806d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f96840bf3d0 tx=0x7f9674008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:46.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.310+0000 7f9679ffb640 1 -- 172.21.15.8:0/1125008071 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9680076d10 con 0x7f968406b740 2023-10-14T10:34:46.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:46.504+0000 7f968a5f4640 1 -- 172.21.15.8:0/1125008071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9684150d80 con 0x7f968406b740 2023-10-14T10:34:47.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.061+0000 7f9679ffb640 1 -- 172.21.15.8:0/1125008071 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v32) v1 ==== 180+0+0 (secure 0 0 0) 0x7f968007a330 con 0x7f968406b740 2023-10-14T10:34:47.064 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'testcephfs1_data' created 2023-10-14T10:34:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.067+0000 7f968a5f4640 1 -- 172.21.15.8:0/1125008071 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f966806ae70 msgr2=0x7f966806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.067+0000 7f968a5f4640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f966806ae70 0x7f966806d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f96840bf3d0 tx=0x7f9674008040 comp rx=0 tx=0).stop 2023-10-14T10:34:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.067+0000 7f968a5f4640 1 -- 172.21.15.8:0/1125008071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968406b740 msgr2=0x7f96841537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.067+0000 7f968a5f4640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968406b740 0x7f96841537b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9680009990 tx=0x7f96800046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.068+0000 7f968a5f4640 1 -- 172.21.15.8:0/1125008071 shutdown_connections 2023-10-14T10:34:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.068+0000 7f968a5f4640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f966806ae70 0x7f966806d330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.068+0000 7f968a5f4640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9684152090 0x7f968412ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.068+0000 7f968a5f4640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9684139470 0x7f968412e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.068+0000 7f968a5f4640 1 --2- 172.21.15.8:0/1125008071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f968406b740 0x7f96841537b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.068+0000 7f968a5f4640 1 -- 172.21.15.8:0/1125008071 >> 172.21.15.8:0/1125008071 conn(0x7f96840c1d70 msgr2=0x7f96840be600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.068+0000 7f968a5f4640 1 -- 172.21.15.8:0/1125008071 shutdown_connections 2023-10-14T10:34:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.068+0000 7f968a5f4640 1 -- 172.21.15.8:0/1125008071 wait complete. 2023-10-14T10:34:47.104 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-14T10:34:47.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.293+0000 7f361cc7c640 1 Processor -- start 2023-10-14T10:34:47.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.293+0000 7f361cc7c640 1 -- start start 2023-10-14T10:34:47.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.294+0000 7f361cc7c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f361814f3a0 0x7f3618071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:47.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.295+0000 7f361cc7c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618155440 0x7f361806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:47.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.295+0000 7f361cc7c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36180c57a0 con 0x7f361806dbd0 2023-10-14T10:34:47.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.295+0000 7f361cc7c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361806cee0 con 0x7f361814f3a0 2023-10-14T10:34:47.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.295+0000 7f361cc7c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3618151e50 con 0x7f3618155440 2023-10-14T10:34:47.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.295+0000 7f3616d9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f361806dbd0 0x7f3618152580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60362/0 (socket says 172.21.15.8:60362) 2023-10-14T10:34:47.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.295+0000 7f3616d9d640 1 -- 172.21.15.8:0/396192460 learned_addr learned my addr 172.21.15.8:0/396192460 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:47.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.295+0000 7f361659c640 1 --2- 172.21.15.8:0/396192460 >> v2:172.21.15.92:3300/0 conn(0x7f361814f3a0 0x7f3618071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:47.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.295+0000 7f360ffff640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618155440 0x7f361806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:47.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043130142 0 0) 0x7f36180c57a0 con 0x7f361806dbd0 2023-10-14T10:34:47.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3604003520 con 0x7f361806dbd0 2023-10-14T10:34:47.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 372434605 0 0) 0x7f3604003520 con 0x7f361806dbd0 2023-10-14T10:34:47.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618155440 msgr2=0x7f361806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:47.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618155440 0x7f361806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:47.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 >> v2:172.21.15.92:3300/0 conn(0x7f361814f3a0 msgr2=0x7f3618071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:47.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 --2- 172.21.15.8:0/396192460 >> v2:172.21.15.92:3300/0 conn(0x7f361814f3a0 0x7f3618071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:47.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36180c59f0 con 0x7f361806dbd0 2023-10-14T10:34:47.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f36100019f0 con 0x7f361806dbd0 2023-10-14T10:34:47.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 >> v1:172.21.15.8:6789/0 conn(0x7f361806dbd0 legacy=0x7f3618152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:47.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3604003970 0x7f3604003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:47.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36040047c0 0x7f3604004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:47.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618155440 0x7f3604005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:47.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361806cee0 con 0x7f3604003970 2023-10-14T10:34:47.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3618151e50 con 0x7f36040047c0 2023-10-14T10:34:47.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360400b980 con 0x7f3618155440 2023-10-14T10:34:47.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.296+0000 7f361659c640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3604003970 0x7f3604003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:47.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.297+0000 7f3616d9d640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618155440 0x7f3604005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.297+0000 7f360ffff640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36040047c0 0x7f3604004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.297+0000 7f361659c640 1 -- 172.21.15.8:0/396192460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618155440 msgr2=0x7f3604005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.297+0000 7f361659c640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618155440 0x7f3604005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.297+0000 7f361659c640 1 -- 172.21.15.8:0/396192460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36040047c0 msgr2=0x7f3604004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.297+0000 7f361659c640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36040047c0 0x7f3604004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:47.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.297+0000 7f361659c640 1 -- 172.21.15.8:0/396192460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3604003520 con 0x7f3604003970 2023-10-14T10:34:47.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.297+0000 7f3616d9d640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618155440 0x7f3604005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:47.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.298+0000 7f361659c640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3604003970 0x7f3604003d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3608009af0 tx=0x7f36040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8758bf2b89b3bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:47.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.299+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360802c710 con 0x7f3604003970 2023-10-14T10:34:47.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.299+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360802c870 con 0x7f3604003970 2023-10-14T10:34:47.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.299+0000 7f3615d9b640 1 -- 172.21.15.8:0/396192460 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360802cc00 con 0x7f3604003970 2023-10-14T10:34:47.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.299+0000 7f361cc7c640 1 -- 172.21.15.8:0/396192460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3604003970 msgr2=0x7f3604003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:47.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.299+0000 7f361cc7c640 1 --2- 172.21.15.8:0/396192460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3604003970 0x7f3604003d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3608009af0 tx=0x7f36040057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.299+0000 7f3616d9d640 1 -- 172.21.15.8:0/396192460 reap_dead start 2023-10-14T10:34:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.300+0000 7f361cc7c640 1 -- 172.21.15.8:0/396192460 shutdown_connections 2023-10-14T10:34:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.300+0000 7f361cc7c640 1 -- 172.21.15.8:0/396192460 >> 172.21.15.8:0/396192460 conn(0x7f36180a74d0 msgr2=0x7f36180a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.300+0000 7f361cc7c640 1 -- 172.21.15.8:0/396192460 shutdown_connections 2023-10-14T10:34:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.300+0000 7f361cc7c640 1 -- 172.21.15.8:0/396192460 wait complete. 2023-10-14T10:34:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.301+0000 7f361cc7c640 1 Processor -- start 2023-10-14T10:34:47.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.302+0000 7f361cc7c640 1 -- start start 2023-10-14T10:34:47.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361cc7c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3604003970 0x7f361814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:47.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361cc7c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f361814fa90 0x7f3618140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:47.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361cc7c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618149710 0x7f36181406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:47.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361cc7c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361814e640 con 0x7f3604003970 2023-10-14T10:34:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361cc7c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36181519b0 con 0x7f361814fa90 2023-10-14T10:34:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361cc7c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3618140be0 con 0x7f3618149710 2023-10-14T10:34:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3604003970 0x7f361814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3604003970 0x7f361814e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41036/0 (socket says 172.21.15.8:41036) 2023-10-14T10:34:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361659c640 1 -- 172.21.15.8:0/1216922354 learned_addr learned my addr 172.21.15.8:0/1216922354 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f360ffff640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f361814fa90 0x7f3618140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f3616d9d640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618149710 0x7f36181406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361659c640 1 -- 172.21.15.8:0/1216922354 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618149710 msgr2=0x7f36181406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361659c640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618149710 0x7f36181406a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361659c640 1 -- 172.21.15.8:0/1216922354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f361814fa90 msgr2=0x7f3618140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361659c640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f361814fa90 0x7f3618140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.303+0000 7f361659c640 1 -- 172.21.15.8:0/1216922354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618154ec0 con 0x7f3604003970 2023-10-14T10:34:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.304+0000 7f361659c640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3604003970 0x7f361814e100 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3608037040 tx=0x7f3608004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.304+0000 7f360effd640 1 -- 172.21.15.8:0/1216922354 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608003810 con 0x7f3604003970 2023-10-14T10:34:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.304+0000 7f360effd640 1 -- 172.21.15.8:0/1216922354 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360802de90 con 0x7f3604003970 2023-10-14T10:34:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.304+0000 7f360effd640 1 -- 172.21.15.8:0/1216922354 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608003b70 con 0x7f3604003970 2023-10-14T10:34:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.304+0000 7f361cc7c640 1 -- 172.21.15.8:0/1216922354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36181551a0 con 0x7f3604003970 2023-10-14T10:34:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.304+0000 7f361cc7c640 1 -- 172.21.15.8:0/1216922354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3618151640 con 0x7f3604003970 2023-10-14T10:34:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.306+0000 7f361cc7c640 1 -- 172.21.15.8:0/1216922354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3618151800 con 0x7f3604003970 2023-10-14T10:34:47.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.307+0000 7f360effd640 1 -- 172.21.15.8:0/1216922354 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3608003cd0 con 0x7f3604003970 2023-10-14T10:34:47.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.308+0000 7f360effd640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f35f806aea0 0x7f35f806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:47.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.308+0000 7f360effd640 1 -- 172.21.15.8:0/1216922354 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f36080ab3f0 con 0x7f3604003970 2023-10-14T10:34:47.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.309+0000 7f360ffff640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f35f806aea0 0x7f35f806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:47.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.309+0000 7f360ffff640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f35f806aea0 0x7f35f806d360 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f36180c02c0 tx=0x7f3600008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:47.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.313+0000 7f360effd640 1 -- 172.21.15.8:0/1216922354 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36080766b0 con 0x7f3604003970 2023-10-14T10:34:47.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:47.547+0000 7f361cc7c640 1 -- 172.21.15.8:0/1216922354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7f361804e9b0 con 0x7f3604003970 2023-10-14T10:34:48.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.475+0000 7f360effd640 1 -- 172.21.15.8:0/1216922354 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 187+0+0 (secure 0 0 0) 0x7f3608079cd0 con 0x7f3604003970 2023-10-14T10:34:48.477 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 4 and data pool 5 2023-10-14T10:34:48.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.479+0000 7f361cc7c640 1 -- 172.21.15.8:0/1216922354 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f35f806aea0 msgr2=0x7f35f806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:48.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.479+0000 7f361cc7c640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f35f806aea0 0x7f35f806d360 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f36180c02c0 tx=0x7f3600008040 comp rx=0 tx=0).stop 2023-10-14T10:34:48.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.479+0000 7f361cc7c640 1 -- 172.21.15.8:0/1216922354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3604003970 msgr2=0x7f361814e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:48.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.479+0000 7f361cc7c640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3604003970 0x7f361814e100 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3608037040 tx=0x7f3608004730 comp rx=0 tx=0).stop 2023-10-14T10:34:48.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.480+0000 7f361cc7c640 1 -- 172.21.15.8:0/1216922354 shutdown_connections 2023-10-14T10:34:48.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.480+0000 7f361cc7c640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f35f806aea0 0x7f35f806d360 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.480+0000 7f361cc7c640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3618149710 0x7f36181406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.480+0000 7f361cc7c640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f361814fa90 0x7f3618140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.480+0000 7f361cc7c640 1 --2- 172.21.15.8:0/1216922354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3604003970 0x7f361814e100 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.480+0000 7f361cc7c640 1 -- 172.21.15.8:0/1216922354 >> 172.21.15.8:0/1216922354 conn(0x7f36180a74d0 msgr2=0x7f3618152480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:48.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.481+0000 7f361cc7c640 1 -- 172.21.15.8:0/1216922354 shutdown_connections 2023-10-14T10:34:48.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.481+0000 7f361cc7c640 1 -- 172.21.15.8:0/1216922354 wait complete. 2023-10-14T10:34:48.507 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:48.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.684+0000 7f6d83fff640 1 Processor -- start 2023-10-14T10:34:48.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.684+0000 7f6d83fff640 1 -- start start 2023-10-14T10:34:48.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.686+0000 7f6d83fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6d8406b6e0 0x7f6d841555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:48.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.686+0000 7f6d83fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6d84155b00 0x7f6d8415c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:48.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.686+0000 7f6d83fff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d84151bf0 con 0x7f6d84152670 2023-10-14T10:34:48.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.686+0000 7f6d83fff640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d840bffd0 con 0x7f6d8406b6e0 2023-10-14T10:34:48.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.686+0000 7f6d83fff640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d840c02b0 con 0x7f6d84155b00 2023-10-14T10:34:48.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.687+0000 7f6d7bfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6d8406b6e0 0x7f6d841555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:48.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.687+0000 7f6d7bfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6d8406b6e0 0x7f6d841555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41038/0 (socket says 172.21.15.8:41038) 2023-10-14T10:34:48.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.687+0000 7f6d7bfff640 1 -- 172.21.15.8:0/3690531634 learned_addr learned my addr 172.21.15.8:0/3690531634 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:48.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.687+0000 7f6d837fe640 1 --2- 172.21.15.8:0/3690531634 >> v2:172.21.15.92:3300/0 conn(0x7f6d84155b00 0x7f6d8415c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:48.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.687+0000 7f6d7bfff640 1 -- 172.21.15.8:0/3690531634 >> v2:172.21.15.92:3300/0 conn(0x7f6d84155b00 msgr2=0x7f6d8415c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:48.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.687+0000 7f6d7bfff640 1 --2- 172.21.15.8:0/3690531634 >> v2:172.21.15.92:3300/0 conn(0x7f6d84155b00 0x7f6d8415c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.687+0000 7f6d7bfff640 1 -- 172.21.15.8:0/3690531634 >> v1:172.21.15.8:6789/0 conn(0x7f6d84152670 legacy=0x7f6d840c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:48.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.687+0000 7f6d7bfff640 1 -- 172.21.15.8:0/3690531634 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d840c0590 con 0x7f6d8406b6e0 2023-10-14T10:34:48.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.687+0000 7f6d837fe640 1 --2- 172.21.15.8:0/3690531634 >> v2:172.21.15.92:3300/0 conn(0x7f6d84155b00 0x7f6d8415c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:48.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.688+0000 7f6d7bfff640 1 --2- 172.21.15.8:0/3690531634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d8406b6e0 0x7f6d841555c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6d840c13f0 tx=0x7f6d6c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd31e16276c4015a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:48.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.689+0000 7f6d827fc640 1 -- 172.21.15.8:0/3690531634 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c031870 con 0x7f6d8406b6e0 2023-10-14T10:34:48.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.689+0000 7f6d827fc640 1 -- 172.21.15.8:0/3690531634 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c0319d0 con 0x7f6d8406b6e0 2023-10-14T10:34:48.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.689+0000 7f6d827fc640 1 -- 172.21.15.8:0/3690531634 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c031d60 con 0x7f6d8406b6e0 2023-10-14T10:34:48.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.689+0000 7f6d83fff640 1 -- 172.21.15.8:0/3690531634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d8406b6e0 msgr2=0x7f6d841555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:48.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.689+0000 7f6d83fff640 1 --2- 172.21.15.8:0/3690531634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d8406b6e0 0x7f6d841555c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6d840c13f0 tx=0x7f6d6c02b910 comp rx=0 tx=0).stop 2023-10-14T10:34:48.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.689+0000 7f6d83fff640 1 -- 172.21.15.8:0/3690531634 shutdown_connections 2023-10-14T10:34:48.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.689+0000 7f6d83fff640 1 --2- 172.21.15.8:0/3690531634 >> v2:172.21.15.92:3300/0 conn(0x7f6d84155b00 0x7f6d8415c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.689+0000 7f6d83fff640 1 --2- 172.21.15.8:0/3690531634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d8406b6e0 0x7f6d841555c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.689+0000 7f6d83fff640 1 -- 172.21.15.8:0/3690531634 >> 172.21.15.8:0/3690531634 conn(0x7f6d8406a200 msgr2=0x7f6d8406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:48.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.689+0000 7f6d83fff640 1 -- 172.21.15.8:0/3690531634 shutdown_connections 2023-10-14T10:34:48.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.689+0000 7f6d83fff640 1 -- 172.21.15.8:0/3690531634 wait complete. 2023-10-14T10:34:48.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.691+0000 7f6d83fff640 1 Processor -- start 2023-10-14T10:34:48.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.691+0000 7f6d83fff640 1 -- start start 2023-10-14T10:34:48.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.692+0000 7f6d83fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d8406b6e0 0x7f6d84152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:48.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.692+0000 7f6d83fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d84152670 0x7f6d8414c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:48.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.692+0000 7f6d83fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d84155b00 0x7f6d841ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:48.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.692+0000 7f6d83fff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8414b540 con 0x7f6d84152670 2023-10-14T10:34:48.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.692+0000 7f6d83fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d84154ac0 con 0x7f6d84155b00 2023-10-14T10:34:48.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.692+0000 7f6d83fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d84152f90 con 0x7f6d8406b6e0 2023-10-14T10:34:48.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.692+0000 7f6d7bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d84152670 0x7f6d8414c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:48.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.692+0000 7f6d7bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d84152670 0x7f6d8414c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41042/0 (socket says 172.21.15.8:41042) 2023-10-14T10:34:48.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.692+0000 7f6d7bfff640 1 -- 172.21.15.8:0/349748499 learned_addr learned my addr 172.21.15.8:0/349748499 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:48.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d82ffd640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d8406b6e0 0x7f6d84152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:48.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d837fe640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d84155b00 0x7f6d841ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:48.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d7bfff640 1 -- 172.21.15.8:0/349748499 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d8406b6e0 msgr2=0x7f6d84152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:48.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d7bfff640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d8406b6e0 0x7f6d84152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d7bfff640 1 -- 172.21.15.8:0/349748499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d84155b00 msgr2=0x7f6d841ecee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:48.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d7bfff640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d84155b00 0x7f6d841ecee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d7bfff640 1 -- 172.21.15.8:0/349748499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c0094d0 con 0x7f6d84152670 2023-10-14T10:34:48.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d837fe640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d84155b00 0x7f6d841ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:48.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d7bfff640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d84152670 0x7f6d8414c920 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c000c00 tx=0x7f6d6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:48.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d7b7fe640 1 -- 172.21.15.8:0/349748499 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c031860 con 0x7f6d84152670 2023-10-14T10:34:48.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d7b7fe640 1 -- 172.21.15.8:0/349748499 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c0443f0 con 0x7f6d84152670 2023-10-14T10:34:48.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d83fff640 1 -- 172.21.15.8:0/349748499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d84154d10 con 0x7f6d84152670 2023-10-14T10:34:48.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.693+0000 7f6d7b7fe640 1 -- 172.21.15.8:0/349748499 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0447a0 con 0x7f6d84152670 2023-10-14T10:34:48.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.694+0000 7f6d83fff640 1 -- 172.21.15.8:0/349748499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d841ec6e0 con 0x7f6d84152670 2023-10-14T10:34:48.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.695+0000 7f6d83fff640 1 -- 172.21.15.8:0/349748499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d84155230 con 0x7f6d84152670 2023-10-14T10:34:48.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.696+0000 7f6d7b7fe640 1 -- 172.21.15.8:0/349748499 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6d6c044900 con 0x7f6d84152670 2023-10-14T10:34:48.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.697+0000 7f6d7b7fe640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6d6406ae70 0x7f6d6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:48.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.697+0000 7f6d7b7fe640 1 -- 172.21.15.8:0/349748499 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6d6c02d040 con 0x7f6d84152670 2023-10-14T10:34:48.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.698+0000 7f6d82ffd640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6d6406ae70 0x7f6d6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:48.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.698+0000 7f6d82ffd640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6d6406ae70 0x7f6d6406d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d74000f60 tx=0x7f6d74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:48.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.702+0000 7f6d7b7fe640 1 -- 172.21.15.8:0/349748499 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d6c076ec0 con 0x7f6d84152670 2023-10-14T10:34:48.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.888+0000 7f6d83fff640 1 -- 172.21.15.8:0/349748499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d8404e9b0 con 0x7f6d84152670 2023-10-14T10:34:48.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.890+0000 7f6d7b7fe640 1 -- 172.21.15.8:0/349748499 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f6d6c035070 con 0x7f6d84152670 2023-10-14T10:34:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:48.892 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":33,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:34:47.549381+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T10:34:45.620441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T10:34:46.556786+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:48.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.892+0000 7f6d83fff640 1 -- 172.21.15.8:0/349748499 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6d6406ae70 msgr2=0x7f6d6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:48.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.892+0000 7f6d83fff640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6d6406ae70 0x7f6d6406d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d74000f60 tx=0x7f6d74009040 comp rx=0 tx=0).stop 2023-10-14T10:34:48.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.893+0000 7f6d83fff640 1 -- 172.21.15.8:0/349748499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d84152670 msgr2=0x7f6d8414c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:48.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.893+0000 7f6d83fff640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d84152670 0x7f6d8414c920 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c000c00 tx=0x7f6d6c0046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.893+0000 7f6d83fff640 1 -- 172.21.15.8:0/349748499 shutdown_connections 2023-10-14T10:34:48.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.893+0000 7f6d83fff640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f6d6406ae70 0x7f6d6406d330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.893+0000 7f6d83fff640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d84155b00 0x7f6d841ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.893+0000 7f6d83fff640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6d84152670 0x7f6d8414c920 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.893+0000 7f6d83fff640 1 --2- 172.21.15.8:0/349748499 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d8406b6e0 0x7f6d84152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:48.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.893+0000 7f6d83fff640 1 -- 172.21.15.8:0/349748499 >> 172.21.15.8:0/349748499 conn(0x7f6d8406a200 msgr2=0x7f6d8406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:48.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.893+0000 7f6d83fff640 1 -- 172.21.15.8:0/349748499 shutdown_connections 2023-10-14T10:34:48.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:48.893+0000 7f6d83fff640 1 -- 172.21.15.8:0/349748499 wait complete. 2023-10-14T10:34:48.913 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:49.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.103+0000 7fe1a359e640 1 Processor -- start 2023-10-14T10:34:49.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.104+0000 7fe1a359e640 1 -- start start 2023-10-14T10:34:49.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.105+0000 7fe1a359e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a40a9610 0x7fe1a4151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.105+0000 7fe1a359e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe1a406faf0 0x7fe1a406ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.105+0000 7fe1a359e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a4071650 con 0x7fe1a414abb0 2023-10-14T10:34:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.105+0000 7fe1a359e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a40a9280 con 0x7fe1a406faf0 2023-10-14T10:34:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.105+0000 7fe1a359e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40aa6f0 con 0x7fe1a40a9610 2023-10-14T10:34:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.105+0000 7fe1a259c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe1a414abb0 0x7fe1a40c2110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60370/0 (socket says 172.21.15.8:60370) 2023-10-14T10:34:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.105+0000 7fe1a259c640 1 -- 172.21.15.8:0/1247324055 learned_addr learned my addr 172.21.15.8:0/1247324055 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:49.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a2d9d640 1 --2- 172.21.15.8:0/1247324055 >> v2:172.21.15.92:3300/0 conn(0x7fe1a406faf0 0x7fe1a406ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873882395 0 0) 0x7fe1a4071650 con 0x7fe1a414abb0 2023-10-14T10:34:49.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe19bfff640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a40a9610 0x7fe1a4151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe190003520 con 0x7fe1a414abb0 2023-10-14T10:34:49.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1070573813 0 0) 0x7fe190003520 con 0x7fe1a414abb0 2023-10-14T10:34:49.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a40a9610 msgr2=0x7fe1a4151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:49.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a40a9610 0x7fe1a4151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 >> v2:172.21.15.92:3300/0 conn(0x7fe1a406faf0 msgr2=0x7fe1a406ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:49.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 --2- 172.21.15.8:0/1247324055 >> v2:172.21.15.92:3300/0 conn(0x7fe1a406faf0 0x7fe1a406ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40a81e0 con 0x7fe1a414abb0 2023-10-14T10:34:49.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fe194001670 con 0x7fe1a414abb0 2023-10-14T10:34:49.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 >> v1:172.21.15.8:6789/0 conn(0x7fe1a414abb0 legacy=0x7fe1a40c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:49.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a40a9610 0x7fe190003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe190003ef0 0x7fe1900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe190004d00 0x7fe190005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40a9280 con 0x7fe190004d00 2023-10-14T10:34:49.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40aa6f0 con 0x7fe190003ef0 2023-10-14T10:34:49.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19000b9d0 con 0x7fe1a40a9610 2023-10-14T10:34:49.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.106+0000 7fe1a2d9d640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe190004d00 0x7fe190005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.107+0000 7fe1a259c640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a40a9610 0x7fe190003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.107+0000 7fe19bfff640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe190003ef0 0x7fe1900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.107+0000 7fe1a2d9d640 1 -- 172.21.15.8:0/1247324055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a40a9610 msgr2=0x7fe190003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:49.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.107+0000 7fe1a2d9d640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a40a9610 0x7fe190003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.107+0000 7fe1a2d9d640 1 -- 172.21.15.8:0/1247324055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe190003ef0 msgr2=0x7fe1900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:49.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.107+0000 7fe1a2d9d640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe190003ef0 0x7fe1900047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.107+0000 7fe1a2d9d640 1 -- 172.21.15.8:0/1247324055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190003520 con 0x7fe190004d00 2023-10-14T10:34:49.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.107+0000 7fe1a259c640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a40a9610 0x7fe190003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:49.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.108+0000 7fe1a2d9d640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe190004d00 0x7fe190005180 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009fc0 tx=0x7fe1900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71b1752eac793b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:49.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.108+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c02cc30 con 0x7fe190004d00 2023-10-14T10:34:49.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.108+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c00f040 con 0x7fe190004d00 2023-10-14T10:34:49.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.108+0000 7fe1a1d9b640 1 -- 172.21.15.8:0/1247324055 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c034440 con 0x7fe190004d00 2023-10-14T10:34:49.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.109+0000 7fe1a359e640 1 -- 172.21.15.8:0/1247324055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe190004d00 msgr2=0x7fe190005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:49.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.109+0000 7fe1a359e640 1 --2- 172.21.15.8:0/1247324055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe190004d00 0x7fe190005180 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009fc0 tx=0x7fe1900057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.109+0000 7fe1a2d9d640 1 -- 172.21.15.8:0/1247324055 reap_dead start 2023-10-14T10:34:49.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.109+0000 7fe1a359e640 1 -- 172.21.15.8:0/1247324055 shutdown_connections 2023-10-14T10:34:49.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.109+0000 7fe1a359e640 1 -- 172.21.15.8:0/1247324055 >> 172.21.15.8:0/1247324055 conn(0x7fe1a406a200 msgr2=0x7fe1a406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:49.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.109+0000 7fe1a359e640 1 -- 172.21.15.8:0/1247324055 shutdown_connections 2023-10-14T10:34:49.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.109+0000 7fe1a359e640 1 -- 172.21.15.8:0/1247324055 wait complete. 2023-10-14T10:34:49.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.110+0000 7fe1a359e640 1 Processor -- start 2023-10-14T10:34:49.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.110+0000 7fe1a359e640 1 -- start start 2023-10-14T10:34:49.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.111+0000 7fe1a359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe190004d00 0x7fe1a4149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.111+0000 7fe1a359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a414dc80 0x7fe1a4153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.111+0000 7fe1a359e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a41533f0 0x7fe1a41ec430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.111+0000 7fe1a359e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a414d7f0 con 0x7fe1a414dc80 2023-10-14T10:34:49.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.111+0000 7fe1a359e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a4152ed0 con 0x7fe190004d00 2023-10-14T10:34:49.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.111+0000 7fe1a359e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a4150430 con 0x7fe1a41533f0 2023-10-14T10:34:49.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.112+0000 7fe19bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a414dc80 0x7fe1a4153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.112+0000 7fe19bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a414dc80 0x7fe1a4153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41058/0 (socket says 172.21.15.8:41058) 2023-10-14T10:34:49.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.112+0000 7fe19bfff640 1 -- 172.21.15.8:0/4184757803 learned_addr learned my addr 172.21.15.8:0/4184757803 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:49.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.112+0000 7fe19bfff640 1 -- 172.21.15.8:0/4184757803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a41533f0 msgr2=0x7fe1a41ec430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:49.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.112+0000 7fe19bfff640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a41533f0 0x7fe1a41ec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.112+0000 7fe19bfff640 1 -- 172.21.15.8:0/4184757803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe190004d00 msgr2=0x7fe1a4149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:49.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.112+0000 7fe1a259c640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe190004d00 0x7fe1a4149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.112+0000 7fe19bfff640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe190004d00 0x7fe1a4149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.112+0000 7fe19bfff640 1 -- 172.21.15.8:0/4184757803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a41506d0 con 0x7fe1a414dc80 2023-10-14T10:34:49.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.112+0000 7fe19bfff640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a414dc80 0x7fe1a4153bb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00e760 tx=0x7fe18c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:49.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.113+0000 7fe19affd640 1 -- 172.21.15.8:0/4184757803 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c00c6d0 con 0x7fe1a414dc80 2023-10-14T10:34:49.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.113+0000 7fe19affd640 1 -- 172.21.15.8:0/4184757803 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c00c830 con 0x7fe1a414dc80 2023-10-14T10:34:49.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.113+0000 7fe19affd640 1 -- 172.21.15.8:0/4184757803 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c00cba0 con 0x7fe1a414dc80 2023-10-14T10:34:49.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.113+0000 7fe1a359e640 1 -- 172.21.15.8:0/4184757803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a4153170 con 0x7fe1a414dc80 2023-10-14T10:34:49.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.113+0000 7fe1a359e640 1 -- 172.21.15.8:0/4184757803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a40bef70 con 0x7fe1a414dc80 2023-10-14T10:34:49.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.114+0000 7fe1a359e640 1 -- 172.21.15.8:0/4184757803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a4150280 con 0x7fe1a414dc80 2023-10-14T10:34:49.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.115+0000 7fe19affd640 1 -- 172.21.15.8:0/4184757803 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe18c00cd00 con 0x7fe1a414dc80 2023-10-14T10:34:49.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.116+0000 7fe19affd640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe18406aea0 0x7fe18406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.116+0000 7fe19affd640 1 -- 172.21.15.8:0/4184757803 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fe18c089350 con 0x7fe1a414dc80 2023-10-14T10:34:49.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.116+0000 7fe1a259c640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe18406aea0 0x7fe18406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.116+0000 7fe1a259c640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe18406aea0 0x7fe18406d360 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe1940017a0 tx=0x7fe194009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:49.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.119+0000 7fe19affd640 1 -- 172.21.15.8:0/4184757803 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe18c054470 con 0x7fe1a414dc80 2023-10-14T10:34:49.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.309+0000 7fe1a359e640 1 -- 172.21.15.8:0/4184757803 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1a404e9b0 con 0x7fe1a414dc80 2023-10-14T10:34:49.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.312+0000 7fe19affd640 1 -- 172.21.15.8:0/4184757803 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fe18c057a90 con 0x7fe1a414dc80 2023-10-14T10:34:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:49.315 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":34,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:34:49.066182+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T10:34:45.620441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T10:34:46.556786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.315+0000 7fe1a359e640 1 -- 172.21.15.8:0/4184757803 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe18406aea0 msgr2=0x7fe18406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.315+0000 7fe1a359e640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe18406aea0 0x7fe18406d360 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe1940017a0 tx=0x7fe194009040 comp rx=0 tx=0).stop 2023-10-14T10:34:49.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.315+0000 7fe1a359e640 1 -- 172.21.15.8:0/4184757803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a414dc80 msgr2=0x7fe1a4153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:49.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.315+0000 7fe1a359e640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a414dc80 0x7fe1a4153bb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00e760 tx=0x7fe18c00ec20 comp rx=0 tx=0).stop 2023-10-14T10:34:49.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.315+0000 7fe1a359e640 1 -- 172.21.15.8:0/4184757803 shutdown_connections 2023-10-14T10:34:49.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.315+0000 7fe1a359e640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fe18406aea0 0x7fe18406d360 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.315+0000 7fe1a359e640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a41533f0 0x7fe1a41ec430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.315+0000 7fe1a359e640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1a414dc80 0x7fe1a4153bb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.315+0000 7fe1a359e640 1 --2- 172.21.15.8:0/4184757803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe190004d00 0x7fe1a4149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.315+0000 7fe1a359e640 1 -- 172.21.15.8:0/4184757803 >> 172.21.15.8:0/4184757803 conn(0x7fe1a406a200 msgr2=0x7fe1a406ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:49.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.315+0000 7fe1a359e640 1 -- 172.21.15.8:0/4184757803 shutdown_connections 2023-10-14T10:34:49.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.315+0000 7fe1a359e640 1 -- 172.21.15.8:0/4184757803 wait complete. 2023-10-14T10:34:49.335 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-14T10:34:49.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.548+0000 7f867291a640 1 Processor -- start 2023-10-14T10:34:49.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.548+0000 7f867291a640 1 -- start start 2023-10-14T10:34:49.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.549+0000 7f867291a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866c151420 0x7f866c0c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.549+0000 7f867291a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f866c0c5610 0x7f866c06ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f867291a640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866c0c4e30 con 0x7f866c0c43a0 2023-10-14T10:34:49.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f867291a640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c0c5450 con 0x7f866c0c5610 2023-10-14T10:34:49.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f867291a640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c154950 con 0x7f866c151420 2023-10-14T10:34:49.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f8672119640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f866c0c5610 0x7f866c06ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f8671117640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f866c0c43a0 0x7f866c0c75c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60380/0 (socket says 172.21.15.8:60380) 2023-10-14T10:34:49.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f8671117640 1 -- 172.21.15.8:0/184080620 learned_addr learned my addr 172.21.15.8:0/184080620 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:49.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f8671918640 1 --2- 172.21.15.8:0/184080620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866c151420 0x7f866c0c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f8672119640 1 -- 172.21.15.8:0/184080620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866c151420 msgr2=0x7f866c0c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:49.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f8672119640 1 --2- 172.21.15.8:0/184080620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866c151420 0x7f866c0c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f8672119640 1 -- 172.21.15.8:0/184080620 >> v1:172.21.15.8:6789/0 conn(0x7f866c0c43a0 legacy=0x7f866c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:49.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f8670916640 1 -- 172.21.15.8:0/184080620 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810447728 0 0) 0x7f865c001110 con 0x7f866c0c43a0 2023-10-14T10:34:49.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f8672119640 1 -- 172.21.15.8:0/184080620 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c0c5d00 con 0x7f866c0c5610 2023-10-14T10:34:49.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.550+0000 7f8671918640 1 --2- 172.21.15.8:0/184080620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866c151420 0x7f866c0c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:49.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.552+0000 7f8672119640 1 --2- 172.21.15.8:0/184080620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c0c5610 0x7f866c06ac30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8664009d90 tx=0x7f866402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd997b18d89658f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:49.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.552+0000 7f8670916640 1 -- 172.21.15.8:0/184080620 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866402cbd0 con 0x7f866c0c5610 2023-10-14T10:34:49.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.552+0000 7f8670916640 1 -- 172.21.15.8:0/184080620 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866402cd30 con 0x7f866c0c5610 2023-10-14T10:34:49.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.552+0000 7f8670916640 1 -- 172.21.15.8:0/184080620 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866402cea0 con 0x7f866c0c5610 2023-10-14T10:34:49.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.552+0000 7f867291a640 1 -- 172.21.15.8:0/184080620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c0c5610 msgr2=0x7f866c06ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:49.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.552+0000 7f867291a640 1 --2- 172.21.15.8:0/184080620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c0c5610 0x7f866c06ac30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8664009d90 tx=0x7f866402be20 comp rx=0 tx=0).stop 2023-10-14T10:34:49.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.552+0000 7f867291a640 1 -- 172.21.15.8:0/184080620 shutdown_connections 2023-10-14T10:34:49.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.552+0000 7f867291a640 1 --2- 172.21.15.8:0/184080620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c0c5610 0x7f866c06ac30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.552+0000 7f867291a640 1 --2- 172.21.15.8:0/184080620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866c151420 0x7f866c0c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.552+0000 7f867291a640 1 -- 172.21.15.8:0/184080620 >> 172.21.15.8:0/184080620 conn(0x7f866c0c96c0 msgr2=0x7f866c0c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:49.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.553+0000 7f867291a640 1 -- 172.21.15.8:0/184080620 shutdown_connections 2023-10-14T10:34:49.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.553+0000 7f867291a640 1 -- 172.21.15.8:0/184080620 wait complete. 2023-10-14T10:34:49.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.554+0000 7f867291a640 1 Processor -- start 2023-10-14T10:34:49.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.554+0000 7f867291a640 1 -- start start 2023-10-14T10:34:49.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.555+0000 7f867291a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866c0c43a0 0x7f866c0ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.555+0000 7f867291a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f866c0c5610 0x7f866c1e9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.555+0000 7f867291a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c151420 0x7f866c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.555+0000 7f867291a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c1e94e0 con 0x7f866c151420 2023-10-14T10:34:49.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.555+0000 7f867291a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0accc0 con 0x7f866c0c5610 2023-10-14T10:34:49.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.555+0000 7f867291a640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0acfa0 con 0x7f866c0c43a0 2023-10-14T10:34:49.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.555+0000 7f8672119640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c151420 0x7f866c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.556+0000 7f8672119640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c151420 0x7f866c0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41078/0 (socket says 172.21.15.8:41078) 2023-10-14T10:34:49.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.556+0000 7f8672119640 1 -- 172.21.15.8:0/777587280 learned_addr learned my addr 172.21.15.8:0/777587280 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:49.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.556+0000 7f8671918640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866c0c43a0 0x7f866c0ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.556+0000 7f8671117640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f866c0c5610 0x7f866c1e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.556+0000 7f8672119640 1 -- 172.21.15.8:0/777587280 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866c0c43a0 msgr2=0x7f866c0ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:49.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.556+0000 7f8672119640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866c0c43a0 0x7f866c0ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.556+0000 7f8672119640 1 -- 172.21.15.8:0/777587280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f866c0c5610 msgr2=0x7f866c1e9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:49.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.556+0000 7f8672119640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f866c0c5610 0x7f866c1e9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:49.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.556+0000 7f8672119640 1 -- 172.21.15.8:0/777587280 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8664009a70 con 0x7f866c151420 2023-10-14T10:34:49.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.556+0000 7f8672119640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c151420 0x7f866c0aa570 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8664009d90 tx=0x7f8664004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:49.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.557+0000 7f86627fc640 1 -- 172.21.15.8:0/777587280 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866402cea0 con 0x7f866c151420 2023-10-14T10:34:49.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.557+0000 7f86627fc640 1 -- 172.21.15.8:0/777587280 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8664040670 con 0x7f866c151420 2023-10-14T10:34:49.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.557+0000 7f86627fc640 1 -- 172.21.15.8:0/777587280 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664040a20 con 0x7f866c151420 2023-10-14T10:34:49.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.557+0000 7f867291a640 1 -- 172.21.15.8:0/777587280 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c1e9170 con 0x7f866c151420 2023-10-14T10:34:49.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.557+0000 7f867291a640 1 -- 172.21.15.8:0/777587280 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c1e8e20 con 0x7f866c151420 2023-10-14T10:34:49.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.558+0000 7f867291a640 1 -- 172.21.15.8:0/777587280 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c1e9650 con 0x7f866c151420 2023-10-14T10:34:49.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.559+0000 7f86627fc640 1 -- 172.21.15.8:0/777587280 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8664040b80 con 0x7f866c151420 2023-10-14T10:34:49.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.560+0000 7f86627fc640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f865006ae70 0x7f865006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:49.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.560+0000 7f86627fc640 1 -- 172.21.15.8:0/777587280 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f86640ac410 con 0x7f866c151420 2023-10-14T10:34:49.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.560+0000 7f8671918640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f865006ae70 0x7f865006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:49.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.561+0000 7f8671918640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f865006ae70 0x7f865006d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f866c0ae0c0 tx=0x7f8668008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:49.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.564+0000 7f86627fc640 1 -- 172.21.15.8:0/777587280 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8664077490 con 0x7f866c151420 2023-10-14T10:34:49.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:49.798+0000 7f867291a640 1 -- 172.21.15.8:0/777587280 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f866c0619f0 con 0x7f866c151420 2023-10-14T10:34:50.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.494+0000 7f86627fc640 1 -- 172.21.15.8:0/777587280 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f866407aab0 con 0x7f866c151420 2023-10-14T10:34:50.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.498+0000 7f867291a640 1 -- 172.21.15.8:0/777587280 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f865006ae70 msgr2=0x7f865006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:50.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.498+0000 7f867291a640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f865006ae70 0x7f865006d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f866c0ae0c0 tx=0x7f8668008040 comp rx=0 tx=0).stop 2023-10-14T10:34:50.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.498+0000 7f867291a640 1 -- 172.21.15.8:0/777587280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c151420 msgr2=0x7f866c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:50.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.498+0000 7f867291a640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c151420 0x7f866c0aa570 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8664009d90 tx=0x7f8664004a40 comp rx=0 tx=0).stop 2023-10-14T10:34:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.498+0000 7f867291a640 1 -- 172.21.15.8:0/777587280 shutdown_connections 2023-10-14T10:34:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.498+0000 7f867291a640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f865006ae70 0x7f865006d330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.498+0000 7f867291a640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f866c151420 0x7f866c0aa570 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.498+0000 7f867291a640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f866c0c5610 0x7f866c1e9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:50.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.498+0000 7f867291a640 1 --2- 172.21.15.8:0/777587280 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866c0c43a0 0x7f866c0ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:50.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.498+0000 7f867291a640 1 -- 172.21.15.8:0/777587280 >> 172.21.15.8:0/777587280 conn(0x7f866c0c96c0 msgr2=0x7f866c0c7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:50.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.498+0000 7f867291a640 1 -- 172.21.15.8:0/777587280 shutdown_connections 2023-10-14T10:34:50.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.498+0000 7f867291a640 1 -- 172.21.15.8:0/777587280 wait complete. 2023-10-14T10:34:50.521 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T10:34:50.522 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-14T10:34:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.742+0000 7f9f1489a640 1 Processor -- start 2023-10-14T10:34:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.742+0000 7f9f1489a640 1 -- start start 2023-10-14T10:34:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.743+0000 7f9f1489a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f10151640 0x7f9f10157470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.743+0000 7f9f1489a640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9f100c3170 0x7f9f101579b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.743+0000 7f9f1489a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9f10065cd0 0x7f9f1006a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.743+0000 7f9f1489a640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f10151a20 con 0x7f9f10065cd0 2023-10-14T10:34:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.743+0000 7f9f1489a640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f100c0de0 con 0x7f9f100c3170 2023-10-14T10:34:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.743+0000 7f9f1489a640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100c2330 con 0x7f9f10151640 2023-10-14T10:34:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.744+0000 7f9f0f59e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9f10065cd0 0x7f9f1006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.744+0000 7f9f0f59e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9f10065cd0 0x7f9f1006a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41084/0 (socket says 172.21.15.8:41084) 2023-10-14T10:34:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.744+0000 7f9f0f59e640 1 -- 172.21.15.8:0/737264963 learned_addr learned my addr 172.21.15.8:0/737264963 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.744+0000 7f9f0ed9d640 1 --2- 172.21.15.8:0/737264963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f10151640 0x7f9f10157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.744+0000 7f9f0f59e640 1 -- 172.21.15.8:0/737264963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f10151640 msgr2=0x7f9f10157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.744+0000 7f9f0f59e640 1 --2- 172.21.15.8:0/737264963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f10151640 0x7f9f10157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.744+0000 7f9f0f59e640 1 -- 172.21.15.8:0/737264963 >> v2:172.21.15.92:3300/0 conn(0x7f9f100c3170 msgr2=0x7f9f101579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.744+0000 7f9f0f59e640 1 --2- 172.21.15.8:0/737264963 >> v2:172.21.15.92:3300/0 conn(0x7f9f100c3170 0x7f9f101579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:50.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.744+0000 7f9f0f59e640 1 -- 172.21.15.8:0/737264963 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f100c59e0 con 0x7f9f10065cd0 2023-10-14T10:34:50.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.744+0000 7f9f0ed9d640 1 --2- 172.21.15.8:0/737264963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f10151640 0x7f9f10157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:50.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.745+0000 7f9f0f59e640 1 --2- 172.21.15.8:0/737264963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f10065cd0 0x7f9f1006a960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9f1006c2b0 tx=0x7f9f0802bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8085ffdfb91df7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:50.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.746+0000 7f9f0e59c640 1 -- 172.21.15.8:0/737264963 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0802c980 con 0x7f9f10065cd0 2023-10-14T10:34:50.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.746+0000 7f9f0e59c640 1 -- 172.21.15.8:0/737264963 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0802cae0 con 0x7f9f10065cd0 2023-10-14T10:34:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.746+0000 7f9f0e59c640 1 -- 172.21.15.8:0/737264963 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0802ce70 con 0x7f9f10065cd0 2023-10-14T10:34:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.746+0000 7f9f1489a640 1 -- 172.21.15.8:0/737264963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f10065cd0 msgr2=0x7f9f1006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.746+0000 7f9f1489a640 1 --2- 172.21.15.8:0/737264963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f10065cd0 0x7f9f1006a960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9f1006c2b0 tx=0x7f9f0802bde0 comp rx=0 tx=0).stop 2023-10-14T10:34:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.747+0000 7f9f1489a640 1 -- 172.21.15.8:0/737264963 shutdown_connections 2023-10-14T10:34:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.747+0000 7f9f1489a640 1 --2- 172.21.15.8:0/737264963 >> v2:172.21.15.92:3300/0 conn(0x7f9f100c3170 0x7f9f101579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:50.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.747+0000 7f9f1489a640 1 --2- 172.21.15.8:0/737264963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f10065cd0 0x7f9f1006a960 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:50.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.747+0000 7f9f1489a640 1 --2- 172.21.15.8:0/737264963 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f10151640 0x7f9f10157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:50.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.747+0000 7f9f1489a640 1 -- 172.21.15.8:0/737264963 >> 172.21.15.8:0/737264963 conn(0x7f9f100c2650 msgr2=0x7f9f100c2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:50.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.747+0000 7f9f1489a640 1 -- 172.21.15.8:0/737264963 shutdown_connections 2023-10-14T10:34:50.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.747+0000 7f9f1489a640 1 -- 172.21.15.8:0/737264963 wait complete. 2023-10-14T10:34:50.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.749+0000 7f9f1489a640 1 Processor -- start 2023-10-14T10:34:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.749+0000 7f9f1489a640 1 -- start start 2023-10-14T10:34:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.750+0000 7f9f1489a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f10065cd0 0x7f9f10152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.750+0000 7f9f1489a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f100c3170 0x7f9f101548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.750+0000 7f9f1489a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f10151640 0x7f9f101e8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:50.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.750+0000 7f9f1489a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f101e9c40 con 0x7f9f100c3170 2023-10-14T10:34:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.750+0000 7f9f1489a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f101e9680 con 0x7f9f10065cd0 2023-10-14T10:34:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.750+0000 7f9f1489a640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f101e9960 con 0x7f9f10151640 2023-10-14T10:34:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.750+0000 7f9f0659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f100c3170 0x7f9f101548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.751+0000 7f9f0659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f100c3170 0x7f9f101548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41100/0 (socket says 172.21.15.8:41100) 2023-10-14T10:34:50.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.751+0000 7f9f0659c640 1 -- 172.21.15.8:0/809799601 learned_addr learned my addr 172.21.15.8:0/809799601 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.751+0000 7f9f0ed9d640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f10065cd0 0x7f9f10152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.751+0000 7f9f0f59e640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f10151640 0x7f9f101e8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.751+0000 7f9f0659c640 1 -- 172.21.15.8:0/809799601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f10151640 msgr2=0x7f9f101e8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.751+0000 7f9f0659c640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f10151640 0x7f9f101e8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:50.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.751+0000 7f9f0659c640 1 -- 172.21.15.8:0/809799601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f10065cd0 msgr2=0x7f9f10152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.751+0000 7f9f0659c640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f10065cd0 0x7f9f10152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.751+0000 7f9f0659c640 1 -- 172.21.15.8:0/809799601 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f08009b30 con 0x7f9f100c3170 2023-10-14T10:34:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.751+0000 7f9f0f59e640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f10151640 0x7f9f101e8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.751+0000 7f9f0659c640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f100c3170 0x7f9f101548c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9f100a8840 tx=0x7f9ef800b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:50.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.752+0000 7f9f07fff640 1 -- 172.21.15.8:0/809799601 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8011830 con 0x7f9f100c3170 2023-10-14T10:34:50.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.752+0000 7f9f07fff640 1 -- 172.21.15.8:0/809799601 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef8011990 con 0x7f9f100c3170 2023-10-14T10:34:50.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.752+0000 7f9f07fff640 1 -- 172.21.15.8:0/809799601 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8011d20 con 0x7f9f100c3170 2023-10-14T10:34:50.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.752+0000 7f9f1489a640 1 -- 172.21.15.8:0/809799601 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f100bbb00 con 0x7f9f100c3170 2023-10-14T10:34:50.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.752+0000 7f9f1489a640 1 -- 172.21.15.8:0/809799601 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f10154e00 con 0x7f9f100c3170 2023-10-14T10:34:50.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.753+0000 7f9f1489a640 1 -- 172.21.15.8:0/809799601 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f100619f0 con 0x7f9f100c3170 2023-10-14T10:34:50.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.754+0000 7f9f07fff640 1 -- 172.21.15.8:0/809799601 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9ef801a400 con 0x7f9f100c3170 2023-10-14T10:34:50.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.755+0000 7f9f07fff640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9ef006ae70 0x7f9ef006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:50.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.755+0000 7f9f07fff640 1 -- 172.21.15.8:0/809799601 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f9ef8089710 con 0x7f9f100c3170 2023-10-14T10:34:50.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.755+0000 7f9f0ed9d640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9ef006ae70 0x7f9ef006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:50.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.756+0000 7f9f0ed9d640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9ef006ae70 0x7f9ef006d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000a990 tx=0x7f9f00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:50.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.761+0000 7f9f07fff640 1 -- 172.21.15.8:0/809799601 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9ef8054790 con 0x7f9f100c3170 2023-10-14T10:34:50.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:50.996+0000 7f9f1489a640 1 -- 172.21.15.8:0/809799601 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9f10065ab0 con 0x7f9f100c3170 2023-10-14T10:34:51.028 INFO:tasks.ceph.mds.c.smithi008.stderr:2023-10-14T10:34:51.026+0000 7fb9163bc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T10:34:51.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.503+0000 7f9f07fff640 1 -- 172.21.15.8:0/809799601 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 127+0+0 (secure 0 0 0) 0x7f9ef8057db0 con 0x7f9f100c3170 2023-10-14T10:34:51.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.507+0000 7f9f1489a640 1 -- 172.21.15.8:0/809799601 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9ef006ae70 msgr2=0x7f9ef006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:51.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.507+0000 7f9f1489a640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9ef006ae70 0x7f9ef006d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000a990 tx=0x7f9f00008040 comp rx=0 tx=0).stop 2023-10-14T10:34:51.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.507+0000 7f9f1489a640 1 -- 172.21.15.8:0/809799601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f100c3170 msgr2=0x7f9f101548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:51.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.507+0000 7f9f1489a640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f100c3170 0x7f9f101548c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9f100a8840 tx=0x7f9ef800b820 comp rx=0 tx=0).stop 2023-10-14T10:34:51.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.508+0000 7f9f1489a640 1 -- 172.21.15.8:0/809799601 shutdown_connections 2023-10-14T10:34:51.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.508+0000 7f9f1489a640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9ef006ae70 0x7f9ef006d330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:51.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.508+0000 7f9f1489a640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f10151640 0x7f9f101e8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:51.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.508+0000 7f9f1489a640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f100c3170 0x7f9f101548c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:51.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.508+0000 7f9f1489a640 1 --2- 172.21.15.8:0/809799601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f10065cd0 0x7f9f10152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:51.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.508+0000 7f9f1489a640 1 -- 172.21.15.8:0/809799601 >> 172.21.15.8:0/809799601 conn(0x7f9f100c2650 msgr2=0x7f9f10156880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:51.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.508+0000 7f9f1489a640 1 -- 172.21.15.8:0/809799601 shutdown_connections 2023-10-14T10:34:51.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.508+0000 7f9f1489a640 1 -- 172.21.15.8:0/809799601 wait complete. 2023-10-14T10:34:51.533 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-14T10:34:51.533 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:34:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.763+0000 7efc7bfff640 1 Processor -- start 2023-10-14T10:34:51.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.763+0000 7efc7bfff640 1 -- start start 2023-10-14T10:34:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.764+0000 7efc7bfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efc7c14abb0 0x7efc7c151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:51.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.764+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc7c0a9610 0x7efc7c0c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.764+0000 7efc7bfff640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7c071650 con 0x7efc7c0c2650 2023-10-14T10:34:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.764+0000 7efc7bfff640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c0a9280 con 0x7efc7c14abb0 2023-10-14T10:34:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.764+0000 7efc7bfff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0aa6f0 con 0x7efc7c0a9610 2023-10-14T10:34:51.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.765+0000 7efc7affd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efc7c14abb0 0x7efc7c151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:51.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.765+0000 7efc7affd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efc7c14abb0 0x7efc7c151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41108/0 (socket says 172.21.15.8:41108) 2023-10-14T10:34:51.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.765+0000 7efc7affd640 1 -- 172.21.15.8:0/3602127055 learned_addr learned my addr 172.21.15.8:0/3602127055 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:51.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.765+0000 7efc7a7fc640 1 --2- 172.21.15.8:0/3602127055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc7c0a9610 0x7efc7c0c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:51.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.765+0000 7efc7affd640 1 -- 172.21.15.8:0/3602127055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc7c0a9610 msgr2=0x7efc7c0c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:51.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.765+0000 7efc7affd640 1 --2- 172.21.15.8:0/3602127055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc7c0a9610 0x7efc7c0c2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:51.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.765+0000 7efc7affd640 1 -- 172.21.15.8:0/3602127055 >> v1:172.21.15.92:6789/0 conn(0x7efc7c0c2650 legacy=0x7efc7c06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:51.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.765+0000 7efc7affd640 1 -- 172.21.15.8:0/3602127055 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c0a81e0 con 0x7efc7c14abb0 2023-10-14T10:34:51.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.766+0000 7efc7affd640 1 --2- 172.21.15.8:0/3602127055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc7c14abb0 0x7efc7c151470 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00d150 tx=0x7efc6c02e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c78bbee8348dfc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:51.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.767+0000 7efc79ffb640 1 -- 172.21.15.8:0/3602127055 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c00b0d0 con 0x7efc7c14abb0 2023-10-14T10:34:51.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.767+0000 7efc79ffb640 1 -- 172.21.15.8:0/3602127055 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c00b230 con 0x7efc7c14abb0 2023-10-14T10:34:51.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.767+0000 7efc79ffb640 1 -- 172.21.15.8:0/3602127055 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c009600 con 0x7efc7c14abb0 2023-10-14T10:34:51.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.767+0000 7efc7bfff640 1 -- 172.21.15.8:0/3602127055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc7c14abb0 msgr2=0x7efc7c151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:51.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.767+0000 7efc7bfff640 1 --2- 172.21.15.8:0/3602127055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc7c14abb0 0x7efc7c151470 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00d150 tx=0x7efc6c02e160 comp rx=0 tx=0).stop 2023-10-14T10:34:51.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.767+0000 7efc7bfff640 1 -- 172.21.15.8:0/3602127055 shutdown_connections 2023-10-14T10:34:51.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.767+0000 7efc7bfff640 1 --2- 172.21.15.8:0/3602127055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc7c0a9610 0x7efc7c0c2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:51.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.768+0000 7efc7bfff640 1 --2- 172.21.15.8:0/3602127055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc7c14abb0 0x7efc7c151470 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:51.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.768+0000 7efc7bfff640 1 -- 172.21.15.8:0/3602127055 >> 172.21.15.8:0/3602127055 conn(0x7efc7c06a200 msgr2=0x7efc7c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:51.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.768+0000 7efc7bfff640 1 -- 172.21.15.8:0/3602127055 shutdown_connections 2023-10-14T10:34:51.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.768+0000 7efc7bfff640 1 -- 172.21.15.8:0/3602127055 wait complete. 2023-10-14T10:34:51.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.769+0000 7efc7bfff640 1 Processor -- start 2023-10-14T10:34:51.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.769+0000 7efc7bfff640 1 -- start start 2023-10-14T10:34:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.770+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc7c0a9610 0x7efc7c1e6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.770+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc7c0c2650 0x7efc7c1e4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.770+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc7c14abb0 0x7efc7c144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.770+0000 7efc7bfff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c152120 con 0x7efc7c0c2650 2023-10-14T10:34:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.770+0000 7efc7bfff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c1e5a50 con 0x7efc7c14abb0 2023-10-14T10:34:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.770+0000 7efc7bfff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c14f150 con 0x7efc7c0a9610 2023-10-14T10:34:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.771+0000 7efc7a7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc7c0c2650 0x7efc7c1e4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.771+0000 7efc7a7fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc7c0c2650 0x7efc7c1e4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41120/0 (socket says 172.21.15.8:41120) 2023-10-14T10:34:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.771+0000 7efc7a7fc640 1 -- 172.21.15.8:0/3680583409 learned_addr learned my addr 172.21.15.8:0/3680583409 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.771+0000 7efc7affd640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc7c0a9610 0x7efc7c1e6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:51.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.771+0000 7efc7b7fe640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc7c14abb0 0x7efc7c144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:51.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.771+0000 7efc7a7fc640 1 -- 172.21.15.8:0/3680583409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc7c0a9610 msgr2=0x7efc7c1e6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:51.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.771+0000 7efc7a7fc640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc7c0a9610 0x7efc7c1e6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:51.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.771+0000 7efc7a7fc640 1 -- 172.21.15.8:0/3680583409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc7c14abb0 msgr2=0x7efc7c144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:51.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.771+0000 7efc7a7fc640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc7c14abb0 0x7efc7c144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:51.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.771+0000 7efc7a7fc640 1 -- 172.21.15.8:0/3680583409 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c00bd40 con 0x7efc7c0c2650 2023-10-14T10:34:51.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.771+0000 7efc7b7fe640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc7c14abb0 0x7efc7c144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:51.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.772+0000 7efc7a7fc640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc7c0c2650 0x7efc7c1e4ff0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efc6400d800 tx=0x7efc6400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:51.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.772+0000 7efc737fe640 1 -- 172.21.15.8:0/3680583409 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400b6c0 con 0x7efc7c0c2650 2023-10-14T10:34:51.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.772+0000 7efc737fe640 1 -- 172.21.15.8:0/3680583409 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6400b820 con 0x7efc7c0c2650 2023-10-14T10:34:51.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.772+0000 7efc737fe640 1 -- 172.21.15.8:0/3680583409 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400bbb0 con 0x7efc7c0c2650 2023-10-14T10:34:51.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.772+0000 7efc7bfff640 1 -- 172.21.15.8:0/3680583409 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c14f430 con 0x7efc7c0c2650 2023-10-14T10:34:51.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.772+0000 7efc7bfff640 1 -- 172.21.15.8:0/3680583409 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c070180 con 0x7efc7c0c2650 2023-10-14T10:34:51.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.773+0000 7efc7bfff640 1 -- 172.21.15.8:0/3680583409 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c04e9b0 con 0x7efc7c0c2650 2023-10-14T10:34:51.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.774+0000 7efc737fe640 1 -- 172.21.15.8:0/3680583409 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efc6400bd10 con 0x7efc7c0c2650 2023-10-14T10:34:51.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.775+0000 7efc737fe640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efc5c06ae70 0x7efc5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:51.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.775+0000 7efc737fe640 1 -- 172.21.15.8:0/3680583409 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7efc64089ba0 con 0x7efc7c0c2650 2023-10-14T10:34:51.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.775+0000 7efc7affd640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efc5c06ae70 0x7efc5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:51.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.776+0000 7efc7affd640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efc5c06ae70 0x7efc5c06d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efc6c037000 tx=0x7efc6c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:51.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:51.780+0000 7efc737fe640 1 -- 172.21.15.8:0/3680583409 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc64054c20 con 0x7efc7c0c2650 2023-10-14T10:34:52.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.011+0000 7efc7bfff640 1 -- 172.21.15.8:0/3680583409 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc7c0c0840 con 0x7efc7c0c2650 2023-10-14T10:34:52.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.013+0000 7efc737fe640 1 -- 172.21.15.8:0/3680583409 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7efc64058240 con 0x7efc7c0c2650 2023-10-14T10:34:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:52.016 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:34:52.017 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:34:52.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.015+0000 7efc7bfff640 1 -- 172.21.15.8:0/3680583409 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efc5c06ae70 msgr2=0x7efc5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.015+0000 7efc7bfff640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efc5c06ae70 0x7efc5c06d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efc6c037000 tx=0x7efc6c032000 comp rx=0 tx=0).stop 2023-10-14T10:34:52.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.015+0000 7efc7bfff640 1 -- 172.21.15.8:0/3680583409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc7c0c2650 msgr2=0x7efc7c1e4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.015+0000 7efc7bfff640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc7c0c2650 0x7efc7c1e4ff0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efc6400d800 tx=0x7efc6400dcc0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.015+0000 7efc7bfff640 1 -- 172.21.15.8:0/3680583409 shutdown_connections 2023-10-14T10:34:52.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.015+0000 7efc7bfff640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efc5c06ae70 0x7efc5c06d330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.015+0000 7efc7bfff640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc7c14abb0 0x7efc7c144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.015+0000 7efc7bfff640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc7c0c2650 0x7efc7c1e4ff0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.015+0000 7efc7bfff640 1 --2- 172.21.15.8:0/3680583409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc7c0a9610 0x7efc7c1e6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.015+0000 7efc7bfff640 1 -- 172.21.15.8:0/3680583409 >> 172.21.15.8:0/3680583409 conn(0x7efc7c06a200 msgr2=0x7efc7c06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:52.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.015+0000 7efc7bfff640 1 -- 172.21.15.8:0/3680583409 shutdown_connections 2023-10-14T10:34:52.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.015+0000 7efc7bfff640 1 -- 172.21.15.8:0/3680583409 wait complete. 2023-10-14T10:34:52.039 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:34:52.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.268+0000 7f205dabb640 1 Processor -- start 2023-10-14T10:34:52.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.268+0000 7f205dabb640 1 -- start start 2023-10-14T10:34:52.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.270+0000 7f205dabb640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2058152670 0x7f20580c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.270+0000 7f205dabb640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f205806b6e0 0x7f2058155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.270+0000 7f205dabb640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2058151bf0 con 0x7f20580c2650 2023-10-14T10:34:52.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.270+0000 7f205dabb640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20580bffd0 con 0x7f205806b6e0 2023-10-14T10:34:52.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.270+0000 7f205dabb640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20580c02b0 con 0x7f2058152670 2023-10-14T10:34:52.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.270+0000 7f205d2ba640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f205806b6e0 0x7f2058155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.270+0000 7f205d2ba640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f205806b6e0 0x7f2058155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41130/0 (socket says 172.21.15.8:41130) 2023-10-14T10:34:52.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.271+0000 7f205d2ba640 1 -- 172.21.15.8:0/1310694376 learned_addr learned my addr 172.21.15.8:0/1310694376 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:52.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.271+0000 7f205cab9640 1 --2- 172.21.15.8:0/1310694376 >> v2:172.21.15.92:3300/0 conn(0x7f2058152670 0x7f20580c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.271+0000 7f205d2ba640 1 -- 172.21.15.8:0/1310694376 >> v2:172.21.15.92:3300/0 conn(0x7f2058152670 msgr2=0x7f20580c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:52.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.271+0000 7f205d2ba640 1 --2- 172.21.15.8:0/1310694376 >> v2:172.21.15.92:3300/0 conn(0x7f2058152670 0x7f20580c2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.271+0000 7f205d2ba640 1 -- 172.21.15.8:0/1310694376 >> v1:172.21.15.8:6789/0 conn(0x7f20580c2650 legacy=0x7f20581555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.271+0000 7f205d2ba640 1 -- 172.21.15.8:0/1310694376 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20580c0590 con 0x7f205806b6e0 2023-10-14T10:34:52.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.271+0000 7f205cab9640 1 --2- 172.21.15.8:0/1310694376 >> v2:172.21.15.92:3300/0 conn(0x7f2058152670 0x7f20580c2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:52.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.272+0000 7f205d2ba640 1 --2- 172.21.15.8:0/1310694376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f205806b6e0 0x7f2058155cd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f20580c2d20 tx=0x7f205002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157dc351114d401c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:52.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.273+0000 7f20577fe640 1 -- 172.21.15.8:0/1310694376 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205002ca80 con 0x7f205806b6e0 2023-10-14T10:34:52.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.273+0000 7f20577fe640 1 -- 172.21.15.8:0/1310694376 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205002cbe0 con 0x7f205806b6e0 2023-10-14T10:34:52.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.273+0000 7f20577fe640 1 -- 172.21.15.8:0/1310694376 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20500343f0 con 0x7f205806b6e0 2023-10-14T10:34:52.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.273+0000 7f205dabb640 1 -- 172.21.15.8:0/1310694376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f205806b6e0 msgr2=0x7f2058155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.273+0000 7f205dabb640 1 --2- 172.21.15.8:0/1310694376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f205806b6e0 0x7f2058155cd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f20580c2d20 tx=0x7f205002bee0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.273+0000 7f205dabb640 1 -- 172.21.15.8:0/1310694376 shutdown_connections 2023-10-14T10:34:52.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.273+0000 7f205dabb640 1 --2- 172.21.15.8:0/1310694376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f205806b6e0 0x7f2058155cd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.273+0000 7f205dabb640 1 --2- 172.21.15.8:0/1310694376 >> v2:172.21.15.92:3300/0 conn(0x7f2058152670 0x7f20580c2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.273+0000 7f205dabb640 1 -- 172.21.15.8:0/1310694376 >> 172.21.15.8:0/1310694376 conn(0x7f205806a200 msgr2=0x7f205806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:52.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.273+0000 7f205dabb640 1 -- 172.21.15.8:0/1310694376 shutdown_connections 2023-10-14T10:34:52.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.274+0000 7f205dabb640 1 -- 172.21.15.8:0/1310694376 wait complete. 2023-10-14T10:34:52.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.275+0000 7f205dabb640 1 Processor -- start 2023-10-14T10:34:52.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.275+0000 7f205dabb640 1 -- start start 2023-10-14T10:34:52.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.276+0000 7f205dabb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f205806b6e0 0x7f20580c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.276+0000 7f205dabb640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20580c2650 0x7f205814da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.276+0000 7f205dabb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2058152670 0x7f205814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.276+0000 7f205dabb640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20580c40d0 con 0x7f2058152670 2023-10-14T10:34:52.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.276+0000 7f205dabb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205814e510 con 0x7f205806b6e0 2023-10-14T10:34:52.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.276+0000 7f205dabb640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205814f2a0 con 0x7f20580c2650 2023-10-14T10:34:52.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.277+0000 7f205d2ba640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2058152670 0x7f205814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.277+0000 7f205d2ba640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2058152670 0x7f205814dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41146/0 (socket says 172.21.15.8:41146) 2023-10-14T10:34:52.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.277+0000 7f205d2ba640 1 -- 172.21.15.8:0/3122073665 learned_addr learned my addr 172.21.15.8:0/3122073665 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:52.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.277+0000 7f205cab9640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f205806b6e0 0x7f20580c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.277+0000 7f205d2ba640 1 -- 172.21.15.8:0/3122073665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20580c2650 msgr2=0x7f205814da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.277+0000 7f2057fff640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20580c2650 0x7f205814da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.277+0000 7f205d2ba640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20580c2650 0x7f205814da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.277+0000 7f205d2ba640 1 -- 172.21.15.8:0/3122073665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f205806b6e0 msgr2=0x7f20580c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.277+0000 7f205d2ba640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f205806b6e0 0x7f20580c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.277+0000 7f205d2ba640 1 -- 172.21.15.8:0/3122073665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2050009b30 con 0x7f2058152670 2023-10-14T10:34:52.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.277+0000 7f2057fff640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20580c2650 0x7f205814da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:52.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.278+0000 7f205d2ba640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2058152670 0x7f205814dfd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2050009f40 tx=0x7f2050004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:52.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.278+0000 7f20557fa640 1 -- 172.21.15.8:0/3122073665 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2050009510 con 0x7f2058152670 2023-10-14T10:34:52.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.278+0000 7f20557fa640 1 -- 172.21.15.8:0/3122073665 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205003e450 con 0x7f2058152670 2023-10-14T10:34:52.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.278+0000 7f205dabb640 1 -- 172.21.15.8:0/3122073665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205814ece0 con 0x7f2058152670 2023-10-14T10:34:52.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.278+0000 7f20557fa640 1 -- 172.21.15.8:0/3122073665 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205003e800 con 0x7f2058152670 2023-10-14T10:34:52.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.278+0000 7f205dabb640 1 -- 172.21.15.8:0/3122073665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20581dc5c0 con 0x7f2058152670 2023-10-14T10:34:52.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.279+0000 7f205dabb640 1 -- 172.21.15.8:0/3122073665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205804e9b0 con 0x7f2058152670 2023-10-14T10:34:52.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.280+0000 7f20557fa640 1 -- 172.21.15.8:0/3122073665 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f205002cd50 con 0x7f2058152670 2023-10-14T10:34:52.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.281+0000 7f20557fa640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f203c06ae70 0x7f203c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.281+0000 7f20557fa640 1 -- 172.21.15.8:0/3122073665 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f20500ac060 con 0x7f2058152670 2023-10-14T10:34:52.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.282+0000 7f205cab9640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f203c06ae70 0x7f203c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.282+0000 7f205cab9640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f203c06ae70 0x7f203c06d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2058152ed0 tx=0x7f204c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:52.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.285+0000 7f20557fa640 1 -- 172.21.15.8:0/3122073665 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2050077180 con 0x7f2058152670 2023-10-14T10:34:52.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.481+0000 7f205dabb640 1 -- 172.21.15.8:0/3122073665 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20580c18c0 con 0x7f2058152670 2023-10-14T10:34:52.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.483+0000 7f20557fa640 1 -- 172.21.15.8:0/3122073665 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f205007a7a0 con 0x7f2058152670 2023-10-14T10:34:52.487 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:52.487 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":34,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:34:49.066182+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T10:34:45.620441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T10:34:46.556786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:34:52.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.486+0000 7f205dabb640 1 -- 172.21.15.8:0/3122073665 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f203c06ae70 msgr2=0x7f203c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.486+0000 7f205dabb640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f203c06ae70 0x7f203c06d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2058152ed0 tx=0x7f204c008040 comp rx=0 tx=0).stop 2023-10-14T10:34:52.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.486+0000 7f205dabb640 1 -- 172.21.15.8:0/3122073665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2058152670 msgr2=0x7f205814dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.486+0000 7f205dabb640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2058152670 0x7f205814dfd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2050009f40 tx=0x7f2050004a40 comp rx=0 tx=0).stop 2023-10-14T10:34:52.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.487+0000 7f205dabb640 1 -- 172.21.15.8:0/3122073665 shutdown_connections 2023-10-14T10:34:52.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.487+0000 7f205dabb640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f203c06ae70 0x7f203c06d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.487+0000 7f205dabb640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2058152670 0x7f205814dfd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.487+0000 7f205dabb640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20580c2650 0x7f205814da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.487+0000 7f205dabb640 1 --2- 172.21.15.8:0/3122073665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f205806b6e0 0x7f20580c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.487+0000 7f205dabb640 1 -- 172.21.15.8:0/3122073665 >> 172.21.15.8:0/3122073665 conn(0x7f205806a200 msgr2=0x7f20580be560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:52.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.487+0000 7f205dabb640 1 -- 172.21.15.8:0/3122073665 shutdown_connections 2023-10-14T10:34:52.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.487+0000 7f205dabb640 1 -- 172.21.15.8:0/3122073665 wait complete. 2023-10-14T10:34:52.510 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T10:34:52.511 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T10:34:52.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.730+0000 7f2de9b33640 1 Processor -- start 2023-10-14T10:34:52.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.731+0000 7f2de9b33640 1 -- start start 2023-10-14T10:34:52.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.732+0000 7f2de9b33640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de40c1720 0x7f2de4154d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.732+0000 7f2de9b33640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de41552d0 con 0x7f2de414e640 2023-10-14T10:34:52.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.732+0000 7f2de9b33640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de40c1cc0 con 0x7f2de40a84d0 2023-10-14T10:34:52.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.733+0000 7f2de9b33640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de406cce0 con 0x7f2de40c1720 2023-10-14T10:34:52.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.733+0000 7f2de37fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2de414e640 0x7f2de40c57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60400/0 (socket says 172.21.15.8:60400) 2023-10-14T10:34:52.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.733+0000 7f2de37fe640 1 -- 172.21.15.8:0/755495071 learned_addr learned my addr 172.21.15.8:0/755495071 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.733+0000 7f2de2ffd640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de40c1720 0x7f2de4154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.733+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832188489 0 0) 0x7f2de41552d0 con 0x7f2de414e640 2023-10-14T10:34:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.733+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd0003520 con 0x7f2de414e640 2023-10-14T10:34:52.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3695123722 0 0) 0x7f2dd0003520 con 0x7f2de414e640 2023-10-14T10:34:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de40c1720 msgr2=0x7f2de4154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de40c1720 0x7f2de4154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 >> v1:172.21.15.92:6789/0 conn(0x7f2de40a84d0 legacy=0x7f2de40a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de406cfc0 con 0x7f2de414e640 2023-10-14T10:34:52.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f2dd4001670 con 0x7f2de414e640 2023-10-14T10:34:52.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 >> v1:172.21.15.8:6789/0 conn(0x7f2de414e640 legacy=0x7f2de40c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dd00039a0 0x7f2dd0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de40c1720 0x7f2dd00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd0004d00 0x7f2dd0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de406cce0 con 0x7f2dd0004d00 2023-10-14T10:34:52.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd000ba60 con 0x7f2dd00039a0 2023-10-14T10:34:52.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd000de30 con 0x7f2de40c1720 2023-10-14T10:34:52.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.734+0000 7f2de3fff640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd0004d00 0x7f2dd0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.735+0000 7f2de37fe640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dd00039a0 0x7f2dd0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.735+0000 7f2de2ffd640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de40c1720 0x7f2dd00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.735+0000 7f2de3fff640 1 -- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de40c1720 msgr2=0x7f2dd00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:52.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.735+0000 7f2de3fff640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de40c1720 0x7f2dd00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.735+0000 7f2de3fff640 1 -- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dd00039a0 msgr2=0x7f2dd0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:52.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.735+0000 7f2de3fff640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dd00039a0 0x7f2dd0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.735+0000 7f2de3fff640 1 -- 172.21.15.8:0/755495071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0003520 con 0x7f2dd0004d00 2023-10-14T10:34:52.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.735+0000 7f2de37fe640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dd00039a0 0x7f2dd0003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:52.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.735+0000 7f2de2ffd640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de40c1720 0x7f2dd00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:52.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.736+0000 7f2de3fff640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd0004d00 0x7f2dd0005180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc001720 tx=0x7f2dd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d711f2a65a82ed3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:52.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.736+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0052d0 con 0x7f2dd0004d00 2023-10-14T10:34:52.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.736+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc02e050 con 0x7f2dd0004d00 2023-10-14T10:34:52.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.736+0000 7f2de27fc640 1 -- 172.21.15.8:0/755495071 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0035f0 con 0x7f2dd0004d00 2023-10-14T10:34:52.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.737+0000 7f2de9b33640 1 -- 172.21.15.8:0/755495071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd0004d00 msgr2=0x7f2dd0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.737+0000 7f2de9b33640 1 --2- 172.21.15.8:0/755495071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2dd0004d00 0x7f2dd0005180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc001720 tx=0x7f2dd00057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.737+0000 7f2de3fff640 1 -- 172.21.15.8:0/755495071 reap_dead start 2023-10-14T10:34:52.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.737+0000 7f2de9b33640 1 -- 172.21.15.8:0/755495071 shutdown_connections 2023-10-14T10:34:52.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.737+0000 7f2de9b33640 1 -- 172.21.15.8:0/755495071 >> 172.21.15.8:0/755495071 conn(0x7f2de40a74d0 msgr2=0x7f2de40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:52.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.737+0000 7f2de9b33640 1 -- 172.21.15.8:0/755495071 shutdown_connections 2023-10-14T10:34:52.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.737+0000 7f2de9b33640 1 -- 172.21.15.8:0/755495071 wait complete. 2023-10-14T10:34:52.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.739+0000 7f2de9b33640 1 Processor -- start 2023-10-14T10:34:52.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.739+0000 7f2de9b33640 1 -- start start 2023-10-14T10:34:52.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.740+0000 7f2de9b33640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2de40c29a0 0x7f2de4146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.740+0000 7f2de9b33640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de414f000 0x7f2de4151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.740+0000 7f2de9b33640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de414d010 0x7f2de4152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.740+0000 7f2de9b33640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de414da50 con 0x7f2de40c29a0 2023-10-14T10:34:52.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.740+0000 7f2de9b33640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de414dca0 con 0x7f2de414f000 2023-10-14T10:34:52.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.740+0000 7f2de9b33640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de41ed6a0 con 0x7f2de414d010 2023-10-14T10:34:52.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.740+0000 7f2de37fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2de40c29a0 0x7f2de4146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.740+0000 7f2de37fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2de40c29a0 0x7f2de4146000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41166/0 (socket says 172.21.15.8:41166) 2023-10-14T10:34:52.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.740+0000 7f2de37fe640 1 -- 172.21.15.8:0/3735046606 learned_addr learned my addr 172.21.15.8:0/3735046606 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:52.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2de2ffd640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de414f000 0x7f2de4151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2de3fff640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de414d010 0x7f2de4152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2de37fe640 1 -- 172.21.15.8:0/3735046606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de414d010 msgr2=0x7f2de4152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2de37fe640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de414d010 0x7f2de4152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2de37fe640 1 -- 172.21.15.8:0/3735046606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de414f000 msgr2=0x7f2de4151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2de37fe640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de414f000 0x7f2de4151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2de37fe640 1 -- 172.21.15.8:0/3735046606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de41ed980 con 0x7f2de40c29a0 2023-10-14T10:34:52.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2de2ffd640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de414f000 0x7f2de4151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:52.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2de3fff640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de414d010 0x7f2de4152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:52.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2de37fe640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2de40c29a0 0x7f2de4146000 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400dae0 tx=0x7f2dd4001de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:52.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2ddbfff640 1 -- 172.21.15.8:0/3735046606 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4004cb0 con 0x7f2de40c29a0 2023-10-14T10:34:52.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2ddbfff640 1 -- 172.21.15.8:0/3735046606 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd4004e10 con 0x7f2de40c29a0 2023-10-14T10:34:52.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2ddbfff640 1 -- 172.21.15.8:0/3735046606 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40072d0 con 0x7f2de40c29a0 2023-10-14T10:34:52.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.741+0000 7f2de9b33640 1 -- 172.21.15.8:0/3735046606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de414be20 con 0x7f2de40c29a0 2023-10-14T10:34:52.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.742+0000 7f2de9b33640 1 -- 172.21.15.8:0/3735046606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de40c2f60 con 0x7f2de40c29a0 2023-10-14T10:34:52.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.743+0000 7f2de9b33640 1 -- 172.21.15.8:0/3735046606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de41ed500 con 0x7f2de40c29a0 2023-10-14T10:34:52.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.744+0000 7f2ddbfff640 1 -- 172.21.15.8:0/3735046606 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2dd4007430 con 0x7f2de40c29a0 2023-10-14T10:34:52.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.745+0000 7f2ddbfff640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2dc406ae70 0x7f2dc406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:52.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.745+0000 7f2ddbfff640 1 -- 172.21.15.8:0/3735046606 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f2dd4088f50 con 0x7f2de40c29a0 2023-10-14T10:34:52.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.745+0000 7f2de2ffd640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2dc406ae70 0x7f2dc406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:52.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.745+0000 7f2de2ffd640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2dc406ae70 0x7f2dc406d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2de40c12a0 tx=0x7f2dcc00d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:52.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.749+0000 7f2ddbfff640 1 -- 172.21.15.8:0/3735046606 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2de41ed500 con 0x7f2de40c29a0 2023-10-14T10:34:52.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.941+0000 7f2de9b33640 1 -- 172.21.15.8:0/3735046606 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2de406d580 con 0x7f2dc406ae70 2023-10-14T10:34:52.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.961+0000 7f2ddbfff640 1 -- 172.21.15.8:0/3735046606 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287156 (secure 0 0 0) 0x7f2dcc011040 con 0x7f2dc406ae70 2023-10-14T10:34:52.968 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:52.969 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T10:34:52.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.966+0000 7f2de9b33640 1 -- 172.21.15.8:0/3735046606 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2dc406ae70 msgr2=0x7f2dc406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.966+0000 7f2de9b33640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2dc406ae70 0x7f2dc406d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2de40c12a0 tx=0x7f2dcc00d040 comp rx=0 tx=0).stop 2023-10-14T10:34:52.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.967+0000 7f2de9b33640 1 -- 172.21.15.8:0/3735046606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2de40c29a0 msgr2=0x7f2de4146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:52.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.967+0000 7f2de9b33640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2de40c29a0 0x7f2de4146000 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400dae0 tx=0x7f2dd4001de0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.967+0000 7f2de9b33640 1 -- 172.21.15.8:0/3735046606 shutdown_connections 2023-10-14T10:34:52.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.967+0000 7f2de9b33640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2dc406ae70 0x7f2dc406d330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.967+0000 7f2de9b33640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2de414d010 0x7f2de4152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.967+0000 7f2de9b33640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de414f000 0x7f2de4151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.967+0000 7f2de9b33640 1 --2- 172.21.15.8:0/3735046606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2de40c29a0 0x7f2de4146000 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.967+0000 7f2de9b33640 1 -- 172.21.15.8:0/3735046606 >> 172.21.15.8:0/3735046606 conn(0x7f2de40a74d0 msgr2=0x7f2de40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.967+0000 7f2de9b33640 1 -- 172.21.15.8:0/3735046606 shutdown_connections 2023-10-14T10:34:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:52.967+0000 7f2de9b33640 1 -- 172.21.15.8:0/3735046606 wait complete. 2023-10-14T10:34:52.990 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-10-14T10:34:52.656489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237032,"kb_used_data":4184,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737688,"statfs":{"total":773094113280,"available":772851392512,"internally_reserved":0,"allocated":4284416,"data_stored":2373624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001760"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.112837+0000","last_change":"2023-10-14T10:34:48.102692+0000","last_active":"2023-10-14T10:34:48.112837+0000","last_peered":"2023-10-14T10:34:48.112837+0000","last_clean":"2023-10-14T10:34:48.112837+0000","last_became_active":"2023-10-14T10:34:48.102372+0000","last_became_peered":"2023-10-14T10:34:48.102372+0000","last_unstale":"2023-10-14T10:34:48.112837+0000","last_undegraded":"2023-10-14T10:34:48.112837+0000","last_fullsized":"2023-10-14T10:34:48.112837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:51.026719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075729+0000","last_change":"2023-10-14T10:34:48.107062+0000","last_active":"2023-10-14T10:34:49.075729+0000","last_peered":"2023-10-14T10:34:49.075729+0000","last_clean":"2023-10-14T10:34:49.075729+0000","last_became_active":"2023-10-14T10:34:48.106746+0000","last_became_peered":"2023-10-14T10:34:48.106746+0000","last_unstale":"2023-10-14T10:34:49.075729+0000","last_undegraded":"2023-10-14T10:34:49.075729+0000","last_fullsized":"2023-10-14T10:34:49.075729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:07.358137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.105213+0000","last_change":"2023-10-14T10:34:48.098193+0000","last_active":"2023-10-14T10:34:48.105213+0000","last_peered":"2023-10-14T10:34:48.105213+0000","last_clean":"2023-10-14T10:34:48.105213+0000","last_became_active":"2023-10-14T10:34:48.097892+0000","last_became_peered":"2023-10-14T10:34:48.097892+0000","last_unstale":"2023-10-14T10:34:48.105213+0000","last_undegraded":"2023-10-14T10:34:48.105213+0000","last_fullsized":"2023-10-14T10:34:48.105213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:01.114365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.110095+0000","last_change":"2023-10-14T10:34:48.100603+0000","last_active":"2023-10-14T10:34:48.110095+0000","last_peered":"2023-10-14T10:34:48.110095+0000","last_clean":"2023-10-14T10:34:48.110095+0000","last_became_active":"2023-10-14T10:34:48.100326+0000","last_became_peered":"2023-10-14T10:34:48.100326+0000","last_unstale":"2023-10-14T10:34:48.110095+0000","last_undegraded":"2023-10-14T10:34:48.110095+0000","last_fullsized":"2023-10-14T10:34:48.110095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:44.026366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.329430+0000","last_change":"2023-10-14T10:34:48.099267+0000","last_active":"2023-10-14T10:34:49.329430+0000","last_peered":"2023-10-14T10:34:49.329430+0000","last_clean":"2023-10-14T10:34:49.329430+0000","last_became_active":"2023-10-14T10:34:48.098359+0000","last_became_peered":"2023-10-14T10:34:48.098359+0000","last_unstale":"2023-10-14T10:34:49.329430+0000","last_undegraded":"2023-10-14T10:34:49.329430+0000","last_fullsized":"2023-10-14T10:34:49.329430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:41:59.524870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074409+0000","last_change":"2023-10-14T10:34:48.107059+0000","last_active":"2023-10-14T10:34:49.074409+0000","last_peered":"2023-10-14T10:34:49.074409+0000","last_clean":"2023-10-14T10:34:49.074409+0000","last_became_active":"2023-10-14T10:34:48.106733+0000","last_became_peered":"2023-10-14T10:34:48.106733+0000","last_unstale":"2023-10-14T10:34:49.074409+0000","last_undegraded":"2023-10-14T10:34:49.074409+0000","last_fullsized":"2023-10-14T10:34:49.074409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:59.764413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.077008+0000","last_change":"2023-10-14T10:34:48.106440+0000","last_active":"2023-10-14T10:34:49.077008+0000","last_peered":"2023-10-14T10:34:49.077008+0000","last_clean":"2023-10-14T10:34:49.077008+0000","last_became_active":"2023-10-14T10:34:48.105177+0000","last_became_peered":"2023-10-14T10:34:48.105177+0000","last_unstale":"2023-10-14T10:34:49.077008+0000","last_undegraded":"2023-10-14T10:34:49.077008+0000","last_fullsized":"2023-10-14T10:34:49.077008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:42:43.503085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076063+0000","last_change":"2023-10-14T10:34:48.098653+0000","last_active":"2023-10-14T10:34:49.076063+0000","last_peered":"2023-10-14T10:34:49.076063+0000","last_clean":"2023-10-14T10:34:49.076063+0000","last_became_active":"2023-10-14T10:34:48.098182+0000","last_became_peered":"2023-10-14T10:34:48.098182+0000","last_unstale":"2023-10-14T10:34:49.076063+0000","last_undegraded":"2023-10-14T10:34:49.076063+0000","last_fullsized":"2023-10-14T10:34:49.076063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:40.982959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.080186+0000","last_change":"2023-10-14T10:34:48.088452+0000","last_active":"2023-10-14T10:34:49.080186+0000","last_peered":"2023-10-14T10:34:49.080186+0000","last_clean":"2023-10-14T10:34:49.080186+0000","last_became_active":"2023-10-14T10:34:48.088035+0000","last_became_peered":"2023-10-14T10:34:48.088035+0000","last_unstale":"2023-10-14T10:34:49.080186+0000","last_undegraded":"2023-10-14T10:34:49.080186+0000","last_fullsized":"2023-10-14T10:34:49.080186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:11.292863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.115484+0000","last_change":"2023-10-14T10:34:48.114438+0000","last_active":"2023-10-14T10:34:48.115484+0000","last_peered":"2023-10-14T10:34:48.115484+0000","last_clean":"2023-10-14T10:34:48.115484+0000","last_became_active":"2023-10-14T10:34:48.112474+0000","last_became_peered":"2023-10-14T10:34:48.112474+0000","last_unstale":"2023-10-14T10:34:48.115484+0000","last_undegraded":"2023-10-14T10:34:48.115484+0000","last_fullsized":"2023-10-14T10:34:48.115484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:04:39.441587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.077800+0000","last_change":"2023-10-14T10:34:48.113107+0000","last_active":"2023-10-14T10:34:49.077800+0000","last_peered":"2023-10-14T10:34:49.077800+0000","last_clean":"2023-10-14T10:34:49.077800+0000","last_became_active":"2023-10-14T10:34:48.112731+0000","last_became_peered":"2023-10-14T10:34:48.112731+0000","last_unstale":"2023-10-14T10:34:49.077800+0000","last_undegraded":"2023-10-14T10:34:49.077800+0000","last_fullsized":"2023-10-14T10:34:49.077800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:09:24.259730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.105571+0000","last_change":"2023-10-14T10:34:48.098245+0000","last_active":"2023-10-14T10:34:48.105571+0000","last_peered":"2023-10-14T10:34:48.105571+0000","last_clean":"2023-10-14T10:34:48.105571+0000","last_became_active":"2023-10-14T10:34:48.097698+0000","last_became_peered":"2023-10-14T10:34:48.097698+0000","last_unstale":"2023-10-14T10:34:48.105571+0000","last_undegraded":"2023-10-14T10:34:48.105571+0000","last_fullsized":"2023-10-14T10:34:48.105571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:06.145367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.329579+0000","last_change":"2023-10-14T10:34:48.104822+0000","last_active":"2023-10-14T10:34:49.329579+0000","last_peered":"2023-10-14T10:34:49.329579+0000","last_clean":"2023-10-14T10:34:49.329579+0000","last_became_active":"2023-10-14T10:34:48.104537+0000","last_became_peered":"2023-10-14T10:34:48.104537+0000","last_unstale":"2023-10-14T10:34:49.329579+0000","last_undegraded":"2023-10-14T10:34:49.329579+0000","last_fullsized":"2023-10-14T10:34:49.329579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:22.890449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074706+0000","last_change":"2023-10-14T10:34:48.116714+0000","last_active":"2023-10-14T10:34:49.074706+0000","last_peered":"2023-10-14T10:34:49.074706+0000","last_clean":"2023-10-14T10:34:49.074706+0000","last_became_active":"2023-10-14T10:34:48.116442+0000","last_became_peered":"2023-10-14T10:34:48.116442+0000","last_unstale":"2023-10-14T10:34:49.074706+0000","last_undegraded":"2023-10-14T10:34:49.074706+0000","last_fullsized":"2023-10-14T10:34:49.074706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:42:43.503085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.105885+0000","last_change":"2023-10-14T10:34:48.102786+0000","last_active":"2023-10-14T10:34:48.105885+0000","last_peered":"2023-10-14T10:34:48.105885+0000","last_clean":"2023-10-14T10:34:48.105885+0000","last_became_active":"2023-10-14T10:34:48.102406+0000","last_became_peered":"2023-10-14T10:34:48.102406+0000","last_unstale":"2023-10-14T10:34:48.105885+0000","last_undegraded":"2023-10-14T10:34:48.105885+0000","last_fullsized":"2023-10-14T10:34:48.105885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:52:02.254285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076897+0000","last_change":"2023-10-14T10:34:48.105827+0000","last_active":"2023-10-14T10:34:49.076897+0000","last_peered":"2023-10-14T10:34:49.076897+0000","last_clean":"2023-10-14T10:34:49.076897+0000","last_became_active":"2023-10-14T10:34:48.103968+0000","last_became_peered":"2023-10-14T10:34:48.103968+0000","last_unstale":"2023-10-14T10:34:49.076897+0000","last_undegraded":"2023-10-14T10:34:49.076897+0000","last_fullsized":"2023-10-14T10:34:49.076897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:59.764413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.077800+0000","last_change":"2023-10-14T10:34:48.103691+0000","last_active":"2023-10-14T10:34:49.077800+0000","last_peered":"2023-10-14T10:34:49.077800+0000","last_clean":"2023-10-14T10:34:49.077800+0000","last_became_active":"2023-10-14T10:34:48.103330+0000","last_became_peered":"2023-10-14T10:34:48.103330+0000","last_unstale":"2023-10-14T10:34:49.077800+0000","last_undegraded":"2023-10-14T10:34:49.077800+0000","last_fullsized":"2023-10-14T10:34:49.077800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:56:48.618899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076031+0000","last_change":"2023-10-14T10:34:48.112598+0000","last_active":"2023-10-14T10:34:49.076031+0000","last_peered":"2023-10-14T10:34:49.076031+0000","last_clean":"2023-10-14T10:34:49.076031+0000","last_became_active":"2023-10-14T10:34:48.112245+0000","last_became_peered":"2023-10-14T10:34:48.112245+0000","last_unstale":"2023-10-14T10:34:49.076031+0000","last_undegraded":"2023-10-14T10:34:49.076031+0000","last_fullsized":"2023-10-14T10:34:49.076031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:35.064912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075073+0000","last_change":"2023-10-14T10:34:48.113956+0000","last_active":"2023-10-14T10:34:49.075073+0000","last_peered":"2023-10-14T10:34:49.075073+0000","last_clean":"2023-10-14T10:34:49.075073+0000","last_became_active":"2023-10-14T10:34:48.113670+0000","last_became_peered":"2023-10-14T10:34:48.113670+0000","last_unstale":"2023-10-14T10:34:49.075073+0000","last_undegraded":"2023-10-14T10:34:49.075073+0000","last_fullsized":"2023-10-14T10:34:49.075073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:42:53.725104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.330089+0000","last_change":"2023-10-14T10:34:48.096211+0000","last_active":"2023-10-14T10:34:49.330089+0000","last_peered":"2023-10-14T10:34:49.330089+0000","last_clean":"2023-10-14T10:34:49.330089+0000","last_became_active":"2023-10-14T10:34:48.095924+0000","last_became_peered":"2023-10-14T10:34:48.095924+0000","last_unstale":"2023-10-14T10:34:49.330089+0000","last_undegraded":"2023-10-14T10:34:49.330089+0000","last_fullsized":"2023-10-14T10:34:49.330089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:00.681671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078708+0000","last_change":"2023-10-14T10:34:48.107060+0000","last_active":"2023-10-14T10:34:49.078708+0000","last_peered":"2023-10-14T10:34:49.078708+0000","last_clean":"2023-10-14T10:34:49.078708+0000","last_became_active":"2023-10-14T10:34:48.105747+0000","last_became_peered":"2023-10-14T10:34:48.105747+0000","last_unstale":"2023-10-14T10:34:49.078708+0000","last_undegraded":"2023-10-14T10:34:49.078708+0000","last_fullsized":"2023-10-14T10:34:49.078708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:19:15.201385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.080142+0000","last_change":"2023-10-14T10:34:48.100254+0000","last_active":"2023-10-14T10:34:49.080142+0000","last_peered":"2023-10-14T10:34:49.080142+0000","last_clean":"2023-10-14T10:34:49.080142+0000","last_became_active":"2023-10-14T10:34:48.099968+0000","last_became_peered":"2023-10-14T10:34:48.099968+0000","last_unstale":"2023-10-14T10:34:49.080142+0000","last_undegraded":"2023-10-14T10:34:49.080142+0000","last_fullsized":"2023-10-14T10:34:49.080142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:01.114365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.106615+0000","last_change":"2023-10-14T10:34:48.105170+0000","last_active":"2023-10-14T10:34:48.106615+0000","last_peered":"2023-10-14T10:34:48.106615+0000","last_clean":"2023-10-14T10:34:48.106615+0000","last_became_active":"2023-10-14T10:34:48.104365+0000","last_became_peered":"2023-10-14T10:34:48.104365+0000","last_unstale":"2023-10-14T10:34:48.106615+0000","last_undegraded":"2023-10-14T10:34:48.106615+0000","last_fullsized":"2023-10-14T10:34:48.106615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:52.164412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.097406+0000","last_change":"2023-10-14T10:34:48.089867+0000","last_active":"2023-10-14T10:34:48.097406+0000","last_peered":"2023-10-14T10:34:48.097406+0000","last_clean":"2023-10-14T10:34:48.097406+0000","last_became_active":"2023-10-14T10:34:48.089349+0000","last_became_peered":"2023-10-14T10:34:48.089349+0000","last_unstale":"2023-10-14T10:34:48.097406+0000","last_undegraded":"2023-10-14T10:34:48.097406+0000","last_fullsized":"2023-10-14T10:34:48.097406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:19:15.201385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.111849+0000","last_change":"2023-10-14T10:34:48.102281+0000","last_active":"2023-10-14T10:34:48.111849+0000","last_peered":"2023-10-14T10:34:48.111849+0000","last_clean":"2023-10-14T10:34:48.111849+0000","last_became_active":"2023-10-14T10:34:48.101999+0000","last_became_peered":"2023-10-14T10:34:48.101999+0000","last_unstale":"2023-10-14T10:34:48.111849+0000","last_undegraded":"2023-10-14T10:34:48.111849+0000","last_fullsized":"2023-10-14T10:34:48.111849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:04.920771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075985+0000","last_change":"2023-10-14T10:34:48.110836+0000","last_active":"2023-10-14T10:34:49.075985+0000","last_peered":"2023-10-14T10:34:49.075985+0000","last_clean":"2023-10-14T10:34:49.075985+0000","last_became_active":"2023-10-14T10:34:48.110490+0000","last_became_peered":"2023-10-14T10:34:48.110490+0000","last_unstale":"2023-10-14T10:34:49.075985+0000","last_undegraded":"2023-10-14T10:34:49.075985+0000","last_fullsized":"2023-10-14T10:34:49.075985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:55:52.597001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.111834+0000","last_change":"2023-10-14T10:34:48.102753+0000","last_active":"2023-10-14T10:34:48.111834+0000","last_peered":"2023-10-14T10:34:48.111834+0000","last_clean":"2023-10-14T10:34:48.111834+0000","last_became_active":"2023-10-14T10:34:48.102471+0000","last_became_peered":"2023-10-14T10:34:48.102471+0000","last_unstale":"2023-10-14T10:34:48.111834+0000","last_undegraded":"2023-10-14T10:34:48.111834+0000","last_fullsized":"2023-10-14T10:34:48.111834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:38.455838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.105589+0000","last_change":"2023-10-14T10:34:48.102581+0000","last_active":"2023-10-14T10:34:48.105589+0000","last_peered":"2023-10-14T10:34:48.105589+0000","last_clean":"2023-10-14T10:34:48.105589+0000","last_became_active":"2023-10-14T10:34:48.102258+0000","last_became_peered":"2023-10-14T10:34:48.102258+0000","last_unstale":"2023-10-14T10:34:48.105589+0000","last_undegraded":"2023-10-14T10:34:48.105589+0000","last_fullsized":"2023-10-14T10:34:48.105589+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:44.026366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078557+0000","last_change":"2023-10-14T10:34:48.100947+0000","last_active":"2023-10-14T10:34:49.078557+0000","last_peered":"2023-10-14T10:34:49.078557+0000","last_clean":"2023-10-14T10:34:49.078557+0000","last_became_active":"2023-10-14T10:34:48.099710+0000","last_became_peered":"2023-10-14T10:34:48.099710+0000","last_unstale":"2023-10-14T10:34:49.078557+0000","last_undegraded":"2023-10-14T10:34:49.078557+0000","last_fullsized":"2023-10-14T10:34:49.078557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:28.633301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076853+0000","last_change":"2023-10-14T10:34:48.101780+0000","last_active":"2023-10-14T10:34:49.076853+0000","last_peered":"2023-10-14T10:34:49.076853+0000","last_clean":"2023-10-14T10:34:49.076853+0000","last_became_active":"2023-10-14T10:34:48.101412+0000","last_became_peered":"2023-10-14T10:34:48.101412+0000","last_unstale":"2023-10-14T10:34:49.076853+0000","last_undegraded":"2023-10-14T10:34:49.076853+0000","last_fullsized":"2023-10-14T10:34:49.076853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:48:06.832259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.112730+0000","last_change":"2023-10-14T10:34:48.101345+0000","last_active":"2023-10-14T10:34:48.112730+0000","last_peered":"2023-10-14T10:34:48.112730+0000","last_clean":"2023-10-14T10:34:48.112730+0000","last_became_active":"2023-10-14T10:34:48.101046+0000","last_became_peered":"2023-10-14T10:34:48.101046+0000","last_unstale":"2023-10-14T10:34:48.112730+0000","last_undegraded":"2023-10-14T10:34:48.112730+0000","last_fullsized":"2023-10-14T10:34:48.112730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:00.681671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076133+0000","last_change":"2023-10-14T10:34:48.098458+0000","last_active":"2023-10-14T10:34:49.076133+0000","last_peered":"2023-10-14T10:34:49.076133+0000","last_clean":"2023-10-14T10:34:49.076133+0000","last_became_active":"2023-10-14T10:34:48.097814+0000","last_became_peered":"2023-10-14T10:34:48.097814+0000","last_unstale":"2023-10-14T10:34:49.076133+0000","last_undegraded":"2023-10-14T10:34:49.076133+0000","last_fullsized":"2023-10-14T10:34:49.076133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:05.586092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.115650+0000","last_change":"2023-10-14T10:34:48.111494+0000","last_active":"2023-10-14T10:34:48.115650+0000","last_peered":"2023-10-14T10:34:48.115650+0000","last_clean":"2023-10-14T10:34:48.115650+0000","last_became_active":"2023-10-14T10:34:48.110349+0000","last_became_peered":"2023-10-14T10:34:48.110349+0000","last_unstale":"2023-10-14T10:34:48.115650+0000","last_undegraded":"2023-10-14T10:34:48.115650+0000","last_fullsized":"2023-10-14T10:34:48.115650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:31:28.634278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.498807+0000","last_change":"2023-10-14T10:34:47.096886+0000","last_active":"2023-10-14T10:34:48.498807+0000","last_peered":"2023-10-14T10:34:48.498807+0000","last_clean":"2023-10-14T10:34:48.498807+0000","last_became_active":"2023-10-14T10:34:47.096342+0000","last_became_peered":"2023-10-14T10:34:47.096342+0000","last_unstale":"2023-10-14T10:34:48.498807+0000","last_undegraded":"2023-10-14T10:34:48.498807+0000","last_fullsized":"2023-10-14T10:34:48.498807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:37.440609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.112856+0000","last_change":"2023-10-14T10:34:48.106224+0000","last_active":"2023-10-14T10:34:48.112856+0000","last_peered":"2023-10-14T10:34:48.112856+0000","last_clean":"2023-10-14T10:34:48.112856+0000","last_became_active":"2023-10-14T10:34:48.104352+0000","last_became_peered":"2023-10-14T10:34:48.104352+0000","last_unstale":"2023-10-14T10:34:48.112856+0000","last_undegraded":"2023-10-14T10:34:48.112856+0000","last_fullsized":"2023-10-14T10:34:48.112856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:57.853799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.493398+0000","last_change":"2023-10-14T10:34:47.097491+0000","last_active":"2023-10-14T10:34:48.493398+0000","last_peered":"2023-10-14T10:34:48.493398+0000","last_clean":"2023-10-14T10:34:48.493398+0000","last_became_active":"2023-10-14T10:34:47.097213+0000","last_became_peered":"2023-10-14T10:34:47.097213+0000","last_unstale":"2023-10-14T10:34:48.493398+0000","last_undegraded":"2023-10-14T10:34:48.493398+0000","last_fullsized":"2023-10-14T10:34:48.493398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:04:38.426358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079247+0000","last_change":"2023-10-14T10:34:48.109402+0000","last_active":"2023-10-14T10:34:49.079247+0000","last_peered":"2023-10-14T10:34:49.079247+0000","last_clean":"2023-10-14T10:34:49.079247+0000","last_became_active":"2023-10-14T10:34:48.109006+0000","last_became_peered":"2023-10-14T10:34:48.109006+0000","last_unstale":"2023-10-14T10:34:49.079247+0000","last_undegraded":"2023-10-14T10:34:49.079247+0000","last_fullsized":"2023-10-14T10:34:49.079247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:52:02.254285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075438+0000","last_change":"2023-10-14T10:34:47.099070+0000","last_active":"2023-10-14T10:34:49.075438+0000","last_peered":"2023-10-14T10:34:49.075438+0000","last_clean":"2023-10-14T10:34:49.075438+0000","last_became_active":"2023-10-14T10:34:47.098634+0000","last_became_peered":"2023-10-14T10:34:47.098634+0000","last_unstale":"2023-10-14T10:34:49.075438+0000","last_undegraded":"2023-10-14T10:34:49.075438+0000","last_fullsized":"2023-10-14T10:34:49.075438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:39.967729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.109025+0000","last_change":"2023-10-14T10:34:48.094356+0000","last_active":"2023-10-14T10:34:48.109025+0000","last_peered":"2023-10-14T10:34:48.109025+0000","last_clean":"2023-10-14T10:34:48.109025+0000","last_became_active":"2023-10-14T10:34:48.093953+0000","last_became_peered":"2023-10-14T10:34:48.093953+0000","last_unstale":"2023-10-14T10:34:48.109025+0000","last_undegraded":"2023-10-14T10:34:48.109025+0000","last_fullsized":"2023-10-14T10:34:48.109025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:54:58.489664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.330087+0000","last_change":"2023-10-14T10:34:47.104307+0000","last_active":"2023-10-14T10:34:49.330087+0000","last_peered":"2023-10-14T10:34:49.330087+0000","last_clean":"2023-10-14T10:34:49.330087+0000","last_became_active":"2023-10-14T10:34:47.102470+0000","last_became_peered":"2023-10-14T10:34:47.102470+0000","last_unstale":"2023-10-14T10:34:49.330087+0000","last_undegraded":"2023-10-14T10:34:49.330087+0000","last_fullsized":"2023-10-14T10:34:49.330087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:09.464271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.077211+0000","last_change":"2023-10-14T10:34:48.111042+0000","last_active":"2023-10-14T10:34:49.077211+0000","last_peered":"2023-10-14T10:34:49.077211+0000","last_clean":"2023-10-14T10:34:49.077211+0000","last_became_active":"2023-10-14T10:34:48.110289+0000","last_became_peered":"2023-10-14T10:34:48.110289+0000","last_unstale":"2023-10-14T10:34:49.077211+0000","last_undegraded":"2023-10-14T10:34:49.077211+0000","last_fullsized":"2023-10-14T10:34:49.077211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:12:42.674090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078823+0000","last_change":"2023-10-14T10:34:47.100008+0000","last_active":"2023-10-14T10:34:49.078823+0000","last_peered":"2023-10-14T10:34:49.078823+0000","last_clean":"2023-10-14T10:34:49.078823+0000","last_became_active":"2023-10-14T10:34:47.099704+0000","last_became_peered":"2023-10-14T10:34:47.099704+0000","last_unstale":"2023-10-14T10:34:49.078823+0000","last_undegraded":"2023-10-14T10:34:49.078823+0000","last_fullsized":"2023-10-14T10:34:49.078823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:56.838570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.110086+0000","last_change":"2023-10-14T10:34:48.105607+0000","last_active":"2023-10-14T10:34:48.110086+0000","last_peered":"2023-10-14T10:34:48.110086+0000","last_clean":"2023-10-14T10:34:48.110086+0000","last_became_active":"2023-10-14T10:34:48.105291+0000","last_became_peered":"2023-10-14T10:34:48.105291+0000","last_unstale":"2023-10-14T10:34:48.110086+0000","last_undegraded":"2023-10-14T10:34:48.110086+0000","last_fullsized":"2023-10-14T10:34:48.110086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:11:56.244591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.080060+0000","last_change":"2023-10-14T10:34:47.100035+0000","last_active":"2023-10-14T10:34:49.080060+0000","last_peered":"2023-10-14T10:34:49.080060+0000","last_clean":"2023-10-14T10:34:49.080060+0000","last_became_active":"2023-10-14T10:34:47.099709+0000","last_became_peered":"2023-10-14T10:34:47.099709+0000","last_unstale":"2023-10-14T10:34:49.080060+0000","last_undegraded":"2023-10-14T10:34:49.080060+0000","last_fullsized":"2023-10-14T10:34:49.080060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:31:27.619048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078819+0000","last_change":"2023-10-14T10:34:48.097145+0000","last_active":"2023-10-14T10:34:49.078819+0000","last_peered":"2023-10-14T10:34:49.078819+0000","last_clean":"2023-10-14T10:34:49.078819+0000","last_became_active":"2023-10-14T10:34:48.096980+0000","last_became_peered":"2023-10-14T10:34:48.096980+0000","last_unstale":"2023-10-14T10:34:49.078819+0000","last_undegraded":"2023-10-14T10:34:49.078819+0000","last_fullsized":"2023-10-14T10:34:49.078819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:44.026366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074163+0000","last_change":"2023-10-14T10:34:47.093987+0000","last_active":"2023-10-14T10:34:49.074163+0000","last_peered":"2023-10-14T10:34:49.074163+0000","last_clean":"2023-10-14T10:34:49.074163+0000","last_became_active":"2023-10-14T10:34:47.093668+0000","last_became_peered":"2023-10-14T10:34:47.093668+0000","last_unstale":"2023-10-14T10:34:49.074163+0000","last_undegraded":"2023-10-14T10:34:49.074163+0000","last_fullsized":"2023-10-14T10:34:49.074163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:46.272932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.115337+0000","last_change":"2023-10-14T10:34:48.109852+0000","last_active":"2023-10-14T10:34:48.115337+0000","last_peered":"2023-10-14T10:34:48.115337+0000","last_clean":"2023-10-14T10:34:48.115337+0000","last_became_active":"2023-10-14T10:34:48.109585+0000","last_became_peered":"2023-10-14T10:34:48.109585+0000","last_unstale":"2023-10-14T10:34:48.115337+0000","last_undegraded":"2023-10-14T10:34:48.115337+0000","last_fullsized":"2023-10-14T10:34:48.115337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:51.026719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079047+0000","last_change":"2023-10-14T10:34:47.091217+0000","last_active":"2023-10-14T10:34:49.079047+0000","last_peered":"2023-10-14T10:34:49.079047+0000","last_clean":"2023-10-14T10:34:49.079047+0000","last_became_active":"2023-10-14T10:34:47.090952+0000","last_became_peered":"2023-10-14T10:34:47.090952+0000","last_unstale":"2023-10-14T10:34:49.079047+0000","last_undegraded":"2023-10-14T10:34:49.079047+0000","last_fullsized":"2023-10-14T10:34:49.079047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:03.905542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.110598+0000","last_change":"2023-10-14T10:34:48.106797+0000","last_active":"2023-10-14T10:34:48.110598+0000","last_peered":"2023-10-14T10:34:48.110598+0000","last_clean":"2023-10-14T10:34:48.110598+0000","last_became_active":"2023-10-14T10:34:48.106247+0000","last_became_peered":"2023-10-14T10:34:48.106247+0000","last_unstale":"2023-10-14T10:34:48.110598+0000","last_undegraded":"2023-10-14T10:34:48.110598+0000","last_fullsized":"2023-10-14T10:34:48.110598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:17.577645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075669+0000","last_change":"2023-10-14T10:34:47.098097+0000","last_active":"2023-10-14T10:34:49.075669+0000","last_peered":"2023-10-14T10:34:49.075669+0000","last_clean":"2023-10-14T10:34:49.075669+0000","last_became_active":"2023-10-14T10:34:47.097797+0000","last_became_peered":"2023-10-14T10:34:47.097797+0000","last_unstale":"2023-10-14T10:34:49.075669+0000","last_undegraded":"2023-10-14T10:34:49.075669+0000","last_fullsized":"2023-10-14T10:34:49.075669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:04.570862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075541+0000","last_change":"2023-10-14T10:34:48.112736+0000","last_active":"2023-10-14T10:34:49.075541+0000","last_peered":"2023-10-14T10:34:49.075541+0000","last_clean":"2023-10-14T10:34:49.075541+0000","last_became_active":"2023-10-14T10:34:48.112474+0000","last_became_peered":"2023-10-14T10:34:48.112474+0000","last_unstale":"2023-10-14T10:34:49.075541+0000","last_undegraded":"2023-10-14T10:34:49.075541+0000","last_fullsized":"2023-10-14T10:34:49.075541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:09:24.259730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.103144+0000","last_change":"2023-10-14T10:34:47.101978+0000","last_active":"2023-10-14T10:34:48.103144+0000","last_peered":"2023-10-14T10:34:48.103144+0000","last_clean":"2023-10-14T10:34:48.103144+0000","last_became_active":"2023-10-14T10:34:47.101673+0000","last_became_peered":"2023-10-14T10:34:47.101673+0000","last_unstale":"2023-10-14T10:34:48.103144+0000","last_undegraded":"2023-10-14T10:34:48.103144+0000","last_fullsized":"2023-10-14T10:34:48.103144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:03.905542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074828+0000","last_change":"2023-10-14T10:34:48.111235+0000","last_active":"2023-10-14T10:34:49.074828+0000","last_peered":"2023-10-14T10:34:49.074828+0000","last_clean":"2023-10-14T10:34:49.074828+0000","last_became_active":"2023-10-14T10:34:48.110985+0000","last_became_peered":"2023-10-14T10:34:48.110985+0000","last_unstale":"2023-10-14T10:34:49.074828+0000","last_undegraded":"2023-10-14T10:34:49.074828+0000","last_fullsized":"2023-10-14T10:34:49.074828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:12:42.674090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.496856+0000","last_change":"2023-10-14T10:34:47.100449+0000","last_active":"2023-10-14T10:34:48.496856+0000","last_peered":"2023-10-14T10:34:48.496856+0000","last_clean":"2023-10-14T10:34:48.496856+0000","last_became_active":"2023-10-14T10:34:47.099542+0000","last_became_peered":"2023-10-14T10:34:47.099542+0000","last_unstale":"2023-10-14T10:34:48.496856+0000","last_undegraded":"2023-10-14T10:34:48.496856+0000","last_fullsized":"2023-10-14T10:34:48.496856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:39.967729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.105236+0000","last_change":"2023-10-14T10:34:48.100583+0000","last_active":"2023-10-14T10:34:48.105236+0000","last_peered":"2023-10-14T10:34:48.105236+0000","last_clean":"2023-10-14T10:34:48.105236+0000","last_became_active":"2023-10-14T10:34:48.100282+0000","last_became_peered":"2023-10-14T10:34:48.100282+0000","last_unstale":"2023-10-14T10:34:48.105236+0000","last_undegraded":"2023-10-14T10:34:48.105236+0000","last_fullsized":"2023-10-14T10:34:48.105236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:11.292863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074927+0000","last_change":"2023-10-14T10:34:47.096849+0000","last_active":"2023-10-14T10:34:49.074927+0000","last_peered":"2023-10-14T10:34:49.074927+0000","last_clean":"2023-10-14T10:34:49.074927+0000","last_became_active":"2023-10-14T10:34:47.096591+0000","last_became_peered":"2023-10-14T10:34:47.096591+0000","last_unstale":"2023-10-14T10:34:49.074927+0000","last_undegraded":"2023-10-14T10:34:49.074927+0000","last_fullsized":"2023-10-14T10:34:49.074927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:16.562415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.108209+0000","last_change":"2023-10-14T10:34:48.097117+0000","last_active":"2023-10-14T10:34:48.108209+0000","last_peered":"2023-10-14T10:34:48.108209+0000","last_clean":"2023-10-14T10:34:48.108209+0000","last_became_active":"2023-10-14T10:34:48.094861+0000","last_became_peered":"2023-10-14T10:34:48.094861+0000","last_unstale":"2023-10-14T10:34:48.108209+0000","last_undegraded":"2023-10-14T10:34:48.108209+0000","last_fullsized":"2023-10-14T10:34:48.108209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:00.681671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079016+0000","last_change":"2023-10-14T10:34:47.090429+0000","last_active":"2023-10-14T10:34:49.079016+0000","last_peered":"2023-10-14T10:34:49.079016+0000","last_clean":"2023-10-14T10:34:49.079016+0000","last_became_active":"2023-10-14T10:34:47.089962+0000","last_became_peered":"2023-10-14T10:34:47.089962+0000","last_unstale":"2023-10-14T10:34:49.079016+0000","last_undegraded":"2023-10-14T10:34:49.079016+0000","last_fullsized":"2023-10-14T10:34:49.079016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:37.440609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075357+0000","last_change":"2023-10-14T10:34:48.105466+0000","last_active":"2023-10-14T10:34:49.075357+0000","last_peered":"2023-10-14T10:34:49.075357+0000","last_clean":"2023-10-14T10:34:49.075357+0000","last_became_active":"2023-10-14T10:34:48.104466+0000","last_became_peered":"2023-10-14T10:34:48.104466+0000","last_unstale":"2023-10-14T10:34:49.075357+0000","last_undegraded":"2023-10-14T10:34:49.075357+0000","last_fullsized":"2023-10-14T10:34:49.075357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:56:48.618899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.073585+0000","last_change":"2023-10-14T10:34:47.092531+0000","last_active":"2023-10-14T10:34:48.073585+0000","last_peered":"2023-10-14T10:34:48.073585+0000","last_clean":"2023-10-14T10:34:48.073585+0000","last_became_active":"2023-10-14T10:34:47.092272+0000","last_became_peered":"2023-10-14T10:34:47.092272+0000","last_unstale":"2023-10-14T10:34:48.073585+0000","last_undegraded":"2023-10-14T10:34:48.073585+0000","last_fullsized":"2023-10-14T10:34:48.073585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:27.618071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076419+0000","last_change":"2023-10-14T10:34:48.106030+0000","last_active":"2023-10-14T10:34:49.076419+0000","last_peered":"2023-10-14T10:34:49.076419+0000","last_clean":"2023-10-14T10:34:49.076419+0000","last_became_active":"2023-10-14T10:34:48.105561+0000","last_became_peered":"2023-10-14T10:34:48.105561+0000","last_unstale":"2023-10-14T10:34:49.076419+0000","last_undegraded":"2023-10-14T10:34:49.076419+0000","last_fullsized":"2023-10-14T10:34:49.076419+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:47.288161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074069+0000","last_change":"2023-10-14T10:34:47.101295+0000","last_active":"2023-10-14T10:34:49.074069+0000","last_peered":"2023-10-14T10:34:49.074069+0000","last_clean":"2023-10-14T10:34:49.074069+0000","last_became_active":"2023-10-14T10:34:47.101021+0000","last_became_peered":"2023-10-14T10:34:47.101021+0000","last_unstale":"2023-10-14T10:34:49.074069+0000","last_undegraded":"2023-10-14T10:34:49.074069+0000","last_fullsized":"2023-10-14T10:34:49.074069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:11:55.229362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.115557+0000","last_change":"2023-10-14T10:34:48.106712+0000","last_active":"2023-10-14T10:34:48.115557+0000","last_peered":"2023-10-14T10:34:48.115557+0000","last_clean":"2023-10-14T10:34:48.115557+0000","last_became_active":"2023-10-14T10:34:48.105814+0000","last_became_peered":"2023-10-14T10:34:48.105814+0000","last_unstale":"2023-10-14T10:34:48.115557+0000","last_undegraded":"2023-10-14T10:34:48.115557+0000","last_fullsized":"2023-10-14T10:34:48.115557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:52.164412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074411+0000","last_change":"2023-10-14T10:34:47.100990+0000","last_active":"2023-10-14T10:34:49.074411+0000","last_peered":"2023-10-14T10:34:49.074411+0000","last_clean":"2023-10-14T10:34:49.074411+0000","last_became_active":"2023-10-14T10:34:47.098131+0000","last_became_peered":"2023-10-14T10:34:47.098131+0000","last_unstale":"2023-10-14T10:34:49.074411+0000","last_undegraded":"2023-10-14T10:34:49.074411+0000","last_fullsized":"2023-10-14T10:34:49.074411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:53:07.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079772+0000","last_change":"2023-10-14T10:34:48.105770+0000","last_active":"2023-10-14T10:34:49.079772+0000","last_peered":"2023-10-14T10:34:49.079772+0000","last_clean":"2023-10-14T10:34:49.079772+0000","last_became_active":"2023-10-14T10:34:48.104285+0000","last_became_peered":"2023-10-14T10:34:48.104285+0000","last_unstale":"2023-10-14T10:34:49.079772+0000","last_undegraded":"2023-10-14T10:34:49.079772+0000","last_fullsized":"2023-10-14T10:34:49.079772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:06.145367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.489457+0000","last_change":"2023-10-14T10:34:47.103477+0000","last_active":"2023-10-14T10:34:48.489457+0000","last_peered":"2023-10-14T10:34:48.489457+0000","last_clean":"2023-10-14T10:34:48.489457+0000","last_became_active":"2023-10-14T10:34:47.103207+0000","last_became_peered":"2023-10-14T10:34:47.103207+0000","last_unstale":"2023-10-14T10:34:48.489457+0000","last_undegraded":"2023-10-14T10:34:48.489457+0000","last_fullsized":"2023-10-14T10:34:48.489457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:49.593230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.108373+0000","last_change":"2023-10-14T10:34:48.104302+0000","last_active":"2023-10-14T10:34:48.108373+0000","last_peered":"2023-10-14T10:34:48.108373+0000","last_clean":"2023-10-14T10:34:48.108373+0000","last_became_active":"2023-10-14T10:34:48.104041+0000","last_became_peered":"2023-10-14T10:34:48.104041+0000","last_unstale":"2023-10-14T10:34:48.108373+0000","last_undegraded":"2023-10-14T10:34:48.108373+0000","last_fullsized":"2023-10-14T10:34:48.108373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:53:08.764848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079803+0000","last_change":"2023-10-14T10:34:47.090600+0000","last_active":"2023-10-14T10:34:49.079803+0000","last_peered":"2023-10-14T10:34:49.079803+0000","last_clean":"2023-10-14T10:34:49.079803+0000","last_became_active":"2023-10-14T10:34:47.089926+0000","last_became_peered":"2023-10-14T10:34:47.089926+0000","last_unstale":"2023-10-14T10:34:49.079803+0000","last_undegraded":"2023-10-14T10:34:49.079803+0000","last_fullsized":"2023-10-14T10:34:49.079803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:49.593230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.108259+0000","last_change":"2023-10-14T10:34:48.094064+0000","last_active":"2023-10-14T10:34:48.108259+0000","last_peered":"2023-10-14T10:34:48.108259+0000","last_clean":"2023-10-14T10:34:48.108259+0000","last_became_active":"2023-10-14T10:34:48.093716+0000","last_became_peered":"2023-10-14T10:34:48.093716+0000","last_unstale":"2023-10-14T10:34:48.108259+0000","last_undegraded":"2023-10-14T10:34:48.108259+0000","last_fullsized":"2023-10-14T10:34:48.108259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:19:15.201385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079525+0000","last_change":"2023-10-14T10:34:47.094365+0000","last_active":"2023-10-14T10:34:49.079525+0000","last_peered":"2023-10-14T10:34:49.079525+0000","last_clean":"2023-10-14T10:34:49.079525+0000","last_became_active":"2023-10-14T10:34:47.094082+0000","last_became_peered":"2023-10-14T10:34:47.094082+0000","last_unstale":"2023-10-14T10:34:49.079525+0000","last_undegraded":"2023-10-14T10:34:49.079525+0000","last_fullsized":"2023-10-14T10:34:49.079525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:59.666442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.329914+0000","last_change":"2023-10-14T10:34:48.110294+0000","last_active":"2023-10-14T10:34:49.329914+0000","last_peered":"2023-10-14T10:34:49.329914+0000","last_clean":"2023-10-14T10:34:49.329914+0000","last_became_active":"2023-10-14T10:34:48.109558+0000","last_became_peered":"2023-10-14T10:34:48.109558+0000","last_unstale":"2023-10-14T10:34:49.329914+0000","last_undegraded":"2023-10-14T10:34:49.329914+0000","last_fullsized":"2023-10-14T10:34:49.329914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:31:28.634278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079468+0000","last_change":"2023-10-14T10:34:47.095314+0000","last_active":"2023-10-14T10:34:49.079468+0000","last_peered":"2023-10-14T10:34:49.079468+0000","last_clean":"2023-10-14T10:34:49.079468+0000","last_became_active":"2023-10-14T10:34:47.094594+0000","last_became_peered":"2023-10-14T10:34:47.094594+0000","last_unstale":"2023-10-14T10:34:49.079468+0000","last_undegraded":"2023-10-14T10:34:49.079468+0000","last_fullsized":"2023-10-14T10:34:49.079468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:54:57.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.329668+0000","last_change":"2023-10-14T10:34:48.114327+0000","last_active":"2023-10-14T10:34:49.329668+0000","last_peered":"2023-10-14T10:34:49.329668+0000","last_clean":"2023-10-14T10:34:49.329668+0000","last_became_active":"2023-10-14T10:34:48.112064+0000","last_became_peered":"2023-10-14T10:34:48.112064+0000","last_unstale":"2023-10-14T10:34:49.329668+0000","last_undegraded":"2023-10-14T10:34:49.329668+0000","last_fullsized":"2023-10-14T10:34:49.329668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:47:41.009308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.493426+0000","last_change":"2023-10-14T10:34:47.092365+0000","last_active":"2023-10-14T10:34:48.493426+0000","last_peered":"2023-10-14T10:34:48.493426+0000","last_clean":"2023-10-14T10:34:48.493426+0000","last_became_active":"2023-10-14T10:34:47.091764+0000","last_became_peered":"2023-10-14T10:34:47.091764+0000","last_unstale":"2023-10-14T10:34:48.493426+0000","last_undegraded":"2023-10-14T10:34:48.493426+0000","last_fullsized":"2023-10-14T10:34:48.493426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:37.440609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.329910+0000","last_change":"2023-10-14T10:34:48.103724+0000","last_active":"2023-10-14T10:34:49.329910+0000","last_peered":"2023-10-14T10:34:49.329910+0000","last_clean":"2023-10-14T10:34:49.329910+0000","last_became_active":"2023-10-14T10:34:48.103341+0000","last_became_peered":"2023-10-14T10:34:48.103341+0000","last_unstale":"2023-10-14T10:34:49.329910+0000","last_undegraded":"2023-10-14T10:34:49.329910+0000","last_fullsized":"2023-10-14T10:34:49.329910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:52.164412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.098537+0000","last_change":"2023-10-14T10:34:47.099835+0000","last_active":"2023-10-14T10:34:48.098537+0000","last_peered":"2023-10-14T10:34:48.098537+0000","last_clean":"2023-10-14T10:34:48.098537+0000","last_became_active":"2023-10-14T10:34:47.099476+0000","last_became_peered":"2023-10-14T10:34:47.099476+0000","last_unstale":"2023-10-14T10:34:48.098537+0000","last_undegraded":"2023-10-14T10:34:48.098537+0000","last_fullsized":"2023-10-14T10:34:48.098537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:54:57.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.329551+0000","last_change":"2023-10-14T10:34:48.111740+0000","last_active":"2023-10-14T10:34:49.329551+0000","last_peered":"2023-10-14T10:34:49.329551+0000","last_clean":"2023-10-14T10:34:49.329551+0000","last_became_active":"2023-10-14T10:34:48.110834+0000","last_became_peered":"2023-10-14T10:34:48.110834+0000","last_unstale":"2023-10-14T10:34:49.329551+0000","last_undegraded":"2023-10-14T10:34:49.329551+0000","last_fullsized":"2023-10-14T10:34:49.329551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:21:26.137901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078754+0000","last_change":"2023-10-14T10:34:47.095777+0000","last_active":"2023-10-14T10:34:49.078754+0000","last_peered":"2023-10-14T10:34:49.078754+0000","last_clean":"2023-10-14T10:34:49.078754+0000","last_became_active":"2023-10-14T10:34:47.095466+0000","last_became_peered":"2023-10-14T10:34:47.095466+0000","last_unstale":"2023-10-14T10:34:49.078754+0000","last_undegraded":"2023-10-14T10:34:49.078754+0000","last_fullsized":"2023-10-14T10:34:49.078754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:41:58.509640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076712+0000","last_change":"2023-10-14T10:34:48.108443+0000","last_active":"2023-10-14T10:34:49.076712+0000","last_peered":"2023-10-14T10:34:49.076712+0000","last_clean":"2023-10-14T10:34:49.076712+0000","last_became_active":"2023-10-14T10:34:48.104834+0000","last_became_peered":"2023-10-14T10:34:48.104834+0000","last_unstale":"2023-10-14T10:34:49.076712+0000","last_undegraded":"2023-10-14T10:34:49.076712+0000","last_fullsized":"2023-10-14T10:34:49.076712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:04.413822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.085829+0000","last_change":"2023-10-14T10:34:47.102370+0000","last_active":"2023-10-14T10:34:48.085829+0000","last_peered":"2023-10-14T10:34:48.085829+0000","last_clean":"2023-10-14T10:34:48.085829+0000","last_became_active":"2023-10-14T10:34:47.101402+0000","last_became_peered":"2023-10-14T10:34:47.101402+0000","last_unstale":"2023-10-14T10:34:48.085829+0000","last_undegraded":"2023-10-14T10:34:48.085829+0000","last_fullsized":"2023-10-14T10:34:48.085829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:04.570862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.330183+0000","last_change":"2023-10-14T10:34:48.099919+0000","last_active":"2023-10-14T10:34:49.330183+0000","last_peered":"2023-10-14T10:34:49.330183+0000","last_clean":"2023-10-14T10:34:49.330183+0000","last_became_active":"2023-10-14T10:34:48.099656+0000","last_became_peered":"2023-10-14T10:34:48.099656+0000","last_unstale":"2023-10-14T10:34:49.330183+0000","last_undegraded":"2023-10-14T10:34:49.330183+0000","last_fullsized":"2023-10-14T10:34:49.330183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:51.026719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.494696+0000","last_change":"2023-10-14T10:34:47.097382+0000","last_active":"2023-10-14T10:34:48.494696+0000","last_peered":"2023-10-14T10:34:48.494696+0000","last_clean":"2023-10-14T10:34:48.494696+0000","last_became_active":"2023-10-14T10:34:47.096826+0000","last_became_peered":"2023-10-14T10:34:47.096826+0000","last_unstale":"2023-10-14T10:34:48.494696+0000","last_undegraded":"2023-10-14T10:34:48.494696+0000","last_fullsized":"2023-10-14T10:34:48.494696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:09:11.205511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.106121+0000","last_change":"2023-10-14T10:34:48.103121+0000","last_active":"2023-10-14T10:34:48.106121+0000","last_peered":"2023-10-14T10:34:48.106121+0000","last_clean":"2023-10-14T10:34:48.106121+0000","last_became_active":"2023-10-14T10:34:48.102839+0000","last_became_peered":"2023-10-14T10:34:48.102839+0000","last_unstale":"2023-10-14T10:34:48.106121+0000","last_undegraded":"2023-10-14T10:34:48.106121+0000","last_fullsized":"2023-10-14T10:34:48.106121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:09:09.645781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.103010+0000","last_change":"2023-10-14T10:34:47.100625+0000","last_active":"2023-10-14T10:34:48.103010+0000","last_peered":"2023-10-14T10:34:48.103010+0000","last_clean":"2023-10-14T10:34:48.103010+0000","last_became_active":"2023-10-14T10:34:47.100287+0000","last_became_peered":"2023-10-14T10:34:47.100287+0000","last_unstale":"2023-10-14T10:34:48.103010+0000","last_undegraded":"2023-10-14T10:34:48.103010+0000","last_fullsized":"2023-10-14T10:34:48.103010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:54:57.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.115724+0000","last_change":"2023-10-14T10:34:48.113303+0000","last_active":"2023-10-14T10:34:48.115724+0000","last_peered":"2023-10-14T10:34:48.115724+0000","last_clean":"2023-10-14T10:34:48.115724+0000","last_became_active":"2023-10-14T10:34:48.113043+0000","last_became_peered":"2023-10-14T10:34:48.113043+0000","last_unstale":"2023-10-14T10:34:48.115724+0000","last_undegraded":"2023-10-14T10:34:48.115724+0000","last_fullsized":"2023-10-14T10:34:48.115724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:00.681671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.074870+0000","last_change":"2023-10-14T10:34:47.105437+0000","last_active":"2023-10-14T10:34:48.074870+0000","last_peered":"2023-10-14T10:34:48.074870+0000","last_clean":"2023-10-14T10:34:48.074870+0000","last_became_active":"2023-10-14T10:34:47.104818+0000","last_became_peered":"2023-10-14T10:34:47.104818+0000","last_unstale":"2023-10-14T10:34:48.074870+0000","last_undegraded":"2023-10-14T10:34:48.074870+0000","last_fullsized":"2023-10-14T10:34:48.074870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:52:01.239056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.112897+0000","last_change":"2023-10-14T10:34:48.106001+0000","last_active":"2023-10-14T10:34:48.112897+0000","last_peered":"2023-10-14T10:34:48.112897+0000","last_clean":"2023-10-14T10:34:48.112897+0000","last_became_active":"2023-10-14T10:34:48.103578+0000","last_became_peered":"2023-10-14T10:34:48.103578+0000","last_unstale":"2023-10-14T10:34:48.112897+0000","last_undegraded":"2023-10-14T10:34:48.112897+0000","last_fullsized":"2023-10-14T10:34:48.112897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:31:28.634278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.100910+0000","last_change":"2023-10-14T10:34:47.092514+0000","last_active":"2023-10-14T10:34:48.100910+0000","last_peered":"2023-10-14T10:34:48.100910+0000","last_clean":"2023-10-14T10:34:48.100910+0000","last_became_active":"2023-10-14T10:34:47.092151+0000","last_became_peered":"2023-10-14T10:34:47.092151+0000","last_unstale":"2023-10-14T10:34:48.100910+0000","last_undegraded":"2023-10-14T10:34:48.100910+0000","last_fullsized":"2023-10-14T10:34:48.100910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:56.838570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.115532+0000","last_change":"2023-10-14T10:34:48.111368+0000","last_active":"2023-10-14T10:34:48.115532+0000","last_peered":"2023-10-14T10:34:48.115532+0000","last_clean":"2023-10-14T10:34:48.115532+0000","last_became_active":"2023-10-14T10:34:48.111109+0000","last_became_peered":"2023-10-14T10:34:48.111109+0000","last_unstale":"2023-10-14T10:34:48.115532+0000","last_undegraded":"2023-10-14T10:34:48.115532+0000","last_fullsized":"2023-10-14T10:34:48.115532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:51.026719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.072262+0000","last_change":"2023-10-14T10:34:47.096035+0000","last_active":"2023-10-14T10:34:48.072262+0000","last_peered":"2023-10-14T10:34:48.072262+0000","last_clean":"2023-10-14T10:34:48.072262+0000","last_became_active":"2023-10-14T10:34:47.095685+0000","last_became_peered":"2023-10-14T10:34:47.095685+0000","last_unstale":"2023-10-14T10:34:48.072262+0000","last_undegraded":"2023-10-14T10:34:48.072262+0000","last_fullsized":"2023-10-14T10:34:48.072262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:56.838570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074196+0000","last_change":"2023-10-14T10:34:48.107696+0000","last_active":"2023-10-14T10:34:49.074196+0000","last_peered":"2023-10-14T10:34:49.074196+0000","last_clean":"2023-10-14T10:34:49.074196+0000","last_became_active":"2023-10-14T10:34:48.106668+0000","last_became_peered":"2023-10-14T10:34:48.106668+0000","last_unstale":"2023-10-14T10:34:49.074196+0000","last_undegraded":"2023-10-14T10:34:49.074196+0000","last_fullsized":"2023-10-14T10:34:49.074196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:48:06.832259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078994+0000","last_change":"2023-10-14T10:34:47.092047+0000","last_active":"2023-10-14T10:34:49.078994+0000","last_peered":"2023-10-14T10:34:49.078994+0000","last_clean":"2023-10-14T10:34:49.078994+0000","last_became_active":"2023-10-14T10:34:47.091758+0000","last_became_peered":"2023-10-14T10:34:47.091758+0000","last_unstale":"2023-10-14T10:34:49.078994+0000","last_undegraded":"2023-10-14T10:34:49.078994+0000","last_fullsized":"2023-10-14T10:34:49.078994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:21.875220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078451+0000","last_change":"2023-10-14T10:34:48.100631+0000","last_active":"2023-10-14T10:34:49.078451+0000","last_peered":"2023-10-14T10:34:49.078451+0000","last_clean":"2023-10-14T10:34:49.078451+0000","last_became_active":"2023-10-14T10:34:48.099013+0000","last_became_peered":"2023-10-14T10:34:48.099013+0000","last_unstale":"2023-10-14T10:34:49.078451+0000","last_undegraded":"2023-10-14T10:34:49.078451+0000","last_fullsized":"2023-10-14T10:34:49.078451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:09:12.220740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074137+0000","last_change":"2023-10-14T10:34:47.101979+0000","last_active":"2023-10-14T10:34:49.074137+0000","last_peered":"2023-10-14T10:34:49.074137+0000","last_clean":"2023-10-14T10:34:49.074137+0000","last_became_active":"2023-10-14T10:34:47.101684+0000","last_became_peered":"2023-10-14T10:34:47.101684+0000","last_unstale":"2023-10-14T10:34:49.074137+0000","last_undegraded":"2023-10-14T10:34:49.074137+0000","last_fullsized":"2023-10-14T10:34:49.074137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:09:08.630552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.077655+0000","last_change":"2023-10-14T10:34:48.101038+0000","last_active":"2023-10-14T10:34:49.077655+0000","last_peered":"2023-10-14T10:34:49.077655+0000","last_clean":"2023-10-14T10:34:49.077655+0000","last_became_active":"2023-10-14T10:34:48.100620+0000","last_became_peered":"2023-10-14T10:34:48.100620+0000","last_unstale":"2023-10-14T10:34:49.077655+0000","last_undegraded":"2023-10-14T10:34:49.077655+0000","last_fullsized":"2023-10-14T10:34:49.077655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:42:53.725104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.097328+0000","last_change":"2023-10-14T10:34:47.098675+0000","last_active":"2023-10-14T10:34:48.097328+0000","last_peered":"2023-10-14T10:34:48.097328+0000","last_clean":"2023-10-14T10:34:48.097328+0000","last_became_active":"2023-10-14T10:34:47.098349+0000","last_became_peered":"2023-10-14T10:34:47.098349+0000","last_unstale":"2023-10-14T10:34:48.097328+0000","last_undegraded":"2023-10-14T10:34:48.097328+0000","last_fullsized":"2023-10-14T10:34:48.097328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:04:38.426358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.090203+0000","last_change":"2023-10-14T10:33:42.821659+0000","last_active":"2023-10-14T10:34:48.090203+0000","last_peered":"2023-10-14T10:34:48.090203+0000","last_clean":"2023-10-14T10:34:48.090203+0000","last_became_active":"2023-10-14T10:33:42.819441+0000","last_became_peered":"2023-10-14T10:33:42.819441+0000","last_unstale":"2023-10-14T10:34:48.090203+0000","last_undegraded":"2023-10-14T10:34:48.090203+0000","last_fullsized":"2023-10-14T10:34:48.090203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_clean_scrub_stamp":"2023-10-14T10:33:41.468382+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:59.542930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.107}]},{"osd":2,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.4199999999999999}]},{"osd":3,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.181}]},{"osd":4,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.218},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.488},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.2909999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":1.363}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":145962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.752}]},{"osd":1,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.84699999999999998}]},{"osd":2,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.395,"5min":3.395,"15min":3.395},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.68799999999999994}]},{"osd":3,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.089},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.0389999999999999}]},{"osd":4,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.2569999999999999}]},{"osd":5,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.327}]},{"osd":7,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.278}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":146018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.121}]},{"osd":1,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":3.1459999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.81000000000000005}]},{"osd":2,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.5920000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.9910000000000001,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":1.413}]},{"osd":4,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":1.444},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":3.8130000000000002,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.3660000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.2749999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.548},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":1.6679999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.79300000000000004}]},{"osd":1,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.115},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.1419999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.288}]},{"osd":3,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.93600000000000005}]},{"osd":5,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.038},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.3799999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.5549999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.502}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":153305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.355}]},{"osd":1,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.0069999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.47599999999999998},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.874}]},{"osd":4,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":1.175}]},{"osd":5,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.143},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.206}]},{"osd":6,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.248},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.272}]},{"osd":7,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.615},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":1.109}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":389120,"data_stored":151741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.70899999999999996}]},{"osd":1,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.85399999999999998}]},{"osd":4,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.498},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.89300000000000002}]},{"osd":5,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.091}]},{"osd":6,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.421}]},{"osd":7,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.147},{"interface":"front","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.302}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":146980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":1.54}]},{"osd":2,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.3500000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.851},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.754}]},{"osd":4,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.891},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.6240000000000001}]},{"osd":5,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":4.1150000000000002,"5min":4.1150000000000002,"15min":4.1150000000000002},"last":1.9139999999999999},{"interface":"front","average":{"1min":1.657,"5min":1.657,"15min":1.657},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":2.004}]},{"osd":6,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":2.0510000000000002},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.6930000000000001}]},{"osd":7,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":4.3559999999999999,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.8},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.9369999999999998,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":1.962}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":966656,"data_stored":735714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.64400000000000002}]},{"osd":2,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.091},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.673,"5min":3.673,"15min":3.673},"last":0.89400000000000002}]},{"osd":4,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":1.123},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":1.306}]},{"osd":5,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.2490000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.3519999999999999,"5min":3.3519999999999999,"15min":3.3519999999999999},"last":1.1519999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":3.4199999999999999,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.272}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T10:34:52.997 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T10:34:53.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.259+0000 7fd206111640 1 Processor -- start 2023-10-14T10:34:53.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.259+0000 7fd206111640 1 -- start start 2023-10-14T10:34:53.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.261+0000 7fd206111640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd20014abb0 0x7fd200151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.261+0000 7fd206111640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd20006faf0 0x7fd20006ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.261+0000 7fd206111640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd200071650 con 0x7fd2000a9610 2023-10-14T10:34:53.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.261+0000 7fd206111640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2000a9280 con 0x7fd20014abb0 2023-10-14T10:34:53.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.261+0000 7fd206111640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000aa6f0 con 0x7fd20006faf0 2023-10-14T10:34:53.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.261+0000 7fd20510f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd20014abb0 0x7fd200151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:53.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.261+0000 7fd20490e640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd2000a9610 0x7fd2000c2110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60402/0 (socket says 172.21.15.8:60402) 2023-10-14T10:34:53.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.261+0000 7fd20490e640 1 -- 172.21.15.8:0/1504412932 learned_addr learned my addr 172.21.15.8:0/1504412932 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:53.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.262+0000 7fd205910640 1 --2- 172.21.15.8:0/1504412932 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd20006faf0 0x7fd20006ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:53.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.262+0000 7fd20510f640 1 -- 172.21.15.8:0/1504412932 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd20006faf0 msgr2=0x7fd20006ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:53.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.262+0000 7fd20510f640 1 --2- 172.21.15.8:0/1504412932 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd20006faf0 0x7fd20006ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.262+0000 7fd20510f640 1 -- 172.21.15.8:0/1504412932 >> v1:172.21.15.8:6789/0 conn(0x7fd2000a9610 legacy=0x7fd2000c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:53.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.262+0000 7fd20510f640 1 -- 172.21.15.8:0/1504412932 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000a81e0 con 0x7fd20014abb0 2023-10-14T10:34:53.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.263+0000 7fd20510f640 1 --2- 172.21.15.8:0/1504412932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd20014abb0 0x7fd200151470 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0097a0 tx=0x7fd1fc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a14ea7c5e0a2bf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:53.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.263+0000 7fd1f7fff640 1 -- 172.21.15.8:0/1504412932 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc02d040 con 0x7fd20014abb0 2023-10-14T10:34:53.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.263+0000 7fd1f7fff640 1 -- 172.21.15.8:0/1504412932 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc031810 con 0x7fd20014abb0 2023-10-14T10:34:53.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.263+0000 7fd1f7fff640 1 -- 172.21.15.8:0/1504412932 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc031ba0 con 0x7fd20014abb0 2023-10-14T10:34:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.264+0000 7fd206111640 1 -- 172.21.15.8:0/1504412932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd20014abb0 msgr2=0x7fd200151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.264+0000 7fd206111640 1 --2- 172.21.15.8:0/1504412932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd20014abb0 0x7fd200151470 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0097a0 tx=0x7fd1fc02b8b0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.264+0000 7fd206111640 1 -- 172.21.15.8:0/1504412932 shutdown_connections 2023-10-14T10:34:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.264+0000 7fd206111640 1 --2- 172.21.15.8:0/1504412932 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd20006faf0 0x7fd20006ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.264+0000 7fd206111640 1 --2- 172.21.15.8:0/1504412932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd20014abb0 0x7fd200151470 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.264+0000 7fd206111640 1 -- 172.21.15.8:0/1504412932 >> 172.21.15.8:0/1504412932 conn(0x7fd20006a200 msgr2=0x7fd20006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.264+0000 7fd206111640 1 -- 172.21.15.8:0/1504412932 shutdown_connections 2023-10-14T10:34:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.264+0000 7fd206111640 1 -- 172.21.15.8:0/1504412932 wait complete. 2023-10-14T10:34:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.266+0000 7fd206111640 1 Processor -- start 2023-10-14T10:34:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.266+0000 7fd206111640 1 -- start start 2023-10-14T10:34:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd206111640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd20006faf0 0x7fd20013ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd206111640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2000a9610 0x7fd20013f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd206111640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd20014abb0 0x7fd2001ea960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd206111640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20014da70 con 0x7fd20006faf0 2023-10-14T10:34:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd206111640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000ba480 con 0x7fd2000a9610 2023-10-14T10:34:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd206111640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20014dc70 con 0x7fd20014abb0 2023-10-14T10:34:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd20510f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd20006faf0 0x7fd20013ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:53.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd20510f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd20006faf0 0x7fd20013ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41194/0 (socket says 172.21.15.8:41194) 2023-10-14T10:34:53.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd20510f640 1 -- 172.21.15.8:0/818425819 learned_addr learned my addr 172.21.15.8:0/818425819 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:53.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd20510f640 1 -- 172.21.15.8:0/818425819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd20014abb0 msgr2=0x7fd2001ea960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:53.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd20510f640 1 --2- 172.21.15.8:0/818425819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd20014abb0 0x7fd2001ea960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd20510f640 1 -- 172.21.15.8:0/818425819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2000a9610 msgr2=0x7fd20013f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd20510f640 1 --2- 172.21.15.8:0/818425819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2000a9610 0x7fd20013f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.267+0000 7fd20510f640 1 -- 172.21.15.8:0/818425819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc009400 con 0x7fd20006faf0 2023-10-14T10:34:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.268+0000 7fd20510f640 1 --2- 172.21.15.8:0/818425819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd20006faf0 0x7fd20013ebd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc000c00 tx=0x7fd1fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.268+0000 7fd1f5ffb640 1 -- 172.21.15.8:0/818425819 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc03ad60 con 0x7fd20006faf0 2023-10-14T10:34:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.268+0000 7fd1f5ffb640 1 -- 172.21.15.8:0/818425819 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc0443f0 con 0x7fd20006faf0 2023-10-14T10:34:53.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.268+0000 7fd206111640 1 -- 172.21.15.8:0/818425819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20014df50 con 0x7fd20006faf0 2023-10-14T10:34:53.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.268+0000 7fd1f5ffb640 1 -- 172.21.15.8:0/818425819 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0447a0 con 0x7fd20006faf0 2023-10-14T10:34:53.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.268+0000 7fd206111640 1 -- 172.21.15.8:0/818425819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2000ba9b0 con 0x7fd20006faf0 2023-10-14T10:34:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.270+0000 7fd206111640 1 -- 172.21.15.8:0/818425819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20004e9b0 con 0x7fd20006faf0 2023-10-14T10:34:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.270+0000 7fd1f5ffb640 1 -- 172.21.15.8:0/818425819 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd1fc04d450 con 0x7fd20006faf0 2023-10-14T10:34:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.271+0000 7fd1f5ffb640 1 --2- 172.21.15.8:0/818425819 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd1e406aea0 0x7fd1e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.272+0000 7fd1f5ffb640 1 -- 172.21.15.8:0/818425819 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd1fc0ab880 con 0x7fd20006faf0 2023-10-14T10:34:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.272+0000 7fd20490e640 1 --2- 172.21.15.8:0/818425819 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd1e406aea0 0x7fd1e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.273+0000 7fd20490e640 1 --2- 172.21.15.8:0/818425819 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd1e406aea0 0x7fd1e406d360 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd2000c4360 tx=0x7fd1f0007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.275+0000 7fd1f5ffb640 1 -- 172.21.15.8:0/818425819 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd1fc076880 con 0x7fd20006faf0 2023-10-14T10:34:53.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.473+0000 7fd206111640 1 -- 172.21.15.8:0/818425819 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2000a87a0 con 0x7fd1e406aea0 2023-10-14T10:34:53.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.495+0000 7fd1f5ffb640 1 -- 172.21.15.8:0/818425819 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287156 (secure 0 0 0) 0x7fd1f00058b0 con 0x7fd1e406aea0 2023-10-14T10:34:53.504 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T10:34:53.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.502+0000 7fd206111640 1 -- 172.21.15.8:0/818425819 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd1e406aea0 msgr2=0x7fd1e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:53.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.502+0000 7fd206111640 1 --2- 172.21.15.8:0/818425819 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd1e406aea0 0x7fd1e406d360 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd2000c4360 tx=0x7fd1f0007a40 comp rx=0 tx=0).stop 2023-10-14T10:34:53.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.502+0000 7fd206111640 1 -- 172.21.15.8:0/818425819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd20006faf0 msgr2=0x7fd20013ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:53.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.502+0000 7fd206111640 1 --2- 172.21.15.8:0/818425819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd20006faf0 0x7fd20013ebd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc000c00 tx=0x7fd1fc0046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.502+0000 7fd206111640 1 -- 172.21.15.8:0/818425819 shutdown_connections 2023-10-14T10:34:53.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.502+0000 7fd206111640 1 --2- 172.21.15.8:0/818425819 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd1e406aea0 0x7fd1e406d360 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.502+0000 7fd206111640 1 --2- 172.21.15.8:0/818425819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd20014abb0 0x7fd2001ea960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.502+0000 7fd206111640 1 --2- 172.21.15.8:0/818425819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2000a9610 0x7fd20013f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.502+0000 7fd206111640 1 --2- 172.21.15.8:0/818425819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd20006faf0 0x7fd20013ebd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.502+0000 7fd206111640 1 -- 172.21.15.8:0/818425819 >> 172.21.15.8:0/818425819 conn(0x7fd20006a200 msgr2=0x7fd2000732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:53.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.502+0000 7fd206111640 1 -- 172.21.15.8:0/818425819 shutdown_connections 2023-10-14T10:34:53.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.502+0000 7fd206111640 1 -- 172.21.15.8:0/818425819 wait complete. 2023-10-14T10:34:53.527 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-10-14T10:34:52.656489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237032,"kb_used_data":4184,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737688,"statfs":{"total":773094113280,"available":772851392512,"internally_reserved":0,"allocated":4284416,"data_stored":2373624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001760"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.112837+0000","last_change":"2023-10-14T10:34:48.102692+0000","last_active":"2023-10-14T10:34:48.112837+0000","last_peered":"2023-10-14T10:34:48.112837+0000","last_clean":"2023-10-14T10:34:48.112837+0000","last_became_active":"2023-10-14T10:34:48.102372+0000","last_became_peered":"2023-10-14T10:34:48.102372+0000","last_unstale":"2023-10-14T10:34:48.112837+0000","last_undegraded":"2023-10-14T10:34:48.112837+0000","last_fullsized":"2023-10-14T10:34:48.112837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:51.026719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075729+0000","last_change":"2023-10-14T10:34:48.107062+0000","last_active":"2023-10-14T10:34:49.075729+0000","last_peered":"2023-10-14T10:34:49.075729+0000","last_clean":"2023-10-14T10:34:49.075729+0000","last_became_active":"2023-10-14T10:34:48.106746+0000","last_became_peered":"2023-10-14T10:34:48.106746+0000","last_unstale":"2023-10-14T10:34:49.075729+0000","last_undegraded":"2023-10-14T10:34:49.075729+0000","last_fullsized":"2023-10-14T10:34:49.075729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:07.358137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.105213+0000","last_change":"2023-10-14T10:34:48.098193+0000","last_active":"2023-10-14T10:34:48.105213+0000","last_peered":"2023-10-14T10:34:48.105213+0000","last_clean":"2023-10-14T10:34:48.105213+0000","last_became_active":"2023-10-14T10:34:48.097892+0000","last_became_peered":"2023-10-14T10:34:48.097892+0000","last_unstale":"2023-10-14T10:34:48.105213+0000","last_undegraded":"2023-10-14T10:34:48.105213+0000","last_fullsized":"2023-10-14T10:34:48.105213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:01.114365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.110095+0000","last_change":"2023-10-14T10:34:48.100603+0000","last_active":"2023-10-14T10:34:48.110095+0000","last_peered":"2023-10-14T10:34:48.110095+0000","last_clean":"2023-10-14T10:34:48.110095+0000","last_became_active":"2023-10-14T10:34:48.100326+0000","last_became_peered":"2023-10-14T10:34:48.100326+0000","last_unstale":"2023-10-14T10:34:48.110095+0000","last_undegraded":"2023-10-14T10:34:48.110095+0000","last_fullsized":"2023-10-14T10:34:48.110095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:44.026366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.329430+0000","last_change":"2023-10-14T10:34:48.099267+0000","last_active":"2023-10-14T10:34:49.329430+0000","last_peered":"2023-10-14T10:34:49.329430+0000","last_clean":"2023-10-14T10:34:49.329430+0000","last_became_active":"2023-10-14T10:34:48.098359+0000","last_became_peered":"2023-10-14T10:34:48.098359+0000","last_unstale":"2023-10-14T10:34:49.329430+0000","last_undegraded":"2023-10-14T10:34:49.329430+0000","last_fullsized":"2023-10-14T10:34:49.329430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:41:59.524870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074409+0000","last_change":"2023-10-14T10:34:48.107059+0000","last_active":"2023-10-14T10:34:49.074409+0000","last_peered":"2023-10-14T10:34:49.074409+0000","last_clean":"2023-10-14T10:34:49.074409+0000","last_became_active":"2023-10-14T10:34:48.106733+0000","last_became_peered":"2023-10-14T10:34:48.106733+0000","last_unstale":"2023-10-14T10:34:49.074409+0000","last_undegraded":"2023-10-14T10:34:49.074409+0000","last_fullsized":"2023-10-14T10:34:49.074409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:59.764413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.077008+0000","last_change":"2023-10-14T10:34:48.106440+0000","last_active":"2023-10-14T10:34:49.077008+0000","last_peered":"2023-10-14T10:34:49.077008+0000","last_clean":"2023-10-14T10:34:49.077008+0000","last_became_active":"2023-10-14T10:34:48.105177+0000","last_became_peered":"2023-10-14T10:34:48.105177+0000","last_unstale":"2023-10-14T10:34:49.077008+0000","last_undegraded":"2023-10-14T10:34:49.077008+0000","last_fullsized":"2023-10-14T10:34:49.077008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:42:43.503085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076063+0000","last_change":"2023-10-14T10:34:48.098653+0000","last_active":"2023-10-14T10:34:49.076063+0000","last_peered":"2023-10-14T10:34:49.076063+0000","last_clean":"2023-10-14T10:34:49.076063+0000","last_became_active":"2023-10-14T10:34:48.098182+0000","last_became_peered":"2023-10-14T10:34:48.098182+0000","last_unstale":"2023-10-14T10:34:49.076063+0000","last_undegraded":"2023-10-14T10:34:49.076063+0000","last_fullsized":"2023-10-14T10:34:49.076063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:40.982959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.080186+0000","last_change":"2023-10-14T10:34:48.088452+0000","last_active":"2023-10-14T10:34:49.080186+0000","last_peered":"2023-10-14T10:34:49.080186+0000","last_clean":"2023-10-14T10:34:49.080186+0000","last_became_active":"2023-10-14T10:34:48.088035+0000","last_became_peered":"2023-10-14T10:34:48.088035+0000","last_unstale":"2023-10-14T10:34:49.080186+0000","last_undegraded":"2023-10-14T10:34:49.080186+0000","last_fullsized":"2023-10-14T10:34:49.080186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:11.292863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.115484+0000","last_change":"2023-10-14T10:34:48.114438+0000","last_active":"2023-10-14T10:34:48.115484+0000","last_peered":"2023-10-14T10:34:48.115484+0000","last_clean":"2023-10-14T10:34:48.115484+0000","last_became_active":"2023-10-14T10:34:48.112474+0000","last_became_peered":"2023-10-14T10:34:48.112474+0000","last_unstale":"2023-10-14T10:34:48.115484+0000","last_undegraded":"2023-10-14T10:34:48.115484+0000","last_fullsized":"2023-10-14T10:34:48.115484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:04:39.441587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.077800+0000","last_change":"2023-10-14T10:34:48.113107+0000","last_active":"2023-10-14T10:34:49.077800+0000","last_peered":"2023-10-14T10:34:49.077800+0000","last_clean":"2023-10-14T10:34:49.077800+0000","last_became_active":"2023-10-14T10:34:48.112731+0000","last_became_peered":"2023-10-14T10:34:48.112731+0000","last_unstale":"2023-10-14T10:34:49.077800+0000","last_undegraded":"2023-10-14T10:34:49.077800+0000","last_fullsized":"2023-10-14T10:34:49.077800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:09:24.259730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.105571+0000","last_change":"2023-10-14T10:34:48.098245+0000","last_active":"2023-10-14T10:34:48.105571+0000","last_peered":"2023-10-14T10:34:48.105571+0000","last_clean":"2023-10-14T10:34:48.105571+0000","last_became_active":"2023-10-14T10:34:48.097698+0000","last_became_peered":"2023-10-14T10:34:48.097698+0000","last_unstale":"2023-10-14T10:34:48.105571+0000","last_undegraded":"2023-10-14T10:34:48.105571+0000","last_fullsized":"2023-10-14T10:34:48.105571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:06.145367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.329579+0000","last_change":"2023-10-14T10:34:48.104822+0000","last_active":"2023-10-14T10:34:49.329579+0000","last_peered":"2023-10-14T10:34:49.329579+0000","last_clean":"2023-10-14T10:34:49.329579+0000","last_became_active":"2023-10-14T10:34:48.104537+0000","last_became_peered":"2023-10-14T10:34:48.104537+0000","last_unstale":"2023-10-14T10:34:49.329579+0000","last_undegraded":"2023-10-14T10:34:49.329579+0000","last_fullsized":"2023-10-14T10:34:49.329579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:22.890449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074706+0000","last_change":"2023-10-14T10:34:48.116714+0000","last_active":"2023-10-14T10:34:49.074706+0000","last_peered":"2023-10-14T10:34:49.074706+0000","last_clean":"2023-10-14T10:34:49.074706+0000","last_became_active":"2023-10-14T10:34:48.116442+0000","last_became_peered":"2023-10-14T10:34:48.116442+0000","last_unstale":"2023-10-14T10:34:49.074706+0000","last_undegraded":"2023-10-14T10:34:49.074706+0000","last_fullsized":"2023-10-14T10:34:49.074706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:42:43.503085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.105885+0000","last_change":"2023-10-14T10:34:48.102786+0000","last_active":"2023-10-14T10:34:48.105885+0000","last_peered":"2023-10-14T10:34:48.105885+0000","last_clean":"2023-10-14T10:34:48.105885+0000","last_became_active":"2023-10-14T10:34:48.102406+0000","last_became_peered":"2023-10-14T10:34:48.102406+0000","last_unstale":"2023-10-14T10:34:48.105885+0000","last_undegraded":"2023-10-14T10:34:48.105885+0000","last_fullsized":"2023-10-14T10:34:48.105885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:52:02.254285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076897+0000","last_change":"2023-10-14T10:34:48.105827+0000","last_active":"2023-10-14T10:34:49.076897+0000","last_peered":"2023-10-14T10:34:49.076897+0000","last_clean":"2023-10-14T10:34:49.076897+0000","last_became_active":"2023-10-14T10:34:48.103968+0000","last_became_peered":"2023-10-14T10:34:48.103968+0000","last_unstale":"2023-10-14T10:34:49.076897+0000","last_undegraded":"2023-10-14T10:34:49.076897+0000","last_fullsized":"2023-10-14T10:34:49.076897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:59.764413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.077800+0000","last_change":"2023-10-14T10:34:48.103691+0000","last_active":"2023-10-14T10:34:49.077800+0000","last_peered":"2023-10-14T10:34:49.077800+0000","last_clean":"2023-10-14T10:34:49.077800+0000","last_became_active":"2023-10-14T10:34:48.103330+0000","last_became_peered":"2023-10-14T10:34:48.103330+0000","last_unstale":"2023-10-14T10:34:49.077800+0000","last_undegraded":"2023-10-14T10:34:49.077800+0000","last_fullsized":"2023-10-14T10:34:49.077800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:56:48.618899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076031+0000","last_change":"2023-10-14T10:34:48.112598+0000","last_active":"2023-10-14T10:34:49.076031+0000","last_peered":"2023-10-14T10:34:49.076031+0000","last_clean":"2023-10-14T10:34:49.076031+0000","last_became_active":"2023-10-14T10:34:48.112245+0000","last_became_peered":"2023-10-14T10:34:48.112245+0000","last_unstale":"2023-10-14T10:34:49.076031+0000","last_undegraded":"2023-10-14T10:34:49.076031+0000","last_fullsized":"2023-10-14T10:34:49.076031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:35.064912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075073+0000","last_change":"2023-10-14T10:34:48.113956+0000","last_active":"2023-10-14T10:34:49.075073+0000","last_peered":"2023-10-14T10:34:49.075073+0000","last_clean":"2023-10-14T10:34:49.075073+0000","last_became_active":"2023-10-14T10:34:48.113670+0000","last_became_peered":"2023-10-14T10:34:48.113670+0000","last_unstale":"2023-10-14T10:34:49.075073+0000","last_undegraded":"2023-10-14T10:34:49.075073+0000","last_fullsized":"2023-10-14T10:34:49.075073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:42:53.725104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.330089+0000","last_change":"2023-10-14T10:34:48.096211+0000","last_active":"2023-10-14T10:34:49.330089+0000","last_peered":"2023-10-14T10:34:49.330089+0000","last_clean":"2023-10-14T10:34:49.330089+0000","last_became_active":"2023-10-14T10:34:48.095924+0000","last_became_peered":"2023-10-14T10:34:48.095924+0000","last_unstale":"2023-10-14T10:34:49.330089+0000","last_undegraded":"2023-10-14T10:34:49.330089+0000","last_fullsized":"2023-10-14T10:34:49.330089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:00.681671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078708+0000","last_change":"2023-10-14T10:34:48.107060+0000","last_active":"2023-10-14T10:34:49.078708+0000","last_peered":"2023-10-14T10:34:49.078708+0000","last_clean":"2023-10-14T10:34:49.078708+0000","last_became_active":"2023-10-14T10:34:48.105747+0000","last_became_peered":"2023-10-14T10:34:48.105747+0000","last_unstale":"2023-10-14T10:34:49.078708+0000","last_undegraded":"2023-10-14T10:34:49.078708+0000","last_fullsized":"2023-10-14T10:34:49.078708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:19:15.201385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.080142+0000","last_change":"2023-10-14T10:34:48.100254+0000","last_active":"2023-10-14T10:34:49.080142+0000","last_peered":"2023-10-14T10:34:49.080142+0000","last_clean":"2023-10-14T10:34:49.080142+0000","last_became_active":"2023-10-14T10:34:48.099968+0000","last_became_peered":"2023-10-14T10:34:48.099968+0000","last_unstale":"2023-10-14T10:34:49.080142+0000","last_undegraded":"2023-10-14T10:34:49.080142+0000","last_fullsized":"2023-10-14T10:34:49.080142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:01.114365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.106615+0000","last_change":"2023-10-14T10:34:48.105170+0000","last_active":"2023-10-14T10:34:48.106615+0000","last_peered":"2023-10-14T10:34:48.106615+0000","last_clean":"2023-10-14T10:34:48.106615+0000","last_became_active":"2023-10-14T10:34:48.104365+0000","last_became_peered":"2023-10-14T10:34:48.104365+0000","last_unstale":"2023-10-14T10:34:48.106615+0000","last_undegraded":"2023-10-14T10:34:48.106615+0000","last_fullsized":"2023-10-14T10:34:48.106615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:52.164412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.097406+0000","last_change":"2023-10-14T10:34:48.089867+0000","last_active":"2023-10-14T10:34:48.097406+0000","last_peered":"2023-10-14T10:34:48.097406+0000","last_clean":"2023-10-14T10:34:48.097406+0000","last_became_active":"2023-10-14T10:34:48.089349+0000","last_became_peered":"2023-10-14T10:34:48.089349+0000","last_unstale":"2023-10-14T10:34:48.097406+0000","last_undegraded":"2023-10-14T10:34:48.097406+0000","last_fullsized":"2023-10-14T10:34:48.097406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:19:15.201385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.111849+0000","last_change":"2023-10-14T10:34:48.102281+0000","last_active":"2023-10-14T10:34:48.111849+0000","last_peered":"2023-10-14T10:34:48.111849+0000","last_clean":"2023-10-14T10:34:48.111849+0000","last_became_active":"2023-10-14T10:34:48.101999+0000","last_became_peered":"2023-10-14T10:34:48.101999+0000","last_unstale":"2023-10-14T10:34:48.111849+0000","last_undegraded":"2023-10-14T10:34:48.111849+0000","last_fullsized":"2023-10-14T10:34:48.111849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:04.920771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075985+0000","last_change":"2023-10-14T10:34:48.110836+0000","last_active":"2023-10-14T10:34:49.075985+0000","last_peered":"2023-10-14T10:34:49.075985+0000","last_clean":"2023-10-14T10:34:49.075985+0000","last_became_active":"2023-10-14T10:34:48.110490+0000","last_became_peered":"2023-10-14T10:34:48.110490+0000","last_unstale":"2023-10-14T10:34:49.075985+0000","last_undegraded":"2023-10-14T10:34:49.075985+0000","last_fullsized":"2023-10-14T10:34:49.075985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:55:52.597001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.111834+0000","last_change":"2023-10-14T10:34:48.102753+0000","last_active":"2023-10-14T10:34:48.111834+0000","last_peered":"2023-10-14T10:34:48.111834+0000","last_clean":"2023-10-14T10:34:48.111834+0000","last_became_active":"2023-10-14T10:34:48.102471+0000","last_became_peered":"2023-10-14T10:34:48.102471+0000","last_unstale":"2023-10-14T10:34:48.111834+0000","last_undegraded":"2023-10-14T10:34:48.111834+0000","last_fullsized":"2023-10-14T10:34:48.111834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:38.455838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.105589+0000","last_change":"2023-10-14T10:34:48.102581+0000","last_active":"2023-10-14T10:34:48.105589+0000","last_peered":"2023-10-14T10:34:48.105589+0000","last_clean":"2023-10-14T10:34:48.105589+0000","last_became_active":"2023-10-14T10:34:48.102258+0000","last_became_peered":"2023-10-14T10:34:48.102258+0000","last_unstale":"2023-10-14T10:34:48.105589+0000","last_undegraded":"2023-10-14T10:34:48.105589+0000","last_fullsized":"2023-10-14T10:34:48.105589+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:44.026366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078557+0000","last_change":"2023-10-14T10:34:48.100947+0000","last_active":"2023-10-14T10:34:49.078557+0000","last_peered":"2023-10-14T10:34:49.078557+0000","last_clean":"2023-10-14T10:34:49.078557+0000","last_became_active":"2023-10-14T10:34:48.099710+0000","last_became_peered":"2023-10-14T10:34:48.099710+0000","last_unstale":"2023-10-14T10:34:49.078557+0000","last_undegraded":"2023-10-14T10:34:49.078557+0000","last_fullsized":"2023-10-14T10:34:49.078557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:28.633301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076853+0000","last_change":"2023-10-14T10:34:48.101780+0000","last_active":"2023-10-14T10:34:49.076853+0000","last_peered":"2023-10-14T10:34:49.076853+0000","last_clean":"2023-10-14T10:34:49.076853+0000","last_became_active":"2023-10-14T10:34:48.101412+0000","last_became_peered":"2023-10-14T10:34:48.101412+0000","last_unstale":"2023-10-14T10:34:49.076853+0000","last_undegraded":"2023-10-14T10:34:49.076853+0000","last_fullsized":"2023-10-14T10:34:49.076853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:48:06.832259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.112730+0000","last_change":"2023-10-14T10:34:48.101345+0000","last_active":"2023-10-14T10:34:48.112730+0000","last_peered":"2023-10-14T10:34:48.112730+0000","last_clean":"2023-10-14T10:34:48.112730+0000","last_became_active":"2023-10-14T10:34:48.101046+0000","last_became_peered":"2023-10-14T10:34:48.101046+0000","last_unstale":"2023-10-14T10:34:48.112730+0000","last_undegraded":"2023-10-14T10:34:48.112730+0000","last_fullsized":"2023-10-14T10:34:48.112730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:00.681671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076133+0000","last_change":"2023-10-14T10:34:48.098458+0000","last_active":"2023-10-14T10:34:49.076133+0000","last_peered":"2023-10-14T10:34:49.076133+0000","last_clean":"2023-10-14T10:34:49.076133+0000","last_became_active":"2023-10-14T10:34:48.097814+0000","last_became_peered":"2023-10-14T10:34:48.097814+0000","last_unstale":"2023-10-14T10:34:49.076133+0000","last_undegraded":"2023-10-14T10:34:49.076133+0000","last_fullsized":"2023-10-14T10:34:49.076133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:05.586092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.115650+0000","last_change":"2023-10-14T10:34:48.111494+0000","last_active":"2023-10-14T10:34:48.115650+0000","last_peered":"2023-10-14T10:34:48.115650+0000","last_clean":"2023-10-14T10:34:48.115650+0000","last_became_active":"2023-10-14T10:34:48.110349+0000","last_became_peered":"2023-10-14T10:34:48.110349+0000","last_unstale":"2023-10-14T10:34:48.115650+0000","last_undegraded":"2023-10-14T10:34:48.115650+0000","last_fullsized":"2023-10-14T10:34:48.115650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:31:28.634278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.498807+0000","last_change":"2023-10-14T10:34:47.096886+0000","last_active":"2023-10-14T10:34:48.498807+0000","last_peered":"2023-10-14T10:34:48.498807+0000","last_clean":"2023-10-14T10:34:48.498807+0000","last_became_active":"2023-10-14T10:34:47.096342+0000","last_became_peered":"2023-10-14T10:34:47.096342+0000","last_unstale":"2023-10-14T10:34:48.498807+0000","last_undegraded":"2023-10-14T10:34:48.498807+0000","last_fullsized":"2023-10-14T10:34:48.498807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:37.440609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.112856+0000","last_change":"2023-10-14T10:34:48.106224+0000","last_active":"2023-10-14T10:34:48.112856+0000","last_peered":"2023-10-14T10:34:48.112856+0000","last_clean":"2023-10-14T10:34:48.112856+0000","last_became_active":"2023-10-14T10:34:48.104352+0000","last_became_peered":"2023-10-14T10:34:48.104352+0000","last_unstale":"2023-10-14T10:34:48.112856+0000","last_undegraded":"2023-10-14T10:34:48.112856+0000","last_fullsized":"2023-10-14T10:34:48.112856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:57.853799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.493398+0000","last_change":"2023-10-14T10:34:47.097491+0000","last_active":"2023-10-14T10:34:48.493398+0000","last_peered":"2023-10-14T10:34:48.493398+0000","last_clean":"2023-10-14T10:34:48.493398+0000","last_became_active":"2023-10-14T10:34:47.097213+0000","last_became_peered":"2023-10-14T10:34:47.097213+0000","last_unstale":"2023-10-14T10:34:48.493398+0000","last_undegraded":"2023-10-14T10:34:48.493398+0000","last_fullsized":"2023-10-14T10:34:48.493398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:04:38.426358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079247+0000","last_change":"2023-10-14T10:34:48.109402+0000","last_active":"2023-10-14T10:34:49.079247+0000","last_peered":"2023-10-14T10:34:49.079247+0000","last_clean":"2023-10-14T10:34:49.079247+0000","last_became_active":"2023-10-14T10:34:48.109006+0000","last_became_peered":"2023-10-14T10:34:48.109006+0000","last_unstale":"2023-10-14T10:34:49.079247+0000","last_undegraded":"2023-10-14T10:34:49.079247+0000","last_fullsized":"2023-10-14T10:34:49.079247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:52:02.254285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075438+0000","last_change":"2023-10-14T10:34:47.099070+0000","last_active":"2023-10-14T10:34:49.075438+0000","last_peered":"2023-10-14T10:34:49.075438+0000","last_clean":"2023-10-14T10:34:49.075438+0000","last_became_active":"2023-10-14T10:34:47.098634+0000","last_became_peered":"2023-10-14T10:34:47.098634+0000","last_unstale":"2023-10-14T10:34:49.075438+0000","last_undegraded":"2023-10-14T10:34:49.075438+0000","last_fullsized":"2023-10-14T10:34:49.075438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:39.967729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.109025+0000","last_change":"2023-10-14T10:34:48.094356+0000","last_active":"2023-10-14T10:34:48.109025+0000","last_peered":"2023-10-14T10:34:48.109025+0000","last_clean":"2023-10-14T10:34:48.109025+0000","last_became_active":"2023-10-14T10:34:48.093953+0000","last_became_peered":"2023-10-14T10:34:48.093953+0000","last_unstale":"2023-10-14T10:34:48.109025+0000","last_undegraded":"2023-10-14T10:34:48.109025+0000","last_fullsized":"2023-10-14T10:34:48.109025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:54:58.489664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.330087+0000","last_change":"2023-10-14T10:34:47.104307+0000","last_active":"2023-10-14T10:34:49.330087+0000","last_peered":"2023-10-14T10:34:49.330087+0000","last_clean":"2023-10-14T10:34:49.330087+0000","last_became_active":"2023-10-14T10:34:47.102470+0000","last_became_peered":"2023-10-14T10:34:47.102470+0000","last_unstale":"2023-10-14T10:34:49.330087+0000","last_undegraded":"2023-10-14T10:34:49.330087+0000","last_fullsized":"2023-10-14T10:34:49.330087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:09.464271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.077211+0000","last_change":"2023-10-14T10:34:48.111042+0000","last_active":"2023-10-14T10:34:49.077211+0000","last_peered":"2023-10-14T10:34:49.077211+0000","last_clean":"2023-10-14T10:34:49.077211+0000","last_became_active":"2023-10-14T10:34:48.110289+0000","last_became_peered":"2023-10-14T10:34:48.110289+0000","last_unstale":"2023-10-14T10:34:49.077211+0000","last_undegraded":"2023-10-14T10:34:49.077211+0000","last_fullsized":"2023-10-14T10:34:49.077211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:12:42.674090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078823+0000","last_change":"2023-10-14T10:34:47.100008+0000","last_active":"2023-10-14T10:34:49.078823+0000","last_peered":"2023-10-14T10:34:49.078823+0000","last_clean":"2023-10-14T10:34:49.078823+0000","last_became_active":"2023-10-14T10:34:47.099704+0000","last_became_peered":"2023-10-14T10:34:47.099704+0000","last_unstale":"2023-10-14T10:34:49.078823+0000","last_undegraded":"2023-10-14T10:34:49.078823+0000","last_fullsized":"2023-10-14T10:34:49.078823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:56.838570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.110086+0000","last_change":"2023-10-14T10:34:48.105607+0000","last_active":"2023-10-14T10:34:48.110086+0000","last_peered":"2023-10-14T10:34:48.110086+0000","last_clean":"2023-10-14T10:34:48.110086+0000","last_became_active":"2023-10-14T10:34:48.105291+0000","last_became_peered":"2023-10-14T10:34:48.105291+0000","last_unstale":"2023-10-14T10:34:48.110086+0000","last_undegraded":"2023-10-14T10:34:48.110086+0000","last_fullsized":"2023-10-14T10:34:48.110086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:11:56.244591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.080060+0000","last_change":"2023-10-14T10:34:47.100035+0000","last_active":"2023-10-14T10:34:49.080060+0000","last_peered":"2023-10-14T10:34:49.080060+0000","last_clean":"2023-10-14T10:34:49.080060+0000","last_became_active":"2023-10-14T10:34:47.099709+0000","last_became_peered":"2023-10-14T10:34:47.099709+0000","last_unstale":"2023-10-14T10:34:49.080060+0000","last_undegraded":"2023-10-14T10:34:49.080060+0000","last_fullsized":"2023-10-14T10:34:49.080060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:31:27.619048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078819+0000","last_change":"2023-10-14T10:34:48.097145+0000","last_active":"2023-10-14T10:34:49.078819+0000","last_peered":"2023-10-14T10:34:49.078819+0000","last_clean":"2023-10-14T10:34:49.078819+0000","last_became_active":"2023-10-14T10:34:48.096980+0000","last_became_peered":"2023-10-14T10:34:48.096980+0000","last_unstale":"2023-10-14T10:34:49.078819+0000","last_undegraded":"2023-10-14T10:34:49.078819+0000","last_fullsized":"2023-10-14T10:34:49.078819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:48:44.026366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074163+0000","last_change":"2023-10-14T10:34:47.093987+0000","last_active":"2023-10-14T10:34:49.074163+0000","last_peered":"2023-10-14T10:34:49.074163+0000","last_clean":"2023-10-14T10:34:49.074163+0000","last_became_active":"2023-10-14T10:34:47.093668+0000","last_became_peered":"2023-10-14T10:34:47.093668+0000","last_unstale":"2023-10-14T10:34:49.074163+0000","last_undegraded":"2023-10-14T10:34:49.074163+0000","last_fullsized":"2023-10-14T10:34:49.074163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:46.272932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.115337+0000","last_change":"2023-10-14T10:34:48.109852+0000","last_active":"2023-10-14T10:34:48.115337+0000","last_peered":"2023-10-14T10:34:48.115337+0000","last_clean":"2023-10-14T10:34:48.115337+0000","last_became_active":"2023-10-14T10:34:48.109585+0000","last_became_peered":"2023-10-14T10:34:48.109585+0000","last_unstale":"2023-10-14T10:34:48.115337+0000","last_undegraded":"2023-10-14T10:34:48.115337+0000","last_fullsized":"2023-10-14T10:34:48.115337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:51.026719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079047+0000","last_change":"2023-10-14T10:34:47.091217+0000","last_active":"2023-10-14T10:34:49.079047+0000","last_peered":"2023-10-14T10:34:49.079047+0000","last_clean":"2023-10-14T10:34:49.079047+0000","last_became_active":"2023-10-14T10:34:47.090952+0000","last_became_peered":"2023-10-14T10:34:47.090952+0000","last_unstale":"2023-10-14T10:34:49.079047+0000","last_undegraded":"2023-10-14T10:34:49.079047+0000","last_fullsized":"2023-10-14T10:34:49.079047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:03.905542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.110598+0000","last_change":"2023-10-14T10:34:48.106797+0000","last_active":"2023-10-14T10:34:48.110598+0000","last_peered":"2023-10-14T10:34:48.110598+0000","last_clean":"2023-10-14T10:34:48.110598+0000","last_became_active":"2023-10-14T10:34:48.106247+0000","last_became_peered":"2023-10-14T10:34:48.106247+0000","last_unstale":"2023-10-14T10:34:48.110598+0000","last_undegraded":"2023-10-14T10:34:48.110598+0000","last_fullsized":"2023-10-14T10:34:48.110598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:17.577645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075669+0000","last_change":"2023-10-14T10:34:47.098097+0000","last_active":"2023-10-14T10:34:49.075669+0000","last_peered":"2023-10-14T10:34:49.075669+0000","last_clean":"2023-10-14T10:34:49.075669+0000","last_became_active":"2023-10-14T10:34:47.097797+0000","last_became_peered":"2023-10-14T10:34:47.097797+0000","last_unstale":"2023-10-14T10:34:49.075669+0000","last_undegraded":"2023-10-14T10:34:49.075669+0000","last_fullsized":"2023-10-14T10:34:49.075669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:04.570862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075541+0000","last_change":"2023-10-14T10:34:48.112736+0000","last_active":"2023-10-14T10:34:49.075541+0000","last_peered":"2023-10-14T10:34:49.075541+0000","last_clean":"2023-10-14T10:34:49.075541+0000","last_became_active":"2023-10-14T10:34:48.112474+0000","last_became_peered":"2023-10-14T10:34:48.112474+0000","last_unstale":"2023-10-14T10:34:49.075541+0000","last_undegraded":"2023-10-14T10:34:49.075541+0000","last_fullsized":"2023-10-14T10:34:49.075541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:09:24.259730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.103144+0000","last_change":"2023-10-14T10:34:47.101978+0000","last_active":"2023-10-14T10:34:48.103144+0000","last_peered":"2023-10-14T10:34:48.103144+0000","last_clean":"2023-10-14T10:34:48.103144+0000","last_became_active":"2023-10-14T10:34:47.101673+0000","last_became_peered":"2023-10-14T10:34:47.101673+0000","last_unstale":"2023-10-14T10:34:48.103144+0000","last_undegraded":"2023-10-14T10:34:48.103144+0000","last_fullsized":"2023-10-14T10:34:48.103144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:03.905542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074828+0000","last_change":"2023-10-14T10:34:48.111235+0000","last_active":"2023-10-14T10:34:49.074828+0000","last_peered":"2023-10-14T10:34:49.074828+0000","last_clean":"2023-10-14T10:34:49.074828+0000","last_became_active":"2023-10-14T10:34:48.110985+0000","last_became_peered":"2023-10-14T10:34:48.110985+0000","last_unstale":"2023-10-14T10:34:49.074828+0000","last_undegraded":"2023-10-14T10:34:49.074828+0000","last_fullsized":"2023-10-14T10:34:49.074828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:12:42.674090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.496856+0000","last_change":"2023-10-14T10:34:47.100449+0000","last_active":"2023-10-14T10:34:48.496856+0000","last_peered":"2023-10-14T10:34:48.496856+0000","last_clean":"2023-10-14T10:34:48.496856+0000","last_became_active":"2023-10-14T10:34:47.099542+0000","last_became_peered":"2023-10-14T10:34:47.099542+0000","last_unstale":"2023-10-14T10:34:48.496856+0000","last_undegraded":"2023-10-14T10:34:48.496856+0000","last_fullsized":"2023-10-14T10:34:48.496856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:48:39.967729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.105236+0000","last_change":"2023-10-14T10:34:48.100583+0000","last_active":"2023-10-14T10:34:48.105236+0000","last_peered":"2023-10-14T10:34:48.105236+0000","last_clean":"2023-10-14T10:34:48.105236+0000","last_became_active":"2023-10-14T10:34:48.100282+0000","last_became_peered":"2023-10-14T10:34:48.100282+0000","last_unstale":"2023-10-14T10:34:48.105236+0000","last_undegraded":"2023-10-14T10:34:48.105236+0000","last_fullsized":"2023-10-14T10:34:48.105236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:11.292863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074927+0000","last_change":"2023-10-14T10:34:47.096849+0000","last_active":"2023-10-14T10:34:49.074927+0000","last_peered":"2023-10-14T10:34:49.074927+0000","last_clean":"2023-10-14T10:34:49.074927+0000","last_became_active":"2023-10-14T10:34:47.096591+0000","last_became_peered":"2023-10-14T10:34:47.096591+0000","last_unstale":"2023-10-14T10:34:49.074927+0000","last_undegraded":"2023-10-14T10:34:49.074927+0000","last_fullsized":"2023-10-14T10:34:49.074927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:10:16.562415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.108209+0000","last_change":"2023-10-14T10:34:48.097117+0000","last_active":"2023-10-14T10:34:48.108209+0000","last_peered":"2023-10-14T10:34:48.108209+0000","last_clean":"2023-10-14T10:34:48.108209+0000","last_became_active":"2023-10-14T10:34:48.094861+0000","last_became_peered":"2023-10-14T10:34:48.094861+0000","last_unstale":"2023-10-14T10:34:48.108209+0000","last_undegraded":"2023-10-14T10:34:48.108209+0000","last_fullsized":"2023-10-14T10:34:48.108209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:00.681671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079016+0000","last_change":"2023-10-14T10:34:47.090429+0000","last_active":"2023-10-14T10:34:49.079016+0000","last_peered":"2023-10-14T10:34:49.079016+0000","last_clean":"2023-10-14T10:34:49.079016+0000","last_became_active":"2023-10-14T10:34:47.089962+0000","last_became_peered":"2023-10-14T10:34:47.089962+0000","last_unstale":"2023-10-14T10:34:49.079016+0000","last_undegraded":"2023-10-14T10:34:49.079016+0000","last_fullsized":"2023-10-14T10:34:49.079016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:37.440609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.075357+0000","last_change":"2023-10-14T10:34:48.105466+0000","last_active":"2023-10-14T10:34:49.075357+0000","last_peered":"2023-10-14T10:34:49.075357+0000","last_clean":"2023-10-14T10:34:49.075357+0000","last_became_active":"2023-10-14T10:34:48.104466+0000","last_became_peered":"2023-10-14T10:34:48.104466+0000","last_unstale":"2023-10-14T10:34:49.075357+0000","last_undegraded":"2023-10-14T10:34:49.075357+0000","last_fullsized":"2023-10-14T10:34:49.075357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:56:48.618899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.073585+0000","last_change":"2023-10-14T10:34:47.092531+0000","last_active":"2023-10-14T10:34:48.073585+0000","last_peered":"2023-10-14T10:34:48.073585+0000","last_clean":"2023-10-14T10:34:48.073585+0000","last_became_active":"2023-10-14T10:34:47.092272+0000","last_became_peered":"2023-10-14T10:34:47.092272+0000","last_unstale":"2023-10-14T10:34:48.073585+0000","last_undegraded":"2023-10-14T10:34:48.073585+0000","last_fullsized":"2023-10-14T10:34:48.073585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:27.618071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076419+0000","last_change":"2023-10-14T10:34:48.106030+0000","last_active":"2023-10-14T10:34:49.076419+0000","last_peered":"2023-10-14T10:34:49.076419+0000","last_clean":"2023-10-14T10:34:49.076419+0000","last_became_active":"2023-10-14T10:34:48.105561+0000","last_became_peered":"2023-10-14T10:34:48.105561+0000","last_unstale":"2023-10-14T10:34:49.076419+0000","last_undegraded":"2023-10-14T10:34:49.076419+0000","last_fullsized":"2023-10-14T10:34:49.076419+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:47.288161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074069+0000","last_change":"2023-10-14T10:34:47.101295+0000","last_active":"2023-10-14T10:34:49.074069+0000","last_peered":"2023-10-14T10:34:49.074069+0000","last_clean":"2023-10-14T10:34:49.074069+0000","last_became_active":"2023-10-14T10:34:47.101021+0000","last_became_peered":"2023-10-14T10:34:47.101021+0000","last_unstale":"2023-10-14T10:34:49.074069+0000","last_undegraded":"2023-10-14T10:34:49.074069+0000","last_fullsized":"2023-10-14T10:34:49.074069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:11:55.229362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.115557+0000","last_change":"2023-10-14T10:34:48.106712+0000","last_active":"2023-10-14T10:34:48.115557+0000","last_peered":"2023-10-14T10:34:48.115557+0000","last_clean":"2023-10-14T10:34:48.115557+0000","last_became_active":"2023-10-14T10:34:48.105814+0000","last_became_peered":"2023-10-14T10:34:48.105814+0000","last_unstale":"2023-10-14T10:34:48.115557+0000","last_undegraded":"2023-10-14T10:34:48.115557+0000","last_fullsized":"2023-10-14T10:34:48.115557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:52.164412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074411+0000","last_change":"2023-10-14T10:34:47.100990+0000","last_active":"2023-10-14T10:34:49.074411+0000","last_peered":"2023-10-14T10:34:49.074411+0000","last_clean":"2023-10-14T10:34:49.074411+0000","last_became_active":"2023-10-14T10:34:47.098131+0000","last_became_peered":"2023-10-14T10:34:47.098131+0000","last_unstale":"2023-10-14T10:34:49.074411+0000","last_undegraded":"2023-10-14T10:34:49.074411+0000","last_fullsized":"2023-10-14T10:34:49.074411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:53:07.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079772+0000","last_change":"2023-10-14T10:34:48.105770+0000","last_active":"2023-10-14T10:34:49.079772+0000","last_peered":"2023-10-14T10:34:49.079772+0000","last_clean":"2023-10-14T10:34:49.079772+0000","last_became_active":"2023-10-14T10:34:48.104285+0000","last_became_peered":"2023-10-14T10:34:48.104285+0000","last_unstale":"2023-10-14T10:34:49.079772+0000","last_undegraded":"2023-10-14T10:34:49.079772+0000","last_fullsized":"2023-10-14T10:34:49.079772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:06.145367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.489457+0000","last_change":"2023-10-14T10:34:47.103477+0000","last_active":"2023-10-14T10:34:48.489457+0000","last_peered":"2023-10-14T10:34:48.489457+0000","last_clean":"2023-10-14T10:34:48.489457+0000","last_became_active":"2023-10-14T10:34:47.103207+0000","last_became_peered":"2023-10-14T10:34:47.103207+0000","last_unstale":"2023-10-14T10:34:48.489457+0000","last_undegraded":"2023-10-14T10:34:48.489457+0000","last_fullsized":"2023-10-14T10:34:48.489457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:49.593230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.108373+0000","last_change":"2023-10-14T10:34:48.104302+0000","last_active":"2023-10-14T10:34:48.108373+0000","last_peered":"2023-10-14T10:34:48.108373+0000","last_clean":"2023-10-14T10:34:48.108373+0000","last_became_active":"2023-10-14T10:34:48.104041+0000","last_became_peered":"2023-10-14T10:34:48.104041+0000","last_unstale":"2023-10-14T10:34:48.108373+0000","last_undegraded":"2023-10-14T10:34:48.108373+0000","last_fullsized":"2023-10-14T10:34:48.108373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:53:08.764848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079803+0000","last_change":"2023-10-14T10:34:47.090600+0000","last_active":"2023-10-14T10:34:49.079803+0000","last_peered":"2023-10-14T10:34:49.079803+0000","last_clean":"2023-10-14T10:34:49.079803+0000","last_became_active":"2023-10-14T10:34:47.089926+0000","last_became_peered":"2023-10-14T10:34:47.089926+0000","last_unstale":"2023-10-14T10:34:49.079803+0000","last_undegraded":"2023-10-14T10:34:49.079803+0000","last_fullsized":"2023-10-14T10:34:49.079803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:49.593230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.108259+0000","last_change":"2023-10-14T10:34:48.094064+0000","last_active":"2023-10-14T10:34:48.108259+0000","last_peered":"2023-10-14T10:34:48.108259+0000","last_clean":"2023-10-14T10:34:48.108259+0000","last_became_active":"2023-10-14T10:34:48.093716+0000","last_became_peered":"2023-10-14T10:34:48.093716+0000","last_unstale":"2023-10-14T10:34:48.108259+0000","last_undegraded":"2023-10-14T10:34:48.108259+0000","last_fullsized":"2023-10-14T10:34:48.108259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:19:15.201385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079525+0000","last_change":"2023-10-14T10:34:47.094365+0000","last_active":"2023-10-14T10:34:49.079525+0000","last_peered":"2023-10-14T10:34:49.079525+0000","last_clean":"2023-10-14T10:34:49.079525+0000","last_became_active":"2023-10-14T10:34:47.094082+0000","last_became_peered":"2023-10-14T10:34:47.094082+0000","last_unstale":"2023-10-14T10:34:49.079525+0000","last_undegraded":"2023-10-14T10:34:49.079525+0000","last_fullsized":"2023-10-14T10:34:49.079525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:24:59.666442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.329914+0000","last_change":"2023-10-14T10:34:48.110294+0000","last_active":"2023-10-14T10:34:49.329914+0000","last_peered":"2023-10-14T10:34:49.329914+0000","last_clean":"2023-10-14T10:34:49.329914+0000","last_became_active":"2023-10-14T10:34:48.109558+0000","last_became_peered":"2023-10-14T10:34:48.109558+0000","last_unstale":"2023-10-14T10:34:49.329914+0000","last_undegraded":"2023-10-14T10:34:49.329914+0000","last_fullsized":"2023-10-14T10:34:49.329914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:31:28.634278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.079468+0000","last_change":"2023-10-14T10:34:47.095314+0000","last_active":"2023-10-14T10:34:49.079468+0000","last_peered":"2023-10-14T10:34:49.079468+0000","last_clean":"2023-10-14T10:34:49.079468+0000","last_became_active":"2023-10-14T10:34:47.094594+0000","last_became_peered":"2023-10-14T10:34:47.094594+0000","last_unstale":"2023-10-14T10:34:49.079468+0000","last_undegraded":"2023-10-14T10:34:49.079468+0000","last_fullsized":"2023-10-14T10:34:49.079468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:54:57.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.329668+0000","last_change":"2023-10-14T10:34:48.114327+0000","last_active":"2023-10-14T10:34:49.329668+0000","last_peered":"2023-10-14T10:34:49.329668+0000","last_clean":"2023-10-14T10:34:49.329668+0000","last_became_active":"2023-10-14T10:34:48.112064+0000","last_became_peered":"2023-10-14T10:34:48.112064+0000","last_unstale":"2023-10-14T10:34:49.329668+0000","last_undegraded":"2023-10-14T10:34:49.329668+0000","last_fullsized":"2023-10-14T10:34:49.329668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:47:41.009308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.493426+0000","last_change":"2023-10-14T10:34:47.092365+0000","last_active":"2023-10-14T10:34:48.493426+0000","last_peered":"2023-10-14T10:34:48.493426+0000","last_clean":"2023-10-14T10:34:48.493426+0000","last_became_active":"2023-10-14T10:34:47.091764+0000","last_became_peered":"2023-10-14T10:34:47.091764+0000","last_unstale":"2023-10-14T10:34:48.493426+0000","last_undegraded":"2023-10-14T10:34:48.493426+0000","last_fullsized":"2023-10-14T10:34:48.493426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:37.440609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.329910+0000","last_change":"2023-10-14T10:34:48.103724+0000","last_active":"2023-10-14T10:34:49.329910+0000","last_peered":"2023-10-14T10:34:49.329910+0000","last_clean":"2023-10-14T10:34:49.329910+0000","last_became_active":"2023-10-14T10:34:48.103341+0000","last_became_peered":"2023-10-14T10:34:48.103341+0000","last_unstale":"2023-10-14T10:34:49.329910+0000","last_undegraded":"2023-10-14T10:34:49.329910+0000","last_fullsized":"2023-10-14T10:34:49.329910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:48:52.164412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.098537+0000","last_change":"2023-10-14T10:34:47.099835+0000","last_active":"2023-10-14T10:34:48.098537+0000","last_peered":"2023-10-14T10:34:48.098537+0000","last_clean":"2023-10-14T10:34:48.098537+0000","last_became_active":"2023-10-14T10:34:47.099476+0000","last_became_peered":"2023-10-14T10:34:47.099476+0000","last_unstale":"2023-10-14T10:34:48.098537+0000","last_undegraded":"2023-10-14T10:34:48.098537+0000","last_fullsized":"2023-10-14T10:34:48.098537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:54:57.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.329551+0000","last_change":"2023-10-14T10:34:48.111740+0000","last_active":"2023-10-14T10:34:49.329551+0000","last_peered":"2023-10-14T10:34:49.329551+0000","last_clean":"2023-10-14T10:34:49.329551+0000","last_became_active":"2023-10-14T10:34:48.110834+0000","last_became_peered":"2023-10-14T10:34:48.110834+0000","last_unstale":"2023-10-14T10:34:49.329551+0000","last_undegraded":"2023-10-14T10:34:49.329551+0000","last_fullsized":"2023-10-14T10:34:49.329551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:21:26.137901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078754+0000","last_change":"2023-10-14T10:34:47.095777+0000","last_active":"2023-10-14T10:34:49.078754+0000","last_peered":"2023-10-14T10:34:49.078754+0000","last_clean":"2023-10-14T10:34:49.078754+0000","last_became_active":"2023-10-14T10:34:47.095466+0000","last_became_peered":"2023-10-14T10:34:47.095466+0000","last_unstale":"2023-10-14T10:34:49.078754+0000","last_undegraded":"2023-10-14T10:34:49.078754+0000","last_fullsized":"2023-10-14T10:34:49.078754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:41:58.509640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.076712+0000","last_change":"2023-10-14T10:34:48.108443+0000","last_active":"2023-10-14T10:34:49.076712+0000","last_peered":"2023-10-14T10:34:49.076712+0000","last_clean":"2023-10-14T10:34:49.076712+0000","last_became_active":"2023-10-14T10:34:48.104834+0000","last_became_peered":"2023-10-14T10:34:48.104834+0000","last_unstale":"2023-10-14T10:34:49.076712+0000","last_undegraded":"2023-10-14T10:34:49.076712+0000","last_fullsized":"2023-10-14T10:34:49.076712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:04.413822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.085829+0000","last_change":"2023-10-14T10:34:47.102370+0000","last_active":"2023-10-14T10:34:48.085829+0000","last_peered":"2023-10-14T10:34:48.085829+0000","last_clean":"2023-10-14T10:34:48.085829+0000","last_became_active":"2023-10-14T10:34:47.101402+0000","last_became_peered":"2023-10-14T10:34:47.101402+0000","last_unstale":"2023-10-14T10:34:48.085829+0000","last_undegraded":"2023-10-14T10:34:48.085829+0000","last_fullsized":"2023-10-14T10:34:48.085829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:04.570862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.330183+0000","last_change":"2023-10-14T10:34:48.099919+0000","last_active":"2023-10-14T10:34:49.330183+0000","last_peered":"2023-10-14T10:34:49.330183+0000","last_clean":"2023-10-14T10:34:49.330183+0000","last_became_active":"2023-10-14T10:34:48.099656+0000","last_became_peered":"2023-10-14T10:34:48.099656+0000","last_unstale":"2023-10-14T10:34:49.330183+0000","last_undegraded":"2023-10-14T10:34:49.330183+0000","last_fullsized":"2023-10-14T10:34:49.330183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:51.026719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.494696+0000","last_change":"2023-10-14T10:34:47.097382+0000","last_active":"2023-10-14T10:34:48.494696+0000","last_peered":"2023-10-14T10:34:48.494696+0000","last_clean":"2023-10-14T10:34:48.494696+0000","last_became_active":"2023-10-14T10:34:47.096826+0000","last_became_peered":"2023-10-14T10:34:47.096826+0000","last_unstale":"2023-10-14T10:34:48.494696+0000","last_undegraded":"2023-10-14T10:34:48.494696+0000","last_fullsized":"2023-10-14T10:34:48.494696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:09:11.205511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.106121+0000","last_change":"2023-10-14T10:34:48.103121+0000","last_active":"2023-10-14T10:34:48.106121+0000","last_peered":"2023-10-14T10:34:48.106121+0000","last_clean":"2023-10-14T10:34:48.106121+0000","last_became_active":"2023-10-14T10:34:48.102839+0000","last_became_peered":"2023-10-14T10:34:48.102839+0000","last_unstale":"2023-10-14T10:34:48.106121+0000","last_undegraded":"2023-10-14T10:34:48.106121+0000","last_fullsized":"2023-10-14T10:34:48.106121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:09:09.645781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.103010+0000","last_change":"2023-10-14T10:34:47.100625+0000","last_active":"2023-10-14T10:34:48.103010+0000","last_peered":"2023-10-14T10:34:48.103010+0000","last_clean":"2023-10-14T10:34:48.103010+0000","last_became_active":"2023-10-14T10:34:47.100287+0000","last_became_peered":"2023-10-14T10:34:47.100287+0000","last_unstale":"2023-10-14T10:34:48.103010+0000","last_undegraded":"2023-10-14T10:34:48.103010+0000","last_fullsized":"2023-10-14T10:34:48.103010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:54:57.474434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.115724+0000","last_change":"2023-10-14T10:34:48.113303+0000","last_active":"2023-10-14T10:34:48.115724+0000","last_peered":"2023-10-14T10:34:48.115724+0000","last_clean":"2023-10-14T10:34:48.115724+0000","last_became_active":"2023-10-14T10:34:48.113043+0000","last_became_peered":"2023-10-14T10:34:48.113043+0000","last_unstale":"2023-10-14T10:34:48.115724+0000","last_undegraded":"2023-10-14T10:34:48.115724+0000","last_fullsized":"2023-10-14T10:34:48.115724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:00.681671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.074870+0000","last_change":"2023-10-14T10:34:47.105437+0000","last_active":"2023-10-14T10:34:48.074870+0000","last_peered":"2023-10-14T10:34:48.074870+0000","last_clean":"2023-10-14T10:34:48.074870+0000","last_became_active":"2023-10-14T10:34:47.104818+0000","last_became_peered":"2023-10-14T10:34:47.104818+0000","last_unstale":"2023-10-14T10:34:48.074870+0000","last_undegraded":"2023-10-14T10:34:48.074870+0000","last_fullsized":"2023-10-14T10:34:48.074870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:52:01.239056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.112897+0000","last_change":"2023-10-14T10:34:48.106001+0000","last_active":"2023-10-14T10:34:48.112897+0000","last_peered":"2023-10-14T10:34:48.112897+0000","last_clean":"2023-10-14T10:34:48.112897+0000","last_became_active":"2023-10-14T10:34:48.103578+0000","last_became_peered":"2023-10-14T10:34:48.103578+0000","last_unstale":"2023-10-14T10:34:48.112897+0000","last_undegraded":"2023-10-14T10:34:48.112897+0000","last_fullsized":"2023-10-14T10:34:48.112897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:31:28.634278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.100910+0000","last_change":"2023-10-14T10:34:47.092514+0000","last_active":"2023-10-14T10:34:48.100910+0000","last_peered":"2023-10-14T10:34:48.100910+0000","last_clean":"2023-10-14T10:34:48.100910+0000","last_became_active":"2023-10-14T10:34:47.092151+0000","last_became_peered":"2023-10-14T10:34:47.092151+0000","last_unstale":"2023-10-14T10:34:48.100910+0000","last_undegraded":"2023-10-14T10:34:48.100910+0000","last_fullsized":"2023-10-14T10:34:48.100910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:56.838570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.115532+0000","last_change":"2023-10-14T10:34:48.111368+0000","last_active":"2023-10-14T10:34:48.115532+0000","last_peered":"2023-10-14T10:34:48.115532+0000","last_clean":"2023-10-14T10:34:48.115532+0000","last_became_active":"2023-10-14T10:34:48.111109+0000","last_became_peered":"2023-10-14T10:34:48.111109+0000","last_unstale":"2023-10-14T10:34:48.115532+0000","last_undegraded":"2023-10-14T10:34:48.115532+0000","last_fullsized":"2023-10-14T10:34:48.115532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:33:51.026719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.072262+0000","last_change":"2023-10-14T10:34:47.096035+0000","last_active":"2023-10-14T10:34:48.072262+0000","last_peered":"2023-10-14T10:34:48.072262+0000","last_clean":"2023-10-14T10:34:48.072262+0000","last_became_active":"2023-10-14T10:34:47.095685+0000","last_became_peered":"2023-10-14T10:34:47.095685+0000","last_unstale":"2023-10-14T10:34:48.072262+0000","last_undegraded":"2023-10-14T10:34:48.072262+0000","last_fullsized":"2023-10-14T10:34:48.072262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:56.838570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074196+0000","last_change":"2023-10-14T10:34:48.107696+0000","last_active":"2023-10-14T10:34:49.074196+0000","last_peered":"2023-10-14T10:34:49.074196+0000","last_clean":"2023-10-14T10:34:49.074196+0000","last_became_active":"2023-10-14T10:34:48.106668+0000","last_became_peered":"2023-10-14T10:34:48.106668+0000","last_unstale":"2023-10-14T10:34:49.074196+0000","last_undegraded":"2023-10-14T10:34:49.074196+0000","last_fullsized":"2023-10-14T10:34:49.074196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:48:06.832259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078994+0000","last_change":"2023-10-14T10:34:47.092047+0000","last_active":"2023-10-14T10:34:49.078994+0000","last_peered":"2023-10-14T10:34:49.078994+0000","last_clean":"2023-10-14T10:34:49.078994+0000","last_became_active":"2023-10-14T10:34:47.091758+0000","last_became_peered":"2023-10-14T10:34:47.091758+0000","last_unstale":"2023-10-14T10:34:49.078994+0000","last_undegraded":"2023-10-14T10:34:49.078994+0000","last_fullsized":"2023-10-14T10:34:49.078994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:21.875220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.078451+0000","last_change":"2023-10-14T10:34:48.100631+0000","last_active":"2023-10-14T10:34:49.078451+0000","last_peered":"2023-10-14T10:34:49.078451+0000","last_clean":"2023-10-14T10:34:49.078451+0000","last_became_active":"2023-10-14T10:34:48.099013+0000","last_became_peered":"2023-10-14T10:34:48.099013+0000","last_unstale":"2023-10-14T10:34:49.078451+0000","last_undegraded":"2023-10-14T10:34:49.078451+0000","last_fullsized":"2023-10-14T10:34:49.078451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:09:12.220740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.074137+0000","last_change":"2023-10-14T10:34:47.101979+0000","last_active":"2023-10-14T10:34:49.074137+0000","last_peered":"2023-10-14T10:34:49.074137+0000","last_clean":"2023-10-14T10:34:49.074137+0000","last_became_active":"2023-10-14T10:34:47.101684+0000","last_became_peered":"2023-10-14T10:34:47.101684+0000","last_unstale":"2023-10-14T10:34:49.074137+0000","last_undegraded":"2023-10-14T10:34:49.074137+0000","last_fullsized":"2023-10-14T10:34:49.074137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:09:08.630552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T10:34:49.077655+0000","last_change":"2023-10-14T10:34:48.101038+0000","last_active":"2023-10-14T10:34:49.077655+0000","last_peered":"2023-10-14T10:34:49.077655+0000","last_clean":"2023-10-14T10:34:49.077655+0000","last_became_active":"2023-10-14T10:34:48.100620+0000","last_became_peered":"2023-10-14T10:34:48.100620+0000","last_unstale":"2023-10-14T10:34:49.077655+0000","last_undegraded":"2023-10-14T10:34:49.077655+0000","last_fullsized":"2023-10-14T10:34:49.077655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:47.048618+0000","last_clean_scrub_stamp":"2023-10-14T10:34:47.048618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:42:53.725104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.097328+0000","last_change":"2023-10-14T10:34:47.098675+0000","last_active":"2023-10-14T10:34:48.097328+0000","last_peered":"2023-10-14T10:34:48.097328+0000","last_clean":"2023-10-14T10:34:48.097328+0000","last_became_active":"2023-10-14T10:34:47.098349+0000","last_became_peered":"2023-10-14T10:34:47.098349+0000","last_unstale":"2023-10-14T10:34:48.097328+0000","last_undegraded":"2023-10-14T10:34:48.097328+0000","last_fullsized":"2023-10-14T10:34:48.097328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:34:46.033388+0000","last_clean_scrub_stamp":"2023-10-14T10:34:46.033388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:04:38.426358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T10:34:48.090203+0000","last_change":"2023-10-14T10:33:42.821659+0000","last_active":"2023-10-14T10:34:48.090203+0000","last_peered":"2023-10-14T10:34:48.090203+0000","last_clean":"2023-10-14T10:34:48.090203+0000","last_became_active":"2023-10-14T10:33:42.819441+0000","last_became_peered":"2023-10-14T10:33:42.819441+0000","last_unstale":"2023-10-14T10:34:48.090203+0000","last_undegraded":"2023-10-14T10:34:48.090203+0000","last_fullsized":"2023-10-14T10:34:48.090203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_clean_scrub_stamp":"2023-10-14T10:33:41.468382+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:59.542930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":742129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.107}]},{"osd":2,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.4199999999999999}]},{"osd":3,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.181}]},{"osd":4,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.218},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.488},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.2909999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":1.363}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":145962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.752}]},{"osd":1,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.84699999999999998}]},{"osd":2,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.395,"5min":3.395,"15min":3.395},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.68799999999999994}]},{"osd":3,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.089},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.0389999999999999}]},{"osd":4,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.2569999999999999}]},{"osd":5,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.327}]},{"osd":7,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.278}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":146018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.121}]},{"osd":1,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":3.1459999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.81000000000000005}]},{"osd":2,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.5920000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.9910000000000001,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":1.413}]},{"osd":4,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":1.444},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":3.8130000000000002,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.3660000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.2749999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.548},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":1.6679999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.79300000000000004}]},{"osd":1,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.115},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.1419999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.288}]},{"osd":3,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.93600000000000005}]},{"osd":5,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.038},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.3799999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.5549999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.502}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":153305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.355}]},{"osd":1,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.0069999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.47599999999999998},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.874}]},{"osd":4,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":1.175}]},{"osd":5,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.143},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.206}]},{"osd":6,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":1.248},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.272}]},{"osd":7,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.615},{"interface":"front","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":1.109}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":389120,"data_stored":151741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.70899999999999996}]},{"osd":1,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.85399999999999998}]},{"osd":4,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.498},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.89300000000000002}]},{"osd":5,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.091}]},{"osd":6,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.421}]},{"osd":7,"last update":"Sat Oct 14 10:34:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.147},{"interface":"front","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.302}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":146980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":2.258,"5min":2.258,"15min":2.258},"last":1.54}]},{"osd":2,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.3500000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.851},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.754}]},{"osd":4,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.891},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.6240000000000001}]},{"osd":5,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":4.1150000000000002,"5min":4.1150000000000002,"15min":4.1150000000000002},"last":1.9139999999999999},{"interface":"front","average":{"1min":1.657,"5min":1.657,"15min":1.657},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":2.004}]},{"osd":6,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":2.0510000000000002},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.6930000000000001}]},{"osd":7,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":4.3559999999999999,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.8},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.9369999999999998,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":1.962}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":966656,"data_stored":735714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.64400000000000002}]},{"osd":2,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.091},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.673,"5min":3.673,"15min":3.673},"last":0.89400000000000002}]},{"osd":4,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":1.123},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":1.306}]},{"osd":5,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.2490000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.3519999999999999,"5min":3.3519999999999999,"15min":3.3519999999999999},"last":1.1519999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:34:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":3.4199999999999999,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.272}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T10:34:53.538 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T10:34:53.539 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-14T10:34:53.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.811+0000 7f24e747c640 1 Processor -- start 2023-10-14T10:34:53.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.811+0000 7f24e747c640 1 -- start start 2023-10-14T10:34:53.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.812+0000 7f24e747c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24e00ab2f0 0x7f24e0152940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.812+0000 7f24e747c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f24e00aa4b0 0x7f24e006cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.812+0000 7f24e747c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f24e006d300 0x7f24e0155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.813+0000 7f24e747c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e0152e80 con 0x7f24e00aa4b0 2023-10-14T10:34:53.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.813+0000 7f24e747c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e00a83f0 con 0x7f24e006d300 2023-10-14T10:34:53.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.813+0000 7f24e747c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e01555e0 con 0x7f24e00ab2f0 2023-10-14T10:34:53.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.813+0000 7f24e4a17640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f24e00aa4b0 0x7f24e006cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:53.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.813+0000 7f24e4a17640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f24e00aa4b0 0x7f24e006cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41202/0 (socket says 172.21.15.8:41202) 2023-10-14T10:34:53.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.813+0000 7f24e4a17640 1 -- 172.21.15.8:0/3877860055 learned_addr learned my addr 172.21.15.8:0/3877860055 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:53.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.813+0000 7f24e5218640 1 --2- 172.21.15.8:0/3877860055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24e00ab2f0 0x7f24e0152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.813+0000 7f24e5a19640 1 --2- 172.21.15.8:0/3877860055 >> v2:172.21.15.92:3300/0 conn(0x7f24e006d300 0x7f24e0155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.813+0000 7f24e4a17640 1 -- 172.21.15.8:0/3877860055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24e00ab2f0 msgr2=0x7f24e0152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.813+0000 7f24e4a17640 1 --2- 172.21.15.8:0/3877860055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24e00ab2f0 0x7f24e0152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.813+0000 7f24e4a17640 1 -- 172.21.15.8:0/3877860055 >> v2:172.21.15.92:3300/0 conn(0x7f24e006d300 msgr2=0x7f24e0155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:53.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.813+0000 7f24e4a17640 1 --2- 172.21.15.8:0/3877860055 >> v2:172.21.15.92:3300/0 conn(0x7f24e006d300 0x7f24e0155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.814+0000 7f24e4a17640 1 -- 172.21.15.8:0/3877860055 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e00a8690 con 0x7f24e00aa4b0 2023-10-14T10:34:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.814+0000 7f24e5a19640 1 --2- 172.21.15.8:0/3877860055 >> v2:172.21.15.92:3300/0 conn(0x7f24e006d300 0x7f24e0155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.814+0000 7f24e5218640 1 --2- 172.21.15.8:0/3877860055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24e00ab2f0 0x7f24e0152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.815+0000 7f24e4a17640 1 --2- 172.21.15.8:0/3877860055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e00aa4b0 0x7f24e006cdc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f24e006fb00 tx=0x7f24d002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71bf1ae4ac027078 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:53.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.815+0000 7f24d7fff640 1 -- 172.21.15.8:0/3877860055 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d00317e0 con 0x7f24e00aa4b0 2023-10-14T10:34:53.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.815+0000 7f24d7fff640 1 -- 172.21.15.8:0/3877860055 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d0031940 con 0x7f24e00aa4b0 2023-10-14T10:34:53.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.815+0000 7f24d7fff640 1 -- 172.21.15.8:0/3877860055 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0031cd0 con 0x7f24e00aa4b0 2023-10-14T10:34:53.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.816+0000 7f24e747c640 1 -- 172.21.15.8:0/3877860055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e00aa4b0 msgr2=0x7f24e006cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:53.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.816+0000 7f24e747c640 1 --2- 172.21.15.8:0/3877860055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e00aa4b0 0x7f24e006cdc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f24e006fb00 tx=0x7f24d002b880 comp rx=0 tx=0).stop 2023-10-14T10:34:53.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.816+0000 7f24e747c640 1 -- 172.21.15.8:0/3877860055 shutdown_connections 2023-10-14T10:34:53.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.816+0000 7f24e747c640 1 --2- 172.21.15.8:0/3877860055 >> v2:172.21.15.92:3300/0 conn(0x7f24e006d300 0x7f24e0155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.816+0000 7f24e747c640 1 --2- 172.21.15.8:0/3877860055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e00aa4b0 0x7f24e006cdc0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.816+0000 7f24e747c640 1 --2- 172.21.15.8:0/3877860055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24e00ab2f0 0x7f24e0152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.816+0000 7f24e747c640 1 -- 172.21.15.8:0/3877860055 >> 172.21.15.8:0/3877860055 conn(0x7f24e00c56e0 msgr2=0x7f24e00c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:53.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.816+0000 7f24e747c640 1 -- 172.21.15.8:0/3877860055 shutdown_connections 2023-10-14T10:34:53.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.816+0000 7f24e747c640 1 -- 172.21.15.8:0/3877860055 wait complete. 2023-10-14T10:34:53.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.818+0000 7f24e747c640 1 Processor -- start 2023-10-14T10:34:53.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.818+0000 7f24e747c640 1 -- start start 2023-10-14T10:34:53.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e747c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24e006d300 0x7f24e0071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e747c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e00aa4b0 0x7f24e00bd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e747c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e01ed420 0x7f24e00bdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e747c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e014cd10 con 0x7f24e00aa4b0 2023-10-14T10:34:53.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e747c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e01ecf90 con 0x7f24e01ed420 2023-10-14T10:34:53.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e747c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e014ca30 con 0x7f24e006d300 2023-10-14T10:34:53.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e4a17640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e00aa4b0 0x7f24e00bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:53.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e4a17640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e00aa4b0 0x7f24e00bd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41216/0 (socket says 172.21.15.8:41216) 2023-10-14T10:34:53.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e4a17640 1 -- 172.21.15.8:0/4286993733 learned_addr learned my addr 172.21.15.8:0/4286993733 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:53.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e4a17640 1 -- 172.21.15.8:0/4286993733 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24e006d300 msgr2=0x7f24e0071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:53.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e4a17640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24e006d300 0x7f24e0071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e4a17640 1 -- 172.21.15.8:0/4286993733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e01ed420 msgr2=0x7f24e00bdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:53.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.819+0000 7f24e5a19640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e01ed420 0x7f24e00bdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:53.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.820+0000 7f24e4a17640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e01ed420 0x7f24e00bdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:53.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.820+0000 7f24e4a17640 1 -- 172.21.15.8:0/4286993733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00094d0 con 0x7f24e00aa4b0 2023-10-14T10:34:53.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.820+0000 7f24e4a17640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e00aa4b0 0x7f24e00bd600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f24d0000c00 tx=0x7f24d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:53.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.820+0000 7f24d5ffb640 1 -- 172.21.15.8:0/4286993733 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0032900 con 0x7f24e00aa4b0 2023-10-14T10:34:53.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.820+0000 7f24d5ffb640 1 -- 172.21.15.8:0/4286993733 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d0032a60 con 0x7f24e00aa4b0 2023-10-14T10:34:53.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.820+0000 7f24d5ffb640 1 -- 172.21.15.8:0/4286993733 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0032e10 con 0x7f24e00aa4b0 2023-10-14T10:34:53.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.820+0000 7f24e747c640 1 -- 172.21.15.8:0/4286993733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e01ec940 con 0x7f24e00aa4b0 2023-10-14T10:34:53.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.820+0000 7f24e747c640 1 -- 172.21.15.8:0/4286993733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e0071540 con 0x7f24e00aa4b0 2023-10-14T10:34:53.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.822+0000 7f24e747c640 1 -- 172.21.15.8:0/4286993733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e01ec7a0 con 0x7f24e00aa4b0 2023-10-14T10:34:53.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.822+0000 7f24d5ffb640 1 -- 172.21.15.8:0/4286993733 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f24d00453f0 con 0x7f24e00aa4b0 2023-10-14T10:34:53.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.823+0000 7f24d5ffb640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f24c406ae70 0x7f24c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:53.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.823+0000 7f24d5ffb640 1 -- 172.21.15.8:0/4286993733 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f24d00aba90 con 0x7f24e00aa4b0 2023-10-14T10:34:53.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.824+0000 7f24e5218640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f24c406ae70 0x7f24c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:53.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.825+0000 7f24e5218640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f24c406ae70 0x7f24c406d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f24dc006fd0 tx=0x7f24dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:53.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:53.828+0000 7f24d5ffb640 1 -- 172.21.15.8:0/4286993733 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f24e01ec7a0 con 0x7f24e00aa4b0 2023-10-14T10:34:54.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.090+0000 7f24e747c640 1 -- 172.21.15.8:0/4286993733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7f24e01ec7a0 con 0x7f24e00aa4b0 2023-10-14T10:34:54.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.094+0000 7f24d5ffb640 1 -- 172.21.15.8:0/4286993733 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 195+0+152 (secure 0 0 0) 0x7f24e01ec7a0 con 0x7f24e00aa4b0 2023-10-14T10:34:54.098 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-10-14T10:34:54.098 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQBLbiplEpMMOxAAFJoRo9wSqT02h3Z28vhhgQ== 2023-10-14T10:34:54.098 INFO:teuthology.orchestra.run.smithi008.stdout: caps mds = "allow" 2023-10-14T10:34:54.098 INFO:teuthology.orchestra.run.smithi008.stdout: caps mon = "allow r" 2023-10-14T10:34:54.098 INFO:teuthology.orchestra.run.smithi008.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-14T10:34:54.099 INFO:teuthology.orchestra.run.smithi008.stderr:updated caps for client.0 2023-10-14T10:34:54.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.097+0000 7f24e747c640 1 -- 172.21.15.8:0/4286993733 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f24c406ae70 msgr2=0x7f24c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:54.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.097+0000 7f24e747c640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f24c406ae70 0x7f24c406d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f24dc006fd0 tx=0x7f24dc008040 comp rx=0 tx=0).stop 2023-10-14T10:34:54.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.097+0000 7f24e747c640 1 -- 172.21.15.8:0/4286993733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e00aa4b0 msgr2=0x7f24e00bd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:54.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.097+0000 7f24e747c640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e00aa4b0 0x7f24e00bd600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f24d0000c00 tx=0x7f24d00046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.097+0000 7f24e747c640 1 -- 172.21.15.8:0/4286993733 shutdown_connections 2023-10-14T10:34:54.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.097+0000 7f24e747c640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f24c406ae70 0x7f24c406d330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.097+0000 7f24e747c640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e01ed420 0x7f24e00bdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.097+0000 7f24e747c640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24e00aa4b0 0x7f24e00bd600 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.097+0000 7f24e747c640 1 --2- 172.21.15.8:0/4286993733 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24e006d300 0x7f24e0071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.097+0000 7f24e747c640 1 -- 172.21.15.8:0/4286993733 >> 172.21.15.8:0/4286993733 conn(0x7f24e00c56e0 msgr2=0x7f24e00c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:54.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.098+0000 7f24e747c640 1 -- 172.21.15.8:0/4286993733 shutdown_connections 2023-10-14T10:34:54.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.098+0000 7f24e747c640 1 -- 172.21.15.8:0/4286993733 wait complete. 2023-10-14T10:34:54.121 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:34:54.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.340+0000 7f5fe36a2640 1 Processor -- start 2023-10-14T10:34:54.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.341+0000 7f5fe36a2640 1 -- start start 2023-10-14T10:34:54.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.342+0000 7f5fe36a2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5fdc13b260 0x7f5fdc0c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:54.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.342+0000 7f5fe36a2640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc151ea0 con 0x7f5fdc152960 2023-10-14T10:34:54.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.342+0000 7f5fe36a2640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc0c5d80 con 0x7f5fdc071ff0 2023-10-14T10:34:54.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.342+0000 7f5fe36a2640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc152540 con 0x7f5fdc13b260 2023-10-14T10:34:54.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.343+0000 7f5fe1c3f640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5fdc152960 0x7f5fdc06d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60404/0 (socket says 172.21.15.8:60404) 2023-10-14T10:34:54.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.343+0000 7f5fe1c3f640 1 -- 172.21.15.8:0/3558684871 learned_addr learned my addr 172.21.15.8:0/3558684871 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:54.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.343+0000 7f5fe143e640 1 --2- 172.21.15.8:0/3558684871 >> v2:172.21.15.92:3300/0 conn(0x7f5fdc13b260 0x7f5fdc0c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:54.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.343+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215426864 0 0) 0x7f5fdc151ea0 con 0x7f5fdc152960 2023-10-14T10:34:54.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.343+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc4003520 con 0x7f5fdc152960 2023-10-14T10:34:54.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095342023 0 0) 0x7f5fdc0c5d80 con 0x7f5fdc071ff0 2023-10-14T10:34:54.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fdc151ea0 con 0x7f5fdc071ff0 2023-10-14T10:34:54.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2716702360 0 0) 0x7f5fc4003520 con 0x7f5fdc152960 2023-10-14T10:34:54.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 >> v2:172.21.15.92:3300/0 conn(0x7f5fdc13b260 msgr2=0x7f5fdc0c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:54.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 --2- 172.21.15.8:0/3558684871 >> v2:172.21.15.92:3300/0 conn(0x7f5fdc13b260 0x7f5fdc0c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 >> v1:172.21.15.92:6789/0 conn(0x7f5fdc071ff0 legacy=0x7f5fdc0c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:54.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc0c6060 con 0x7f5fdc152960 2023-10-14T10:34:54.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f5fd4001670 con 0x7f5fdc152960 2023-10-14T10:34:54.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 >> v1:172.21.15.8:6789/0 conn(0x7f5fdc152960 legacy=0x7f5fdc06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:54.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc4003b50 0x7f5fc4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:54.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc40047c0 0x7f5fc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:54.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fc40051d0 0x7f5fc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:54.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc152540 con 0x7f5fc40047c0 2023-10-14T10:34:54.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc400c100 con 0x7f5fc4003b50 2023-10-14T10:34:54.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc400c2c0 con 0x7f5fc40051d0 2023-10-14T10:34:54.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.344+0000 7f5fe0c3d640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc40047c0 0x7f5fc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:54.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.345+0000 7f5fe143e640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc4003b50 0x7f5fc4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:54.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.345+0000 7f5fe1c3f640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fc40051d0 0x7f5fc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:54.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.345+0000 7f5fe0c3d640 1 -- 172.21.15.8:0/3558684871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fc40051d0 msgr2=0x7f5fc400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:54.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.345+0000 7f5fe0c3d640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fc40051d0 0x7f5fc400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.345+0000 7f5fe0c3d640 1 -- 172.21.15.8:0/3558684871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc4003b50 msgr2=0x7f5fc4003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:54.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.345+0000 7f5fe0c3d640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc4003b50 0x7f5fc4003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.345+0000 7f5fe0c3d640 1 -- 172.21.15.8:0/3558684871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc4003520 con 0x7f5fc40047c0 2023-10-14T10:34:54.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.345+0000 7f5fe143e640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc4003b50 0x7f5fc4003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:54.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.345+0000 7f5fe1c3f640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fc40051d0 0x7f5fc400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:54.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.345+0000 7f5fe1c3f640 1 -- 172.21.15.8:0/3558684871 reap_dead start 2023-10-14T10:34:54.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.346+0000 7f5fe0c3d640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc40047c0 0x7f5fc4004c40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00018d0 tx=0x7f5fc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bced126becf76633 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:54.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.346+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00052d0 con 0x7f5fc40047c0 2023-10-14T10:34:54.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.346+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0005430 con 0x7f5fc40047c0 2023-10-14T10:34:54.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.346+0000 7f5fdbfff640 1 -- 172.21.15.8:0/3558684871 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0003810 con 0x7f5fc40047c0 2023-10-14T10:34:54.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.347+0000 7f5fe36a2640 1 -- 172.21.15.8:0/3558684871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc40047c0 msgr2=0x7f5fc4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:54.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.347+0000 7f5fe36a2640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc40047c0 0x7f5fc4004c40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00018d0 tx=0x7f5fc40057f0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.347+0000 7f5fe36a2640 1 -- 172.21.15.8:0/3558684871 shutdown_connections 2023-10-14T10:34:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.347+0000 7f5fe36a2640 1 --2- 172.21.15.8:0/3558684871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fc40047c0 0x7f5fc4004c40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.347+0000 7f5fe36a2640 1 -- 172.21.15.8:0/3558684871 >> 172.21.15.8:0/3558684871 conn(0x7f5fdc0a74d0 msgr2=0x7f5fdc0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.347+0000 7f5fe36a2640 1 -- 172.21.15.8:0/3558684871 shutdown_connections 2023-10-14T10:34:54.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.347+0000 7f5fe36a2640 1 -- 172.21.15.8:0/3558684871 wait complete. 2023-10-14T10:34:54.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.349+0000 7f5fe36a2640 1 Processor -- start 2023-10-14T10:34:54.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.349+0000 7f5fe36a2640 1 -- start start 2023-10-14T10:34:54.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.350+0000 7f5fe36a2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc40047c0 0x7f5fdc0beac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:54.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.350+0000 7f5fe36a2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fdc0bf970 0x7f5fdc132f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:54.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.350+0000 7f5fe36a2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fdc0c48d0 0x7f5fdc1334b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:54.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.350+0000 7f5fe36a2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc1e8e90 con 0x7f5fdc0bf970 2023-10-14T10:34:54.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.350+0000 7f5fe36a2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0a85d0 con 0x7f5fc40047c0 2023-10-14T10:34:54.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.350+0000 7f5fe36a2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc1ece10 con 0x7f5fdc0c48d0 2023-10-14T10:34:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.350+0000 7f5fe0c3d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fdc0bf970 0x7f5fdc132f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.350+0000 7f5fe0c3d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fdc0bf970 0x7f5fdc132f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41246/0 (socket says 172.21.15.8:41246) 2023-10-14T10:34:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.350+0000 7f5fe0c3d640 1 -- 172.21.15.8:0/40535903 learned_addr learned my addr 172.21.15.8:0/40535903 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.351+0000 7f5fe143e640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc40047c0 0x7f5fdc0beac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:54.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.351+0000 7f5fe1c3f640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fdc0c48d0 0x7f5fdc1334b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.351+0000 7f5fe0c3d640 1 -- 172.21.15.8:0/40535903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fdc0c48d0 msgr2=0x7f5fdc1334b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.351+0000 7f5fe0c3d640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fdc0c48d0 0x7f5fdc1334b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.351+0000 7f5fe0c3d640 1 -- 172.21.15.8:0/40535903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc40047c0 msgr2=0x7f5fdc0beac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:54.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.351+0000 7f5fe0c3d640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc40047c0 0x7f5fdc0beac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.351+0000 7f5fe0c3d640 1 -- 172.21.15.8:0/40535903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc1ed340 con 0x7f5fdc0bf970 2023-10-14T10:34:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.351+0000 7f5fe0c3d640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fdc0bf970 0x7f5fdc132f70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00018d0 tx=0x7f5fd00012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.351+0000 7f5fd9ffb640 1 -- 172.21.15.8:0/40535903 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0006e10 con 0x7f5fdc0bf970 2023-10-14T10:34:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.351+0000 7f5fd9ffb640 1 -- 172.21.15.8:0/40535903 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0007040 con 0x7f5fdc0bf970 2023-10-14T10:34:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.352+0000 7f5fd9ffb640 1 -- 172.21.15.8:0/40535903 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00073b0 con 0x7f5fdc0bf970 2023-10-14T10:34:54.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.352+0000 7f5fe36a2640 1 -- 172.21.15.8:0/40535903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc1ed060 con 0x7f5fdc0bf970 2023-10-14T10:34:54.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.352+0000 7f5fe36a2640 1 -- 172.21.15.8:0/40535903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc151710 con 0x7f5fdc0bf970 2023-10-14T10:34:54.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.353+0000 7f5fe36a2640 1 -- 172.21.15.8:0/40535903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc073b50 con 0x7f5fdc0bf970 2023-10-14T10:34:54.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.354+0000 7f5fd9ffb640 1 -- 172.21.15.8:0/40535903 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5fd0007510 con 0x7f5fdc0bf970 2023-10-14T10:34:54.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.355+0000 7f5fd9ffb640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5fc806aea0 0x7f5fc806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:54.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.355+0000 7f5fd9ffb640 1 -- 172.21.15.8:0/40535903 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f5fd00aad20 con 0x7f5fdc0bf970 2023-10-14T10:34:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.356+0000 7f5fe143e640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5fc806aea0 0x7f5fc806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.356+0000 7f5fe143e640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5fc806aea0 0x7f5fc806d360 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc007440 tx=0x7f5fcc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:54.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.360+0000 7f5fd9ffb640 1 -- 172.21.15.8:0/40535903 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5fd0076010 con 0x7f5fdc0bf970 2023-10-14T10:34:54.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.594+0000 7f5fe36a2640 1 -- 172.21.15.8:0/40535903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fdc06d450 con 0x7f5fdc0bf970 2023-10-14T10:34:54.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.595+0000 7f5fd9ffb640 1 -- 172.21.15.8:0/40535903 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f5fd0037090 con 0x7f5fdc0bf970 2023-10-14T10:34:54.599 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:54.599 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:34:54.599 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:34:54.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.598+0000 7f5fe36a2640 1 -- 172.21.15.8:0/40535903 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5fc806aea0 msgr2=0x7f5fc806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:54.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.598+0000 7f5fe36a2640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5fc806aea0 0x7f5fc806d360 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc007440 tx=0x7f5fcc00b040 comp rx=0 tx=0).stop 2023-10-14T10:34:54.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.598+0000 7f5fe36a2640 1 -- 172.21.15.8:0/40535903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fdc0bf970 msgr2=0x7f5fdc132f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:54.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.598+0000 7f5fe36a2640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fdc0bf970 0x7f5fdc132f70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00018d0 tx=0x7f5fd00012d0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.598+0000 7f5fe36a2640 1 -- 172.21.15.8:0/40535903 shutdown_connections 2023-10-14T10:34:54.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.598+0000 7f5fe36a2640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f5fc806aea0 0x7f5fc806d360 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.598+0000 7f5fe36a2640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fdc0c48d0 0x7f5fdc1334b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.598+0000 7f5fe36a2640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fdc0bf970 0x7f5fdc132f70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.598+0000 7f5fe36a2640 1 --2- 172.21.15.8:0/40535903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc40047c0 0x7f5fdc0beac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:54.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.598+0000 7f5fe36a2640 1 -- 172.21.15.8:0/40535903 >> 172.21.15.8:0/40535903 conn(0x7f5fdc0a74d0 msgr2=0x7f5fdc0c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:54.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.598+0000 7f5fe36a2640 1 -- 172.21.15.8:0/40535903 shutdown_connections 2023-10-14T10:34:54.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:54.598+0000 7f5fe36a2640 1 -- 172.21.15.8:0/40535903 wait complete. 2023-10-14T10:34:55.024 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T10:34:47.550249+0000', 'modified': '2023-10-14T10:34:50.997788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5052': {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T10:34:55.024 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T10:34:55.025 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T10:34:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.259+0000 7f3f9759e640 1 Processor -- start 2023-10-14T10:34:55.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.260+0000 7f3f9759e640 1 -- start start 2023-10-14T10:34:55.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.262+0000 7f3f9759e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f980bb4d0 0x7f3f98070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.262+0000 7f3f9759e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3f980bfc10 0x7f3f980c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.262+0000 7f3f9759e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980ba6d0 con 0x7f3f9814dc00 2023-10-14T10:34:55.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.262+0000 7f3f9759e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f981548d0 con 0x7f3f980bfc10 2023-10-14T10:34:55.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.262+0000 7f3f9759e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98070c20 con 0x7f3f980bb4d0 2023-10-14T10:34:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.262+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f980bb4d0 0x7f3f98070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.262+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f980bb4d0 0x7f3f98070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:59854/0 (socket says 172.21.15.8:59854) 2023-10-14T10:34:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.262+0000 7f3f8ffff640 1 -- 172.21.15.8:0/3222723207 learned_addr learned my addr 172.21.15.8:0/3222723207 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.262+0000 7f3f96d9d640 1 --2- 172.21.15.8:0/3222723207 >> v2:172.21.15.92:3300/0 conn(0x7f3f980bfc10 0x7f3f980c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.263+0000 7f3f95d9b640 1 -- 172.21.15.8:0/3222723207 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301672701 0 0) 0x7f3f980ba6d0 con 0x7f3f9814dc00 2023-10-14T10:34:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.263+0000 7f3f95d9b640 1 -- 172.21.15.8:0/3222723207 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f84003520 con 0x7f3f9814dc00 2023-10-14T10:34:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.263+0000 7f3f8ffff640 1 -- 172.21.15.8:0/3222723207 >> v2:172.21.15.92:3300/0 conn(0x7f3f980bfc10 msgr2=0x7f3f980c00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.263+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/3222723207 >> v2:172.21.15.92:3300/0 conn(0x7f3f980bfc10 0x7f3f980c00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.263+0000 7f3f8ffff640 1 -- 172.21.15.8:0/3222723207 >> v1:172.21.15.92:6789/0 conn(0x7f3f9814dc00 legacy=0x7f3f980bba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.263+0000 7f3f8ffff640 1 -- 172.21.15.8:0/3222723207 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f98153b10 con 0x7f3f980bb4d0 2023-10-14T10:34:55.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.264+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/3222723207 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f980bb4d0 0x7f3f98070520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009870 tx=0x7f3f8002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5d544ce91de467c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:55.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.265+0000 7f3f95d9b640 1 -- 172.21.15.8:0/3222723207 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8002f840 con 0x7f3f980bb4d0 2023-10-14T10:34:55.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.265+0000 7f3f95d9b640 1 -- 172.21.15.8:0/3222723207 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8002f9a0 con 0x7f3f980bb4d0 2023-10-14T10:34:55.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.265+0000 7f3f95d9b640 1 -- 172.21.15.8:0/3222723207 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8002fd10 con 0x7f3f980bb4d0 2023-10-14T10:34:55.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.266+0000 7f3f9759e640 1 -- 172.21.15.8:0/3222723207 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f980bb4d0 msgr2=0x7f3f98070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.266+0000 7f3f9759e640 1 --2- 172.21.15.8:0/3222723207 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f980bb4d0 0x7f3f98070520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009870 tx=0x7f3f8002ba20 comp rx=0 tx=0).stop 2023-10-14T10:34:55.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.266+0000 7f3f9759e640 1 -- 172.21.15.8:0/3222723207 shutdown_connections 2023-10-14T10:34:55.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.266+0000 7f3f9759e640 1 --2- 172.21.15.8:0/3222723207 >> v2:172.21.15.92:3300/0 conn(0x7f3f980bfc10 0x7f3f980c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.266+0000 7f3f9759e640 1 --2- 172.21.15.8:0/3222723207 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f980bb4d0 0x7f3f98070520 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.266+0000 7f3f9759e640 1 -- 172.21.15.8:0/3222723207 >> 172.21.15.8:0/3222723207 conn(0x7f3f9806a200 msgr2=0x7f3f9806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:55.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.266+0000 7f3f9759e640 1 -- 172.21.15.8:0/3222723207 shutdown_connections 2023-10-14T10:34:55.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.266+0000 7f3f9759e640 1 -- 172.21.15.8:0/3222723207 wait complete. 2023-10-14T10:34:55.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.268+0000 7f3f9759e640 1 Processor -- start 2023-10-14T10:34:55.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.268+0000 7f3f9759e640 1 -- start start 2023-10-14T10:34:55.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.270+0000 7f3f9759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f980bb4d0 0x7f3f981e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.270+0000 7f3f9759e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f980bfc10 0x7f3f9814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.270+0000 7f3f9759e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f9814dc00 0x7f3f9814af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.270+0000 7f3f9759e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9814d630 con 0x7f3f980bfc10 2023-10-14T10:34:55.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.270+0000 7f3f9759e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980beca0 con 0x7f3f980bb4d0 2023-10-14T10:34:55.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.270+0000 7f3f9759e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980bf190 con 0x7f3f9814dc00 2023-10-14T10:34:55.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.270+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f980bfc10 0x7f3f9814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.270+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f980bfc10 0x7f3f9814bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41262/0 (socket says 172.21.15.8:41262) 2023-10-14T10:34:55.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.270+0000 7f3f8ffff640 1 -- 172.21.15.8:0/4088443362 learned_addr learned my addr 172.21.15.8:0/4088443362 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:55.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.270+0000 7f3f9659c640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f980bb4d0 0x7f3f981e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.270+0000 7f3f96d9d640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f9814dc00 0x7f3f9814af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.271+0000 7f3f8ffff640 1 -- 172.21.15.8:0/4088443362 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f9814dc00 msgr2=0x7f3f9814af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.271+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f9814dc00 0x7f3f9814af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.271+0000 7f3f8ffff640 1 -- 172.21.15.8:0/4088443362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f980bb4d0 msgr2=0x7f3f981e90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.271+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f980bb4d0 0x7f3f981e90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.271+0000 7f3f8ffff640 1 -- 172.21.15.8:0/4088443362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f800094d0 con 0x7f3f980bfc10 2023-10-14T10:34:55.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.271+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f980bfc10 0x7f3f9814bfe0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3f8002ba60 tx=0x7f3f800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:55.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.271+0000 7f3f8effd640 1 -- 172.21.15.8:0/4088443362 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8003b040 con 0x7f3f980bfc10 2023-10-14T10:34:55.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.272+0000 7f3f8effd640 1 -- 172.21.15.8:0/4088443362 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f80003810 con 0x7f3f980bfc10 2023-10-14T10:34:55.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.272+0000 7f3f9759e640 1 -- 172.21.15.8:0/4088443362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9814b9c0 con 0x7f3f980bfc10 2023-10-14T10:34:55.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.272+0000 7f3f8effd640 1 -- 172.21.15.8:0/4088443362 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80003bc0 con 0x7f3f980bfc10 2023-10-14T10:34:55.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.272+0000 7f3f9759e640 1 -- 172.21.15.8:0/4088443362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9806d9b0 con 0x7f3f980bfc10 2023-10-14T10:34:55.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.274+0000 7f3f8effd640 1 -- 172.21.15.8:0/4088443362 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3f80003d20 con 0x7f3f980bfc10 2023-10-14T10:34:55.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.276+0000 7f3f8effd640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3f7806aea0 0x7f3f7806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.276+0000 7f3f8effd640 1 -- 172.21.15.8:0/4088443362 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3f800ac1b0 con 0x7f3f980bfc10 2023-10-14T10:34:55.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.276+0000 7f3f9659c640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3f7806aea0 0x7f3f7806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.277+0000 7f3f9fb87740 1 Processor -- start 2023-10-14T10:34:55.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.277+0000 7f3f9fb87740 1 -- start start 2023-10-14T10:34:55.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.277+0000 7f3f9659c640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3f7806aea0 0x7f3f7806d360 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f880011e0 tx=0x7f3f88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:55.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9fb87740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 0x55edb7c7e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9fb87740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c43c20 0x55edb7c7dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9fb87740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c809f0 0x55edb7c429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9fb87740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb7b5d7a0 con 0x55edb7c7d880 2023-10-14T10:34:55.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9fb87740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb7baf740 con 0x55edb7c43c20 2023-10-14T10:34:55.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9fb87740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edb7bace30 con 0x55edb7c809f0 2023-10-14T10:34:55.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 0x55edb7c7e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 0x55edb7c7e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41272/0 (socket says 172.21.15.8:41272) 2023-10-14T10:34:55.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9659c640 1 -- 172.21.15.8:0/1012576837 learned_addr learned my addr 172.21.15.8:0/1012576837 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:55.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9659c640 1 -- 172.21.15.8:0/1012576837 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c809f0 msgr2=0x55edb7c429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:55.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9659c640 1 --2- 172.21.15.8:0/1012576837 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c809f0 0x55edb7c429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9659c640 1 -- 172.21.15.8:0/1012576837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c43c20 msgr2=0x55edb7c7dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:55.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9659c640 1 --2- 172.21.15.8:0/1012576837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c43c20 0x55edb7c7dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.278+0000 7f3f9659c640 1 -- 172.21.15.8:0/1012576837 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edb7b6c910 con 0x55edb7c7d880 2023-10-14T10:34:55.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.279+0000 7f3f9659c640 1 --2- 172.21.15.8:0/1012576837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 0x55edb7c7e9f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800f880 tx=0x7f3f88012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e4e284d61754bb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:55.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.279+0000 7f3f77fff640 1 -- 172.21.15.8:0/1012576837 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88014950 con 0x55edb7c7d880 2023-10-14T10:34:55.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.279+0000 7f3f77fff640 1 -- 172.21.15.8:0/1012576837 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f88014ad0 con 0x55edb7c7d880 2023-10-14T10:34:55.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.279+0000 7f3f77fff640 1 -- 172.21.15.8:0/1012576837 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88014e80 con 0x55edb7c7d880 2023-10-14T10:34:55.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.279+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1012576837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 msgr2=0x55edb7c7e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.279+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/1012576837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 0x55edb7c7e9f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800f880 tx=0x7f3f88012000 comp rx=0 tx=0).stop 2023-10-14T10:34:55.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.280+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1012576837 shutdown_connections 2023-10-14T10:34:55.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.280+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/1012576837 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c809f0 0x55edb7c429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.280+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/1012576837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c43c20 0x55edb7c7dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.280+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/1012576837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 0x55edb7c7e9f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.280+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1012576837 >> 172.21.15.8:0/1012576837 conn(0x55edb7c3f260 msgr2=0x55edb7c63c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:55.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.280+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1012576837 shutdown_connections 2023-10-14T10:34:55.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.280+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1012576837 wait complete. 2023-10-14T10:34:55.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.280+0000 7f3f9fb87740 1 -- start start 2023-10-14T10:34:55.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.281+0000 7f3f9fb87740 1 Processor -- start 2023-10-14T10:34:55.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f9fb87740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c7d880 0x55edb7c799c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f9fb87740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 0x55edb7c8ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f9fb87740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c8f290 0x55edb7c62c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f9fb87740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb7ba8720 con 0x55edb7c809f0 2023-10-14T10:34:55.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f9fb87740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb7b46970 con 0x55edb7c7d880 2023-10-14T10:34:55.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f9fb87740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edb7b46610 con 0x55edb7c8f290 2023-10-14T10:34:55.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f9fb87740 10 client.0 _ll_register_callbacks cb 0x55edb7b689d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:34:55.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 0x55edb7c8ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 0x55edb7c8ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41288/0 (socket says 172.21.15.8:41288) 2023-10-14T10:34:55.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f8ffff640 1 -- 172.21.15.8:0/1252573829 learned_addr learned my addr 172.21.15.8:0/1252573829 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:55.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f8ffff640 1 -- 172.21.15.8:0/1252573829 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c8f290 msgr2=0x55edb7c62c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/1252573829 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c8f290 0x55edb7c62c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f8ffff640 1 -- 172.21.15.8:0/1252573829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c7d880 msgr2=0x55edb7c799c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f9659c640 1 --2- 172.21.15.8:0/1252573829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c7d880 0x55edb7c799c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/1252573829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c7d880 0x55edb7c799c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f8ffff640 1 -- 172.21.15.8:0/1252573829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f84003520 con 0x55edb7c809f0 2023-10-14T10:34:55.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/1252573829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 0x55edb7c8ed50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3f8002c030 tx=0x7f3f8007ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=badc3aecb5d2992 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:55.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f757fa640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:34:55.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f757fa640 1 -- 172.21.15.8:0/1252573829 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8007fea0 con 0x55edb7c809f0 2023-10-14T10:34:55.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f757fa640 1 -- 172.21.15.8:0/1252573829 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3f8007f160 con 0x55edb7c809f0 2023-10-14T10:34:55.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1252573829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55edb7bcf160 con 0x55edb7c809f0 2023-10-14T10:34:55.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f757fa640 1 -- 172.21.15.8:0/1252573829 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f800812b0 con 0x55edb7c809f0 2023-10-14T10:34:55.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f9fb87740 10 client.5229 fetch_fsmap learned FSMap version 17 2023-10-14T10:34:55.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1252573829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55edb7ba6da0 con 0x55edb7c809f0 2023-10-14T10:34:55.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.283+0000 7f3f757fa640 1 -- 172.21.15.8:0/1252573829 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55edb7bcf160 con 0x55edb7c809f0 2023-10-14T10:34:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.284+0000 7f3f757fa640 1 -- 172.21.15.8:0/1252573829 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f3f80035020 con 0x55edb7c809f0 2023-10-14T10:34:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.284+0000 7f3f9fb87740 10 client.5229 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:34:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.284+0000 7f3f9fb87740 10 client.5229 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:34:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.284+0000 7f3f9fb87740 20 client.5229 populate_metadata read hostname 'smithi008' 2023-10-14T10:34:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.284+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/1252573829 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55edb7c75bb0 0x55edb7c75f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.284+0000 7f3f9fb87740 4 client.5229 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T10:34:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.284+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1252573829 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55edb7b7acc0 con 0x55edb7c75bb0 2023-10-14T10:34:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.284+0000 7f3f9659c640 1 --2- 172.21.15.8:0/1252573829 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55edb7c75bb0 0x55edb7c75f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.285+0000 7f3f9659c640 1 --2- 172.21.15.8:0/1252573829 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55edb7c75bb0 0x55edb7c75f90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4c2ca848df3b21e server_cookie=52c87762830b457c in_seq=0 out_seq=0 2023-10-14T10:34:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.285+0000 7f3f757fa640 10 client.5229 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:34:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.285+0000 7f3f757fa640 1 -- 172.21.15.8:0/1252573829 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55edb7b7acc0 con 0x55edb7c75bb0 2023-10-14T10:34:55.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.285+0000 7f3f757fa640 10 client.5229 handle_command_reply: tid=0 2023-10-14T10:34:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f9fb87740 1 client.5229 shutdown 2023-10-14T10:34:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1252573829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 msgr2=0x55edb7c8ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/1252573829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 0x55edb7c8ed50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3f8002c030 tx=0x7f3f8007ac70 comp rx=0 tx=0).stop 2023-10-14T10:34:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1252573829 shutdown_connections 2023-10-14T10:34:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/1252573829 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55edb7c75bb0 0x55edb7c75f90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/1252573829 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c8f290 0x55edb7c62c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/1252573829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 0x55edb7c8ed50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/1252573829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c7d880 0x55edb7c799c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1252573829 >> 172.21.15.8:0/1252573829 conn(0x55edb7c43c20 msgr2=0x55edb7c7ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:55.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f757fa640 0 client.5229 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:34:55.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1252573829 shutdown_connections 2023-10-14T10:34:55.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f9fb87740 1 -- 172.21.15.8:0/1252573829 wait complete. 2023-10-14T10:34:55.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.286+0000 7f3f9fb87740 20 client.5229 trim_cache size 0 max 16384 2023-10-14T10:34:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.304+0000 7f3f9fb87740 1 Processor -- start 2023-10-14T10:34:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.304+0000 7f3f9fb87740 1 -- start start 2023-10-14T10:34:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.304+0000 7f3f9fb87740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c7d880 0x55edb7c7a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.304+0000 7f3f9fb87740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 0x55edb7c8c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.304+0000 7f3f9fb87740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c8ecd0 0x55edb7c8c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.304+0000 7f3f9fb87740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb790cf20 con 0x55edb7c809f0 2023-10-14T10:34:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.304+0000 7f3f9fb87740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb7c74b60 con 0x55edb7c7d880 2023-10-14T10:34:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.304+0000 7f3f9fb87740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edb7c42130 con 0x55edb7c8ecd0 2023-10-14T10:34:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.304+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 0x55edb7c8c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.304+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 0x55edb7c8c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41294/0 (socket says 172.21.15.8:41294) 2023-10-14T10:34:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.305+0000 7f3f8ffff640 1 -- 172.21.15.8:0/2316186177 learned_addr learned my addr 172.21.15.8:0/2316186177 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.305+0000 7f3f96d9d640 1 --2- 172.21.15.8:0/2316186177 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c8ecd0 0x55edb7c8c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.305+0000 7f3f8ffff640 1 -- 172.21.15.8:0/2316186177 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c8ecd0 msgr2=0x55edb7c8c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:55.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.305+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/2316186177 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c8ecd0 0x55edb7c8c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.305+0000 7f3f8ffff640 1 -- 172.21.15.8:0/2316186177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c7d880 msgr2=0x55edb7c7a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:55.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.305+0000 7f3f9659c640 1 --2- 172.21.15.8:0/2316186177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c7d880 0x55edb7c7a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.305+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/2316186177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c7d880 0x55edb7c7a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.305+0000 7f3f8ffff640 1 -- 172.21.15.8:0/2316186177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edb7b45b80 con 0x55edb7c809f0 2023-10-14T10:34:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.305+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/2316186177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 0x55edb7c8c130 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009870 tx=0x7f3f8007d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950c899d000d82d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.305+0000 7f3f8cff9640 1 -- 172.21.15.8:0/2316186177 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8007fea0 con 0x55edb7c809f0 2023-10-14T10:34:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.306+0000 7f3f8cff9640 1 -- 172.21.15.8:0/2316186177 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f80083360 con 0x55edb7c809f0 2023-10-14T10:34:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.306+0000 7f3f8cff9640 1 -- 172.21.15.8:0/2316186177 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f800812b0 con 0x55edb7c809f0 2023-10-14T10:34:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.306+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2316186177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 msgr2=0x55edb7c8c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.306+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/2316186177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 0x55edb7c8c130 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009870 tx=0x7f3f8007d000 comp rx=0 tx=0).stop 2023-10-14T10:34:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.306+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2316186177 shutdown_connections 2023-10-14T10:34:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.306+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/2316186177 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c8ecd0 0x55edb7c8c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.306+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/2316186177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c809f0 0x55edb7c8c130 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.306+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/2316186177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c7d880 0x55edb7c7a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.306+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2316186177 >> 172.21.15.8:0/2316186177 conn(0x55edb7c43c20 msgr2=0x55edb7c3e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:55.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.306+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2316186177 shutdown_connections 2023-10-14T10:34:55.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.306+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2316186177 wait complete. 2023-10-14T10:34:55.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.307+0000 7f3f9fb87740 1 -- start start 2023-10-14T10:34:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.307+0000 7f3f9fb87740 1 Processor -- start 2023-10-14T10:34:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.308+0000 7f3f9fb87740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 0x55edb7c73c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.308+0000 7f3f9fb87740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c809f0 0x55edb7c77b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.308+0000 7f3f9fb87740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c3d780 0x55edb7c789e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.308+0000 7f3f9fb87740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb7c3cce0 con 0x55edb7c7d880 2023-10-14T10:34:55.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.308+0000 7f3f9fb87740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb7c741b0 con 0x55edb7c809f0 2023-10-14T10:34:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.308+0000 7f3f9fb87740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edb7c64150 con 0x55edb7c3d780 2023-10-14T10:34:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.308+0000 7f3f9fb87740 10 client.0 _ll_register_callbacks cb 0x55edb7c7ee80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:34:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.308+0000 7f3f9659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 0x55edb7c73c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.308+0000 7f3f9659c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 0x55edb7c73c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41306/0 (socket says 172.21.15.8:41306) 2023-10-14T10:34:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.308+0000 7f3f9659c640 1 -- 172.21.15.8:0/2628753450 learned_addr learned my addr 172.21.15.8:0/2628753450 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:55.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.309+0000 7f3f9659c640 1 -- 172.21.15.8:0/2628753450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c3d780 msgr2=0x55edb7c789e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:55.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.309+0000 7f3f9659c640 1 --2- 172.21.15.8:0/2628753450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c3d780 0x55edb7c789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.309+0000 7f3f9659c640 1 -- 172.21.15.8:0/2628753450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c809f0 msgr2=0x55edb7c77b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:55.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.309+0000 7f3f9659c640 1 --2- 172.21.15.8:0/2628753450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c809f0 0x55edb7c77b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.309+0000 7f3f9659c640 1 -- 172.21.15.8:0/2628753450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edb7ba6da0 con 0x55edb7c7d880 2023-10-14T10:34:55.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.309+0000 7f3f9659c640 1 --2- 172.21.15.8:0/2628753450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 0x55edb7c73c70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3f88020000 tx=0x7f3f88001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf578265b72cac3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.309+0000 7f3f757fa640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:34:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.309+0000 7f3f757fa640 1 -- 172.21.15.8:0/2628753450 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88001d40 con 0x55edb7c7d880 2023-10-14T10:34:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.309+0000 7f3f757fa640 1 -- 172.21.15.8:0/2628753450 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3f8801c040 con 0x55edb7c7d880 2023-10-14T10:34:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.309+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2628753450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f88014ad0 con 0x55edb7c7d880 2023-10-14T10:34:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.310+0000 7f3f757fa640 1 -- 172.21.15.8:0/2628753450 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f88014e40 con 0x55edb7c7d880 2023-10-14T10:34:55.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.310+0000 7f3f9fb87740 10 client.5235 fetch_fsmap learned FSMap version 17 2023-10-14T10:34:55.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.310+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2628753450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55edb7b6b170 con 0x55edb7c7d880 2023-10-14T10:34:55.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.310+0000 7f3f757fa640 1 -- 172.21.15.8:0/2628753450 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f88014ad0 con 0x55edb7c7d880 2023-10-14T10:34:55.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.310+0000 7f3f757fa640 1 -- 172.21.15.8:0/2628753450 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f3f88012070 con 0x55edb7c7d880 2023-10-14T10:34:55.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.310+0000 7f3f9fb87740 10 client.5235 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:34:55.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.310+0000 7f3f9fb87740 10 client.5235 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:34:55.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.310+0000 7f3f9fb87740 20 client.5235 populate_metadata read hostname 'smithi008' 2023-10-14T10:34:55.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.310+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/2628753450 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55edb7cf3010 0x55edb7cf33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.310+0000 7f3f9fb87740 4 client.5235 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T10:34:55.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.310+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2628753450 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55edb7ba1700 con 0x55edb7cf3010 2023-10-14T10:34:55.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.310+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/2628753450 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55edb7cf3010 0x55edb7cf33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f8ffff640 1 --2- 172.21.15.8:0/2628753450 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55edb7cf3010 0x55edb7cf33f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46734775dae51753 server_cookie=4f7c9f60bf95cb86 in_seq=0 out_seq=0 2023-10-14T10:34:55.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f757fa640 10 client.5235 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:34:55.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f757fa640 1 -- 172.21.15.8:0/2628753450 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55edb7ba1700 con 0x55edb7cf3010 2023-10-14T10:34:55.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f757fa640 10 client.5235 handle_command_reply: tid=0 2023-10-14T10:34:55.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f9fb87740 1 client.5235 shutdown 2023-10-14T10:34:55.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2628753450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 msgr2=0x55edb7c73c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/2628753450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 0x55edb7c73c70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3f88020000 tx=0x7f3f88001150 comp rx=0 tx=0).stop 2023-10-14T10:34:55.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2628753450 shutdown_connections 2023-10-14T10:34:55.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/2628753450 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55edb7cf3010 0x55edb7cf33f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/2628753450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55edb7c3d780 0x55edb7c789e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/2628753450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb7c809f0 0x55edb7c77b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f9fb87740 1 --2- 172.21.15.8:0/2628753450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55edb7c7d880 0x55edb7c73c70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f757fa640 0 client.5235 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:34:55.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.311+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2628753450 >> 172.21.15.8:0/2628753450 conn(0x55edb7c43c20 msgr2=0x55edb7c60ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:55.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.312+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2628753450 shutdown_connections 2023-10-14T10:34:55.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.312+0000 7f3f9fb87740 1 -- 172.21.15.8:0/2628753450 wait complete. 2023-10-14T10:34:55.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.312+0000 7f3f9fb87740 20 client.5235 trim_cache size 0 max 16384 2023-10-14T10:34:55.328 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:34:55.328 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "452b10b4-f8ad-4e99-85d0-4d157f344356", 2023-10-14T10:34:55.329 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-14T10:34:55.329 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5052, 2023-10-14T10:34:55.329 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-14T10:34:55.329 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-14T10:34:55.329 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "testcephfs1", 2023-10-14T10:34:55.330 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 6.836121629, 2023-10-14T10:34:55.330 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 17, 2023-10-14T10:34:55.330 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 34, 2023-10-14T10:34:55.330 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 34, 2023-10-14T10:34:55.330 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 16.053672789 2023-10-14T10:34:55.331 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:34:55.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.312+0000 7f3f9759e640 1 -- 172.21.15.8:0/4088443362 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3f7806aea0 msgr2=0x7f3f7806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.312+0000 7f3f9759e640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3f7806aea0 0x7f3f7806d360 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f880011e0 tx=0x7f3f88009040 comp rx=0 tx=0).stop 2023-10-14T10:34:55.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.312+0000 7f3f9759e640 1 -- 172.21.15.8:0/4088443362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f980bfc10 msgr2=0x7f3f9814bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.312+0000 7f3f9759e640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f980bfc10 0x7f3f9814bfe0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3f8002ba60 tx=0x7f3f800046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.312+0000 7f3f9759e640 1 -- 172.21.15.8:0/4088443362 shutdown_connections 2023-10-14T10:34:55.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.312+0000 7f3f9759e640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3f7806aea0 0x7f3f7806d360 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.312+0000 7f3f9759e640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f9814dc00 0x7f3f9814af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.312+0000 7f3f9759e640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f980bfc10 0x7f3f9814bfe0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.312+0000 7f3f9759e640 1 --2- 172.21.15.8:0/4088443362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f980bb4d0 0x7f3f981e90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.313+0000 7f3f9759e640 1 -- 172.21.15.8:0/4088443362 >> 172.21.15.8:0/4088443362 conn(0x7f3f9806a200 msgr2=0x7f3f980c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:55.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.313+0000 7f3f9759e640 1 -- 172.21.15.8:0/4088443362 shutdown_connections 2023-10-14T10:34:55.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.313+0000 7f3f9759e640 1 -- 172.21.15.8:0/4088443362 wait complete. 2023-10-14T10:34:55.335 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:34:55.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.554+0000 7f8d3696e640 1 Processor -- start 2023-10-14T10:34:55.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.554+0000 7f8d3696e640 1 -- start start 2023-10-14T10:34:55.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.555+0000 7f8d3696e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8d30155470 0x7f8d30157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.555+0000 7f8d3696e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d300c4210 0x7f8d300c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.555+0000 7f8d3696e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d300ca6c0 con 0x7f8d30151590 2023-10-14T10:34:55.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.555+0000 7f8d3696e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d300c4f70 con 0x7f8d30155470 2023-10-14T10:34:55.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.555+0000 7f8d3696e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d30157a10 con 0x7f8d300c4210 2023-10-14T10:34:55.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.556+0000 7f8d2f7fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8d30155470 0x7f8d30157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.556+0000 7f8d34f0b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d300c4210 0x7f8d300c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.556+0000 7f8d2ffff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8d30151590 0x7f8d30154a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:51360/0 (socket says 172.21.15.8:51360) 2023-10-14T10:34:55.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.556+0000 7f8d2ffff640 1 -- 172.21.15.8:0/2474097024 learned_addr learned my addr 172.21.15.8:0/2474097024 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:34:55.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.556+0000 7f8d2f7fe640 1 --2- 172.21.15.8:0/2474097024 >> v2:172.21.15.92:3300/0 conn(0x7f8d30155470 0x7f8d30157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.8:37806/0 (socket says 172.21.15.8:37806) 2023-10-14T10:34:55.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.557+0000 7f8d2f7fe640 1 -- 172.21.15.8:0/2474097024 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d300c4210 msgr2=0x7f8d300c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:55.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.557+0000 7f8d2f7fe640 1 --2- 172.21.15.8:0/2474097024 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d300c4210 0x7f8d300c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.557+0000 7f8d2f7fe640 1 -- 172.21.15.8:0/2474097024 >> v1:172.21.15.92:6789/0 conn(0x7f8d30151590 legacy=0x7f8d30154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.557+0000 7f8d2f7fe640 1 -- 172.21.15.8:0/2474097024 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d301558b0 con 0x7f8d30155470 2023-10-14T10:34:55.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.557+0000 7f8d34f0b640 1 --2- 172.21.15.8:0/2474097024 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d300c4210 0x7f8d300c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T10:34:55.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.559+0000 7f8d2f7fe640 1 --2- 172.21.15.8:0/2474097024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d30155470 0x7f8d30157ea0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8d240097a0 tx=0x7f8d2402b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fae06abf5b9bcee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:55.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.559+0000 7f8d2effd640 1 -- 172.21.15.8:0/2474097024 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d240316f0 con 0x7f8d30155470 2023-10-14T10:34:55.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.559+0000 7f8d2effd640 1 -- 172.21.15.8:0/2474097024 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d24031850 con 0x7f8d30155470 2023-10-14T10:34:55.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.559+0000 7f8d2effd640 1 -- 172.21.15.8:0/2474097024 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24031be0 con 0x7f8d30155470 2023-10-14T10:34:55.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.560+0000 7f8d3696e640 1 -- 172.21.15.8:0/2474097024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d30155470 msgr2=0x7f8d30157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.560+0000 7f8d3696e640 1 --2- 172.21.15.8:0/2474097024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d30155470 0x7f8d30157ea0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8d240097a0 tx=0x7f8d2402b790 comp rx=0 tx=0).stop 2023-10-14T10:34:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.560+0000 7f8d3696e640 1 -- 172.21.15.8:0/2474097024 shutdown_connections 2023-10-14T10:34:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.560+0000 7f8d3696e640 1 --2- 172.21.15.8:0/2474097024 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d300c4210 0x7f8d300c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.560+0000 7f8d3696e640 1 --2- 172.21.15.8:0/2474097024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d30155470 0x7f8d30157ea0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.560+0000 7f8d3696e640 1 -- 172.21.15.8:0/2474097024 >> 172.21.15.8:0/2474097024 conn(0x7f8d30065ed0 msgr2=0x7f8d300662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:55.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.560+0000 7f8d3696e640 1 -- 172.21.15.8:0/2474097024 shutdown_connections 2023-10-14T10:34:55.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.560+0000 7f8d3696e640 1 -- 172.21.15.8:0/2474097024 wait complete. 2023-10-14T10:34:55.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.562+0000 7f8d3696e640 1 Processor -- start 2023-10-14T10:34:55.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.562+0000 7f8d3696e640 1 -- start start 2023-10-14T10:34:55.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.563+0000 7f8d3696e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d300c4210 0x7f8d300abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.563+0000 7f8d3696e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d30151590 0x7f8d301545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.563+0000 7f8d3696e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d30155470 0x7f8d30154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.563+0000 7f8d3696e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d30155070 con 0x7f8d30151590 2023-10-14T10:34:55.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.563+0000 7f8d3696e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d30154160 con 0x7f8d30155470 2023-10-14T10:34:55.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.563+0000 7f8d3696e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d30152140 con 0x7f8d300c4210 2023-10-14T10:34:55.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.563+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d30151590 0x7f8d301545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.563+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d30151590 0x7f8d301545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41320/0 (socket says 172.21.15.8:41320) 2023-10-14T10:34:55.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.563+0000 7f8d2f7fe640 1 -- 172.21.15.8:0/3483214081 learned_addr learned my addr 172.21.15.8:0/3483214081 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:55.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.563+0000 7f8d34f0b640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d30155470 0x7f8d30154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.563+0000 7f8d2f7fe640 1 -- 172.21.15.8:0/3483214081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d300c4210 msgr2=0x7f8d300abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.564+0000 7f8d2f7fe640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d300c4210 0x7f8d300abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.564+0000 7f8d2f7fe640 1 -- 172.21.15.8:0/3483214081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d30155470 msgr2=0x7f8d30154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.564+0000 7f8d2f7fe640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d30155470 0x7f8d30154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.564+0000 7f8d2f7fe640 1 -- 172.21.15.8:0/3483214081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d28009a70 con 0x7f8d30151590 2023-10-14T10:34:55.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.564+0000 7f8d34f0b640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d30155470 0x7f8d30154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:55.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.564+0000 7f8d2f7fe640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d30151590 0x7f8d301545f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8d240098c0 tx=0x7f8d240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:55.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.564+0000 7f8d2cff9640 1 -- 172.21.15.8:0/3483214081 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24034680 con 0x7f8d30151590 2023-10-14T10:34:55.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.564+0000 7f8d2cff9640 1 -- 172.21.15.8:0/3483214081 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d24034800 con 0x7f8d30151590 2023-10-14T10:34:55.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.564+0000 7f8d3696e640 1 -- 172.21.15.8:0/3483214081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d24009400 con 0x7f8d30151590 2023-10-14T10:34:55.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.564+0000 7f8d2cff9640 1 -- 172.21.15.8:0/3483214081 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24034bb0 con 0x7f8d30151590 2023-10-14T10:34:55.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.564+0000 7f8d3696e640 1 -- 172.21.15.8:0/3483214081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d30152700 con 0x7f8d30151590 2023-10-14T10:34:55.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.566+0000 7f8d3696e640 1 -- 172.21.15.8:0/3483214081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d301528f0 con 0x7f8d30151590 2023-10-14T10:34:55.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.567+0000 7f8d2cff9640 1 -- 172.21.15.8:0/3483214081 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8d2403b040 con 0x7f8d30151590 2023-10-14T10:34:55.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.568+0000 7f8d2cff9640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8d1c06aea0 0x7f8d1c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:55.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.568+0000 7f8d2cff9640 1 -- 172.21.15.8:0/3483214081 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f8d240aaf20 con 0x7f8d30151590 2023-10-14T10:34:55.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.568+0000 7f8d2ffff640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8d1c06aea0 0x7f8d1c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:55.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.569+0000 7f8d2ffff640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8d1c06aea0 0x7f8d1c06d360 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8d20000f60 tx=0x7f8d20007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:55.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.572+0000 7f8d2cff9640 1 -- 172.21.15.8:0/3483214081 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d240760b0 con 0x7f8d30151590 2023-10-14T10:34:55.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.807+0000 7f8d3696e640 1 -- 172.21.15.8:0/3483214081 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d30073b50 con 0x7f8d30151590 2023-10-14T10:34:55.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.808+0000 7f8d2cff9640 1 -- 172.21.15.8:0/3483214081 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f8d240796d0 con 0x7f8d30151590 2023-10-14T10:34:55.812 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:55.812 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:34:55.812 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:34:55.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.811+0000 7f8d3696e640 1 -- 172.21.15.8:0/3483214081 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8d1c06aea0 msgr2=0x7f8d1c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.811+0000 7f8d3696e640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8d1c06aea0 0x7f8d1c06d360 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8d20000f60 tx=0x7f8d20007a80 comp rx=0 tx=0).stop 2023-10-14T10:34:55.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.811+0000 7f8d3696e640 1 -- 172.21.15.8:0/3483214081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d30151590 msgr2=0x7f8d301545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:55.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.811+0000 7f8d3696e640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d30151590 0x7f8d301545f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8d240098c0 tx=0x7f8d240046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.811+0000 7f8d3696e640 1 -- 172.21.15.8:0/3483214081 shutdown_connections 2023-10-14T10:34:55.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.811+0000 7f8d3696e640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8d1c06aea0 0x7f8d1c06d360 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.811+0000 7f8d3696e640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d30155470 0x7f8d30154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.811+0000 7f8d3696e640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d30151590 0x7f8d301545f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.811+0000 7f8d3696e640 1 --2- 172.21.15.8:0/3483214081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d300c4210 0x7f8d300abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:55.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.811+0000 7f8d3696e640 1 -- 172.21.15.8:0/3483214081 >> 172.21.15.8:0/3483214081 conn(0x7f8d30065ed0 msgr2=0x7f8d30149c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:55.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.811+0000 7f8d3696e640 1 -- 172.21.15.8:0/3483214081 shutdown_connections 2023-10-14T10:34:55.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:55.811+0000 7f8d3696e640 1 -- 172.21.15.8:0/3483214081 wait complete. 2023-10-14T10:34:55.834 INFO:tasks.cephfs.test_failover:status = { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T10:34:47.550249+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5052": { "addr": "172.21.15.8:6837/799022047", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6836", "nonce": 799022047, "type": "v2" }, { "addr": "172.21.15.8:6837", "nonce": 799022047, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5052, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T10:34:50.997788+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5052 } } } ], "standbys": [ { "addr": "172.21.15.8:6835/1474692193", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6834", "nonce": 1474692193, "type": "v2" }, { "addr": "172.21.15.8:6835", "nonce": 1474692193, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4532, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6835/2045070429", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6833", "nonce": 2045070429, "type": "v2" }, { "addr": "172.21.15.92:6835", "nonce": 2045070429, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4538, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6834/337485030", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6832", "nonce": 337485030, "type": "v2" }, { "addr": "172.21.15.92:6834", "nonce": 337485030, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4726, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T10:34:55.834 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T10:34:55.835 INFO:tasks.cephfs.test_failover:current = [{'gid': 4532, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.8:6835/1474692193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6834', 'nonce': 1474692193}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 1474692193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 4726, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6834/337485030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 337485030}, {'type': 'v1', 'addr': '172.21.15.92:6834', 'nonce': 337485030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 4538, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6835/2045070429', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6833', 'nonce': 2045070429}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2045070429}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T10:34:55.835 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.a mds_join_fs cephfs 2023-10-14T10:34:56.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.057+0000 7ff685260640 1 Processor -- start 2023-10-14T10:34:56.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.057+0000 7ff685260640 1 -- start start 2023-10-14T10:34:56.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.058+0000 7ff685260640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff68013af90 0x7ff6800a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.058+0000 7ff685260640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff6800bfc10 0x7ff6800c0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.058+0000 7ff685260640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff680152ac0 con 0x7ff68006fb10 2023-10-14T10:34:56.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.058+0000 7ff685260640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff680151eb0 con 0x7ff6800bfc10 2023-10-14T10:34:56.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.058+0000 7ff685260640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff680152190 con 0x7ff68013af90 2023-10-14T10:34:56.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.058+0000 7ff684a5f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff6800bfc10 0x7ff6800c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.058+0000 7ff684a5f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff6800bfc10 0x7ff6800c0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41334/0 (socket says 172.21.15.8:41334) 2023-10-14T10:34:56.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.058+0000 7ff684a5f640 1 -- 172.21.15.8:0/2171355628 learned_addr learned my addr 172.21.15.8:0/2171355628 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:56.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.059+0000 7ff67ffff640 1 --2- 172.21.15.8:0/2171355628 >> v2:172.21.15.92:3300/0 conn(0x7ff68013af90 0x7ff6800a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.059+0000 7ff684a5f640 1 -- 172.21.15.8:0/2171355628 >> v2:172.21.15.92:3300/0 conn(0x7ff68013af90 msgr2=0x7ff6800a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:56.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.059+0000 7ff684a5f640 1 --2- 172.21.15.8:0/2171355628 >> v2:172.21.15.92:3300/0 conn(0x7ff68013af90 0x7ff6800a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.059+0000 7ff684a5f640 1 -- 172.21.15.8:0/2171355628 >> v1:172.21.15.8:6789/0 conn(0x7ff68006fb10 legacy=0x7ff6800c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:56.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.059+0000 7ff684a5f640 1 -- 172.21.15.8:0/2171355628 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff680152470 con 0x7ff6800bfc10 2023-10-14T10:34:56.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.060+0000 7ff684a5f640 1 --2- 172.21.15.8:0/2171355628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800bfc10 0x7ff6800c0080 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff6800c1660 tx=0x7ff67802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29bab1cc99211c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:56.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.060+0000 7ff67effd640 1 -- 172.21.15.8:0/2171355628 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67802ca80 con 0x7ff6800bfc10 2023-10-14T10:34:56.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.061+0000 7ff67effd640 1 -- 172.21.15.8:0/2171355628 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67802cbe0 con 0x7ff6800bfc10 2023-10-14T10:34:56.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.061+0000 7ff67effd640 1 -- 172.21.15.8:0/2171355628 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6780343f0 con 0x7ff6800bfc10 2023-10-14T10:34:56.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.061+0000 7ff685260640 1 -- 172.21.15.8:0/2171355628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800bfc10 msgr2=0x7ff6800c0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:56.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.061+0000 7ff685260640 1 --2- 172.21.15.8:0/2171355628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800bfc10 0x7ff6800c0080 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff6800c1660 tx=0x7ff67802bee0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.061+0000 7ff685260640 1 -- 172.21.15.8:0/2171355628 shutdown_connections 2023-10-14T10:34:56.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.061+0000 7ff685260640 1 --2- 172.21.15.8:0/2171355628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6800bfc10 0x7ff6800c0080 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.061+0000 7ff685260640 1 --2- 172.21.15.8:0/2171355628 >> v2:172.21.15.92:3300/0 conn(0x7ff68013af90 0x7ff6800a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.061+0000 7ff685260640 1 -- 172.21.15.8:0/2171355628 >> 172.21.15.8:0/2171355628 conn(0x7ff68006a200 msgr2=0x7ff68006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:56.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.061+0000 7ff685260640 1 -- 172.21.15.8:0/2171355628 shutdown_connections 2023-10-14T10:34:56.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.061+0000 7ff685260640 1 -- 172.21.15.8:0/2171355628 wait complete. 2023-10-14T10:34:56.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.064+0000 7ff685260640 1 Processor -- start 2023-10-14T10:34:56.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.064+0000 7ff685260640 1 -- start start 2023-10-14T10:34:56.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.066+0000 7ff685260640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff68006fb10 0x7ff6800bb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.066+0000 7ff685260640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff6800bfc10 0x7ff68006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.066+0000 7ff685260640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff68013af90 0x7ff68006c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.066+0000 7ff685260640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68006da40 con 0x7ff68013af90 2023-10-14T10:34:56.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.066+0000 7ff685260640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6801ed630 con 0x7ff68006fb10 2023-10-14T10:34:56.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.066+0000 7ff685260640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff680139c90 con 0x7ff6800bfc10 2023-10-14T10:34:56.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff684a5f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff68013af90 0x7ff68006c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff684a5f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff68013af90 0x7ff68006c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41336/0 (socket says 172.21.15.8:41336) 2023-10-14T10:34:56.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff684a5f640 1 -- 172.21.15.8:0/2957980988 learned_addr learned my addr 172.21.15.8:0/2957980988 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:56.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff67f7fe640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff6800bfc10 0x7ff68006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff67ffff640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff68006fb10 0x7ff6800bb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff684a5f640 1 -- 172.21.15.8:0/2957980988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff6800bfc10 msgr2=0x7ff68006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff684a5f640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff6800bfc10 0x7ff68006bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff684a5f640 1 -- 172.21.15.8:0/2957980988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff68006fb10 msgr2=0x7ff6800bb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff684a5f640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff68006fb10 0x7ff6800bb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff684a5f640 1 -- 172.21.15.8:0/2957980988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff678009b30 con 0x7ff68013af90 2023-10-14T10:34:56.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff67ffff640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff68006fb10 0x7ff6800bb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:34:56.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff684a5f640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff68013af90 0x7ff68006c1f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff678009f40 tx=0x7ff678004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:56.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff67cff9640 1 -- 172.21.15.8:0/2957980988 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678009510 con 0x7ff68013af90 2023-10-14T10:34:56.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff67cff9640 1 -- 172.21.15.8:0/2957980988 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67803e450 con 0x7ff68013af90 2023-10-14T10:34:56.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff67cff9640 1 -- 172.21.15.8:0/2957980988 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67803e820 con 0x7ff68013af90 2023-10-14T10:34:56.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff685260640 1 -- 172.21.15.8:0/2957980988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68006c730 con 0x7ff68013af90 2023-10-14T10:34:56.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.067+0000 7ff685260640 1 -- 172.21.15.8:0/2957980988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6801ecd00 con 0x7ff68013af90 2023-10-14T10:34:56.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.068+0000 7ff685260640 1 -- 172.21.15.8:0/2957980988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6801ed7a0 con 0x7ff68013af90 2023-10-14T10:34:56.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.070+0000 7ff67cff9640 1 -- 172.21.15.8:0/2957980988 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff67802cd50 con 0x7ff68013af90 2023-10-14T10:34:56.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.070+0000 7ff67cff9640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff66c06ae70 0x7ff66c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.071+0000 7ff67cff9640 1 -- 172.21.15.8:0/2957980988 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7ff6780ac0b0 con 0x7ff68013af90 2023-10-14T10:34:56.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.071+0000 7ff67ffff640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff66c06ae70 0x7ff66c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.071+0000 7ff67ffff640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff66c06ae70 0x7ff66c06d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff680071040 tx=0x7ff670008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:56.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.077+0000 7ff67cff9640 1 -- 172.21.15.8:0/2957980988 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff678077130 con 0x7ff68013af90 2023-10-14T10:34:56.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.277+0000 7ff685260640 1 -- 172.21.15.8:0/2957980988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7ff6800619f0 con 0x7ff68013af90 2023-10-14T10:34:56.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.285+0000 7ff67cff9640 1 -- 172.21.15.8:0/2957980988 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v12)=0 v12) v1 ==== 116+0+0 (secure 0 0 0) 0x7ff67807a750 con 0x7ff68013af90 2023-10-14T10:34:56.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.287+0000 7ff685260640 1 -- 172.21.15.8:0/2957980988 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff66c06ae70 msgr2=0x7ff66c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:56.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.287+0000 7ff685260640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff66c06ae70 0x7ff66c06d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff680071040 tx=0x7ff670008040 comp rx=0 tx=0).stop 2023-10-14T10:34:56.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.287+0000 7ff685260640 1 -- 172.21.15.8:0/2957980988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff68013af90 msgr2=0x7ff68006c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:56.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.287+0000 7ff685260640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff68013af90 0x7ff68006c1f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff678009f40 tx=0x7ff678004a40 comp rx=0 tx=0).stop 2023-10-14T10:34:56.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.287+0000 7ff685260640 1 -- 172.21.15.8:0/2957980988 shutdown_connections 2023-10-14T10:34:56.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.287+0000 7ff685260640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7ff66c06ae70 0x7ff66c06d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.287+0000 7ff685260640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff68013af90 0x7ff68006c1f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.287+0000 7ff685260640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff6800bfc10 0x7ff68006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.287+0000 7ff685260640 1 --2- 172.21.15.8:0/2957980988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff68006fb10 0x7ff6800bb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.287+0000 7ff685260640 1 -- 172.21.15.8:0/2957980988 >> 172.21.15.8:0/2957980988 conn(0x7ff68006a200 msgr2=0x7ff680139420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:56.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.288+0000 7ff685260640 1 -- 172.21.15.8:0/2957980988 shutdown_connections 2023-10-14T10:34:56.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.288+0000 7ff685260640 1 -- 172.21.15.8:0/2957980988 wait complete. 2023-10-14T10:34:56.310 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:34:56.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.529+0000 7fa512135640 1 Processor -- start 2023-10-14T10:34:56.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.529+0000 7fa512135640 1 -- start start 2023-10-14T10:34:56.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.531+0000 7fa512135640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa50c0c2380 0x7fa50c070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.531+0000 7fa512135640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50c071550 0x7fa50c0a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.531+0000 7fa512135640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa50c0c06f0 0x7fa50c1511a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.531+0000 7fa512135640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c071190 con 0x7fa50c0c2380 2023-10-14T10:34:56.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.531+0000 7fa512135640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c0719e0 con 0x7fa50c0c06f0 2023-10-14T10:34:56.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.531+0000 7fa512135640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c071cc0 con 0x7fa50c071550 2023-10-14T10:34:56.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.531+0000 7fa511133640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa50c0c2380 0x7fa50c070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.531+0000 7fa511133640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa50c0c2380 0x7fa50c070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41350/0 (socket says 172.21.15.8:41350) 2023-10-14T10:34:56.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.531+0000 7fa511133640 1 -- 172.21.15.8:0/222064946 learned_addr learned my addr 172.21.15.8:0/222064946 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:56.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.531+0000 7fa510932640 1 --2- 172.21.15.8:0/222064946 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50c071550 0x7fa50c0a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.531+0000 7fa511934640 1 --2- 172.21.15.8:0/222064946 >> v2:172.21.15.92:3300/0 conn(0x7fa50c0c06f0 0x7fa50c1511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.532+0000 7fa511133640 1 -- 172.21.15.8:0/222064946 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50c071550 msgr2=0x7fa50c0a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:56.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.532+0000 7fa511133640 1 --2- 172.21.15.8:0/222064946 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50c071550 0x7fa50c0a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.532+0000 7fa511133640 1 -- 172.21.15.8:0/222064946 >> v2:172.21.15.92:3300/0 conn(0x7fa50c0c06f0 msgr2=0x7fa50c1511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:56.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.532+0000 7fa511133640 1 --2- 172.21.15.8:0/222064946 >> v2:172.21.15.92:3300/0 conn(0x7fa50c0c06f0 0x7fa50c1511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.532+0000 7fa511133640 1 -- 172.21.15.8:0/222064946 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c071fa0 con 0x7fa50c0c2380 2023-10-14T10:34:56.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.532+0000 7fa511934640 1 --2- 172.21.15.8:0/222064946 >> v2:172.21.15.92:3300/0 conn(0x7fa50c0c06f0 0x7fa50c1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:56.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.533+0000 7fa511133640 1 --2- 172.21.15.8:0/222064946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa50c0c2380 0x7fa50c070c50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0bf970 tx=0x7fa50802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb6a747c469a5b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:56.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.533+0000 7fa503fff640 1 -- 172.21.15.8:0/222064946 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508031870 con 0x7fa50c0c2380 2023-10-14T10:34:56.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.533+0000 7fa503fff640 1 -- 172.21.15.8:0/222064946 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5080319d0 con 0x7fa50c0c2380 2023-10-14T10:34:56.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.533+0000 7fa503fff640 1 -- 172.21.15.8:0/222064946 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508031d60 con 0x7fa50c0c2380 2023-10-14T10:34:56.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.534+0000 7fa512135640 1 -- 172.21.15.8:0/222064946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa50c0c2380 msgr2=0x7fa50c070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:56.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.534+0000 7fa512135640 1 --2- 172.21.15.8:0/222064946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa50c0c2380 0x7fa50c070c50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0bf970 tx=0x7fa50802b910 comp rx=0 tx=0).stop 2023-10-14T10:34:56.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.534+0000 7fa512135640 1 -- 172.21.15.8:0/222064946 shutdown_connections 2023-10-14T10:34:56.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.534+0000 7fa512135640 1 --2- 172.21.15.8:0/222064946 >> v2:172.21.15.92:3300/0 conn(0x7fa50c0c06f0 0x7fa50c1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.534+0000 7fa512135640 1 --2- 172.21.15.8:0/222064946 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50c071550 0x7fa50c0a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.534+0000 7fa512135640 1 --2- 172.21.15.8:0/222064946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa50c0c2380 0x7fa50c070c50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.534+0000 7fa512135640 1 -- 172.21.15.8:0/222064946 >> 172.21.15.8:0/222064946 conn(0x7fa50c06a200 msgr2=0x7fa50c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:56.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.534+0000 7fa512135640 1 -- 172.21.15.8:0/222064946 shutdown_connections 2023-10-14T10:34:56.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.534+0000 7fa512135640 1 -- 172.21.15.8:0/222064946 wait complete. 2023-10-14T10:34:56.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.536+0000 7fa512135640 1 Processor -- start 2023-10-14T10:34:56.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.536+0000 7fa512135640 1 -- start start 2023-10-14T10:34:56.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa512135640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa50c0c06f0 0x7fa50c1eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa512135640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c0c2380 0x7fa50c0c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa512135640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50c157ae0 0x7fa50c1ea030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa512135640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c1ec820 con 0x7fa50c0c06f0 2023-10-14T10:34:56.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa512135640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c158330 con 0x7fa50c0c2380 2023-10-14T10:34:56.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa512135640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c158050 con 0x7fa50c157ae0 2023-10-14T10:34:56.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa511133640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa50c0c06f0 0x7fa50c1eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa511133640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa50c0c06f0 0x7fa50c1eccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41354/0 (socket says 172.21.15.8:41354) 2023-10-14T10:34:56.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa511133640 1 -- 172.21.15.8:0/580045551 learned_addr learned my addr 172.21.15.8:0/580045551 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:56.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa511934640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50c157ae0 0x7fa50c1ea030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa511133640 1 -- 172.21.15.8:0/580045551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50c157ae0 msgr2=0x7fa50c1ea030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:56.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa510932640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c0c2380 0x7fa50c0c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa511133640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50c157ae0 0x7fa50c1ea030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa511133640 1 -- 172.21.15.8:0/580045551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c0c2380 msgr2=0x7fa50c0c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:56.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa511133640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c0c2380 0x7fa50c0c4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa511133640 1 -- 172.21.15.8:0/580045551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5080094d0 con 0x7fa50c0c06f0 2023-10-14T10:34:56.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.537+0000 7fa511934640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50c157ae0 0x7fa50c1ea030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:56.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.538+0000 7fa511133640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa50c0c06f0 0x7fa50c1eccb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa50802b950 tx=0x7fa5080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:56.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.538+0000 7fa501ffb640 1 -- 172.21.15.8:0/580045551 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50803ad30 con 0x7fa50c0c06f0 2023-10-14T10:34:56.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.538+0000 7fa501ffb640 1 -- 172.21.15.8:0/580045551 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5080443f0 con 0x7fa50c0c06f0 2023-10-14T10:34:56.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.538+0000 7fa501ffb640 1 -- 172.21.15.8:0/580045551 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5080447a0 con 0x7fa50c0c06f0 2023-10-14T10:34:56.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.538+0000 7fa512135640 1 -- 172.21.15.8:0/580045551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c1ec1d0 con 0x7fa50c0c06f0 2023-10-14T10:34:56.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.538+0000 7fa512135640 1 -- 172.21.15.8:0/580045551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c14ded0 con 0x7fa50c0c06f0 2023-10-14T10:34:56.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.539+0000 7fa512135640 1 -- 172.21.15.8:0/580045551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c04e9b0 con 0x7fa50c0c06f0 2023-10-14T10:34:56.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.540+0000 7fa501ffb640 1 -- 172.21.15.8:0/580045551 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa50804d450 con 0x7fa50c0c06f0 2023-10-14T10:34:56.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.541+0000 7fa501ffb640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa4f006aea0 0x7fa4f006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:56.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.541+0000 7fa501ffb640 1 -- 172.21.15.8:0/580045551 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fa50802d040 con 0x7fa50c0c06f0 2023-10-14T10:34:56.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.542+0000 7fa510932640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa4f006aea0 0x7fa4f006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:56.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.542+0000 7fa510932640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa4f006aea0 0x7fa4f006d360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc006fd0 tx=0x7fa4fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:56.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.546+0000 7fa501ffb640 1 -- 172.21.15.8:0/580045551 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa508076cb0 con 0x7fa50c0c06f0 2023-10-14T10:34:56.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.779+0000 7fa512135640 1 -- 172.21.15.8:0/580045551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa50c149dd0 con 0x7fa50c0c06f0 2023-10-14T10:34:56.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.781+0000 7fa501ffb640 1 -- 172.21.15.8:0/580045551 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7fa508035020 con 0x7fa50c0c06f0 2023-10-14T10:34:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:34:56.784 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:34:56.785 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:34:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.783+0000 7fa512135640 1 -- 172.21.15.8:0/580045551 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa4f006aea0 msgr2=0x7fa4f006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.783+0000 7fa512135640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa4f006aea0 0x7fa4f006d360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc006fd0 tx=0x7fa4fc008040 comp rx=0 tx=0).stop 2023-10-14T10:34:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.783+0000 7fa512135640 1 -- 172.21.15.8:0/580045551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa50c0c06f0 msgr2=0x7fa50c1eccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:56.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.783+0000 7fa512135640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa50c0c06f0 0x7fa50c1eccb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa50802b950 tx=0x7fa5080046c0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.785+0000 7fa512135640 1 -- 172.21.15.8:0/580045551 shutdown_connections 2023-10-14T10:34:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.785+0000 7fa512135640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa4f006aea0 0x7fa4f006d360 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.785+0000 7fa512135640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50c157ae0 0x7fa50c1ea030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.785+0000 7fa512135640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa50c0c2380 0x7fa50c0c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.785+0000 7fa512135640 1 --2- 172.21.15.8:0/580045551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa50c0c06f0 0x7fa50c1eccb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.785+0000 7fa512135640 1 -- 172.21.15.8:0/580045551 >> 172.21.15.8:0/580045551 conn(0x7fa50c06a200 msgr2=0x7fa50c0732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.785+0000 7fa512135640 1 -- 172.21.15.8:0/580045551 shutdown_connections 2023-10-14T10:34:56.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:56.785+0000 7fa512135640 1 -- 172.21.15.8:0/580045551 wait complete. 2023-10-14T10:34:57.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T10:34:47.550249+0000', 'modified': '2023-10-14T10:34:50.997788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5052': {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T10:34:57.210 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T10:34:57.210 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T10:34:57.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.440+0000 7f039b59e640 1 Processor -- start 2023-10-14T10:34:57.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.440+0000 7f039b59e640 1 -- start start 2023-10-14T10:34:57.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.441+0000 7f039b59e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f039c0c23a0 0x7f039c14df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.442+0000 7f039b59e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f039c0aa030 0x7f039c1513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.442+0000 7f039b59e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039c154d90 con 0x7f039c0bbf60 2023-10-14T10:34:57.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.442+0000 7f039b59e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039c0bc3f0 con 0x7f039c0aa030 2023-10-14T10:34:57.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.442+0000 7f039b59e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039c155220 con 0x7f039c0c23a0 2023-10-14T10:34:57.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.442+0000 7f039ad9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f039c0aa030 0x7f039c1513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.442+0000 7f039ad9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f039c0aa030 0x7f039c1513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42038/0 (socket says 172.21.15.8:42038) 2023-10-14T10:34:57.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.442+0000 7f039ad9d640 1 -- 172.21.15.8:0/4055426933 learned_addr learned my addr 172.21.15.8:0/4055426933 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:57.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.442+0000 7f039ad9d640 1 -- 172.21.15.8:0/4055426933 >> v2:172.21.15.92:3300/0 conn(0x7f039c0c23a0 msgr2=0x7f039c14df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:57.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.442+0000 7f039ad9d640 1 --2- 172.21.15.8:0/4055426933 >> v2:172.21.15.92:3300/0 conn(0x7f039c0c23a0 0x7f039c14df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.442+0000 7f039ad9d640 1 -- 172.21.15.8:0/4055426933 >> v1:172.21.15.92:6789/0 conn(0x7f039c0bbf60 legacy=0x7f039c150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:57.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.442+0000 7f039ad9d640 1 -- 172.21.15.8:0/4055426933 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c154460 con 0x7f039c0aa030 2023-10-14T10:34:57.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.444+0000 7f039ad9d640 1 --2- 172.21.15.8:0/4055426933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f039c0aa030 0x7f039c1513e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f039c0c2c00 tx=0x7f039402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd8ee7196bc66ff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:57.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.444+0000 7f0399d9b640 1 -- 172.21.15.8:0/4055426933 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039402c9f0 con 0x7f039c0aa030 2023-10-14T10:34:57.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.444+0000 7f0399d9b640 1 -- 172.21.15.8:0/4055426933 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039402cb50 con 0x7f039c0aa030 2023-10-14T10:34:57.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.444+0000 7f0399d9b640 1 -- 172.21.15.8:0/4055426933 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03940343f0 con 0x7f039c0aa030 2023-10-14T10:34:57.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.445+0000 7f039b59e640 1 -- 172.21.15.8:0/4055426933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f039c0aa030 msgr2=0x7f039c1513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:57.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.445+0000 7f039b59e640 1 --2- 172.21.15.8:0/4055426933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f039c0aa030 0x7f039c1513e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f039c0c2c00 tx=0x7f039402be50 comp rx=0 tx=0).stop 2023-10-14T10:34:57.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.445+0000 7f039b59e640 1 -- 172.21.15.8:0/4055426933 shutdown_connections 2023-10-14T10:34:57.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.445+0000 7f039b59e640 1 --2- 172.21.15.8:0/4055426933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f039c0aa030 0x7f039c1513e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.445+0000 7f039b59e640 1 --2- 172.21.15.8:0/4055426933 >> v2:172.21.15.92:3300/0 conn(0x7f039c0c23a0 0x7f039c14df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.445+0000 7f039b59e640 1 -- 172.21.15.8:0/4055426933 >> 172.21.15.8:0/4055426933 conn(0x7f039c06a200 msgr2=0x7f039c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:57.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.445+0000 7f039b59e640 1 -- 172.21.15.8:0/4055426933 shutdown_connections 2023-10-14T10:34:57.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.445+0000 7f039b59e640 1 -- 172.21.15.8:0/4055426933 wait complete. 2023-10-14T10:34:57.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.447+0000 7f039b59e640 1 Processor -- start 2023-10-14T10:34:57.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.447+0000 7f039b59e640 1 -- start start 2023-10-14T10:34:57.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039b59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f039c0aa030 0x7f039c06c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039b59e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f039c0c23a0 0x7f039c141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039b59e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f039c143cb0 0x7f039c142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039b59e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c1428a0 con 0x7f039c143cb0 2023-10-14T10:34:57.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039b59e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c144230 con 0x7f039c0aa030 2023-10-14T10:34:57.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039b59e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c144510 con 0x7f039c0c23a0 2023-10-14T10:34:57.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039ad9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f039c143cb0 0x7f039c142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039ad9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f039c143cb0 0x7f039c142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42040/0 (socket says 172.21.15.8:42040) 2023-10-14T10:34:57.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039ad9d640 1 -- 172.21.15.8:0/771329706 learned_addr learned my addr 172.21.15.8:0/771329706 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:57.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039ad9d640 1 -- 172.21.15.8:0/771329706 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f039c0c23a0 msgr2=0x7f039c141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:57.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f0393fff640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f039c0c23a0 0x7f039c141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039a59c640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f039c0aa030 0x7f039c06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039ad9d640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f039c0c23a0 0x7f039c141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039ad9d640 1 -- 172.21.15.8:0/771329706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f039c0aa030 msgr2=0x7f039c06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:57.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039ad9d640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f039c0aa030 0x7f039c06c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039ad9d640 1 -- 172.21.15.8:0/771329706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394009b30 con 0x7f039c143cb0 2023-10-14T10:34:57.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f0393fff640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f039c0c23a0 0x7f039c141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:57.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.448+0000 7f039a59c640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f039c0aa030 0x7f039c06c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:57.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.449+0000 7f039ad9d640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f039c143cb0 0x7f039c142360 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0394036040 tx=0x7f0394004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:57.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.449+0000 7f0392ffd640 1 -- 172.21.15.8:0/771329706 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039403e450 con 0x7f039c143cb0 2023-10-14T10:34:57.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.449+0000 7f0392ffd640 1 -- 172.21.15.8:0/771329706 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039403e5d0 con 0x7f039c143cb0 2023-10-14T10:34:57.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.449+0000 7f0392ffd640 1 -- 172.21.15.8:0/771329706 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039403e980 con 0x7f039c143cb0 2023-10-14T10:34:57.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.449+0000 7f039b59e640 1 -- 172.21.15.8:0/771329706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039c14eed0 con 0x7f039c143cb0 2023-10-14T10:34:57.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.449+0000 7f039b59e640 1 -- 172.21.15.8:0/771329706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039c070fe0 con 0x7f039c143cb0 2023-10-14T10:34:57.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.452+0000 7f0392ffd640 1 -- 172.21.15.8:0/771329706 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f039403eae0 con 0x7f039c143cb0 2023-10-14T10:34:57.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.453+0000 7f0392ffd640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f037c06ae70 0x7f037c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.453+0000 7f0392ffd640 1 -- 172.21.15.8:0/771329706 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f03940ac610 con 0x7f039c143cb0 2023-10-14T10:34:57.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.454+0000 7f039a59c640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f037c06ae70 0x7f037c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.454+0000 7f03a3772740 1 Processor -- start 2023-10-14T10:34:57.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.454+0000 7f039a59c640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f037c06ae70 0x7f037c06d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f038c00a870 tx=0x7f038c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:57.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.454+0000 7f03a3772740 1 -- start start 2023-10-14T10:34:57.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.455+0000 7f03a3772740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e853e880 0x5569e853f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.455+0000 7f03a3772740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e8504c20 0x5569e853ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.455+0000 7f03a3772740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 0x5569e85039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.455+0000 7f03a3772740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e841e7a0 con 0x5569e8504c20 2023-10-14T10:34:57.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.455+0000 7f03a3772740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e8470740 con 0x5569e853e880 2023-10-14T10:34:57.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.455+0000 7f03a3772740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569e846de30 con 0x5569e85419f0 2023-10-14T10:34:57.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.456+0000 7f0393fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e8504c20 0x5569e853ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.456+0000 7f0393fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e8504c20 0x5569e853ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42044/0 (socket says 172.21.15.8:42044) 2023-10-14T10:34:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.456+0000 7f0393fff640 1 -- 172.21.15.8:0/1305206664 learned_addr learned my addr 172.21.15.8:0/1305206664 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.456+0000 7f0393fff640 1 -- 172.21.15.8:0/1305206664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 msgr2=0x5569e85039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.456+0000 7f0393fff640 1 --2- 172.21.15.8:0/1305206664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 0x5569e85039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.456+0000 7f0393fff640 1 -- 172.21.15.8:0/1305206664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e853e880 msgr2=0x5569e853f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.456+0000 7f0393fff640 1 --2- 172.21.15.8:0/1305206664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e853e880 0x5569e853f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.456+0000 7f0393fff640 1 -- 172.21.15.8:0/1305206664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569e842d910 con 0x5569e8504c20 2023-10-14T10:34:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.456+0000 7f0393fff640 1 --2- 172.21.15.8:0/1305206664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e8504c20 0x5569e853ec60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0384003f20 tx=0x7f03840043e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5842c848afcca13c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.457+0000 7f037bfff640 1 -- 172.21.15.8:0/1305206664 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384005270 con 0x5569e8504c20 2023-10-14T10:34:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.457+0000 7f037bfff640 1 -- 172.21.15.8:0/1305206664 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03840053d0 con 0x5569e8504c20 2023-10-14T10:34:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.457+0000 7f037bfff640 1 -- 172.21.15.8:0/1305206664 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400dc40 con 0x5569e8504c20 2023-10-14T10:34:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.457+0000 7f03a3772740 1 -- 172.21.15.8:0/1305206664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e8504c20 msgr2=0x5569e853ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.457+0000 7f03a3772740 1 --2- 172.21.15.8:0/1305206664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e8504c20 0x5569e853ec60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0384003f20 tx=0x7f03840043e0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.457+0000 7f03a3772740 1 -- 172.21.15.8:0/1305206664 shutdown_connections 2023-10-14T10:34:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.457+0000 7f03a3772740 1 --2- 172.21.15.8:0/1305206664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 0x5569e85039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.457+0000 7f03a3772740 1 --2- 172.21.15.8:0/1305206664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e8504c20 0x5569e853ec60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.457+0000 7f03a3772740 1 --2- 172.21.15.8:0/1305206664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e853e880 0x5569e853f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.457+0000 7f03a3772740 1 -- 172.21.15.8:0/1305206664 >> 172.21.15.8:0/1305206664 conn(0x5569e8500260 msgr2=0x5569e8524c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:57.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.458+0000 7f03a3772740 1 -- 172.21.15.8:0/1305206664 shutdown_connections 2023-10-14T10:34:57.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.458+0000 7f03a3772740 1 -- 172.21.15.8:0/1305206664 wait complete. 2023-10-14T10:34:57.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.458+0000 7f03a3772740 1 -- start start 2023-10-14T10:34:57.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.459+0000 7f03a3772740 1 Processor -- start 2023-10-14T10:34:57.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.459+0000 7f03a3772740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 0x5569e8524030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f03a3772740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 0x5569e8544fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f03a3772740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e8546d10 0x5569e8545630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f03a3772740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e8469720 con 0x5569e853e880 2023-10-14T10:34:57.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f03a3772740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e8407970 con 0x5569e8546d10 2023-10-14T10:34:57.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f03a3772740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569e8407610 con 0x5569e85419f0 2023-10-14T10:34:57.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f03a3772740 10 client.0 _ll_register_callbacks cb 0x5569e84299d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:34:57.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f039a59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 0x5569e8524030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f039a59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 0x5569e8524030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42046/0 (socket says 172.21.15.8:42046) 2023-10-14T10:34:57.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f039a59c640 1 -- 172.21.15.8:0/1214829157 learned_addr learned my addr 172.21.15.8:0/1214829157 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:57.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f0393fff640 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 0x5569e8544fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f039a59c640 1 -- 172.21.15.8:0/1214829157 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 msgr2=0x5569e8544fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:57.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f039a59c640 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 0x5569e8544fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f039a59c640 1 -- 172.21.15.8:0/1214829157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e8546d10 msgr2=0x5569e8545630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:57.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f039a59c640 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e8546d10 0x5569e8545630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f039a59c640 1 -- 172.21.15.8:0/1214829157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0384003b50 con 0x5569e853e880 2023-10-14T10:34:57.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.460+0000 7f0393fff640 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 0x5569e8544fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:34:57.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.461+0000 7f039a59c640 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 0x5569e8524030 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f038c00ce60 tx=0x7f038c0137f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3c4fbc5c3d31a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:57.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.461+0000 7f03797fa640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:34:57.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.461+0000 7f03797fa640 1 -- 172.21.15.8:0/1214829157 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c0117e0 con 0x5569e853e880 2023-10-14T10:34:57.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.461+0000 7f03797fa640 1 -- 172.21.15.8:0/1214829157 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f038c013e20 con 0x5569e853e880 2023-10-14T10:34:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.461+0000 7f03a3772740 1 -- 172.21.15.8:0/1214829157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5569e8490160 con 0x5569e853e880 2023-10-14T10:34:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.461+0000 7f03797fa640 1 -- 172.21.15.8:0/1214829157 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f038c011940 con 0x5569e853e880 2023-10-14T10:34:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.461+0000 7f03a3772740 10 client.5265 fetch_fsmap learned FSMap version 17 2023-10-14T10:34:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.461+0000 7f03a3772740 1 -- 172.21.15.8:0/1214829157 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5569e8467da0 con 0x5569e853e880 2023-10-14T10:34:57.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.461+0000 7f03797fa640 1 -- 172.21.15.8:0/1214829157 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569e8490160 con 0x5569e853e880 2023-10-14T10:34:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.462+0000 7f03797fa640 1 -- 172.21.15.8:0/1214829157 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f038c011aa0 con 0x5569e853e880 2023-10-14T10:34:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.462+0000 7f03a3772740 10 client.5265 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:34:57.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.462+0000 7f03a3772740 10 client.5265 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:34:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.462+0000 7f03a3772740 20 client.5265 populate_metadata read hostname 'smithi008' 2023-10-14T10:34:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.462+0000 7f03a3772740 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5569e85534e0 0x5569e85538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.462+0000 7f03a3772740 4 client.5265 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T10:34:57.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.462+0000 7f03a3772740 1 -- 172.21.15.8:0/1214829157 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5569e843bcc0 con 0x5569e85534e0 2023-10-14T10:34:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.462+0000 7f0393fff640 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5569e85534e0 0x5569e85538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.463+0000 7f0393fff640 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5569e85534e0 0x5569e85538c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf7be86fc1c551fb server_cookie=96beddaf3ea1d9f in_seq=0 out_seq=0 2023-10-14T10:34:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.463+0000 7f03797fa640 10 client.5265 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:34:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.463+0000 7f03797fa640 1 -- 172.21.15.8:0/1214829157 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5569e843bcc0 con 0x5569e85534e0 2023-10-14T10:34:57.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.463+0000 7f03797fa640 10 client.5265 handle_command_reply: tid=0 2023-10-14T10:34:57.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.463+0000 7f03a3772740 1 client.5265 shutdown 2023-10-14T10:34:57.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.464+0000 7f03a3772740 1 -- 172.21.15.8:0/1214829157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 msgr2=0x5569e8524030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:57.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.464+0000 7f03a3772740 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 0x5569e8524030 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f038c00ce60 tx=0x7f038c0137f0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.464+0000 7f03a3772740 1 -- 172.21.15.8:0/1214829157 shutdown_connections 2023-10-14T10:34:57.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.464+0000 7f03a3772740 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5569e85534e0 0x5569e85538c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.464+0000 7f03a3772740 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e8546d10 0x5569e8545630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.464+0000 7f03a3772740 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 0x5569e8544fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.464+0000 7f03a3772740 1 --2- 172.21.15.8:0/1214829157 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 0x5569e8524030 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.464+0000 7f03797fa640 0 client.5265 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:34:57.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.464+0000 7f03a3772740 1 -- 172.21.15.8:0/1214829157 >> 172.21.15.8:0/1214829157 conn(0x5569e8504c20 msgr2=0x5569e853ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.464+0000 7f03a3772740 1 -- 172.21.15.8:0/1214829157 shutdown_connections 2023-10-14T10:34:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.464+0000 7f03a3772740 1 -- 172.21.15.8:0/1214829157 wait complete. 2023-10-14T10:34:57.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.464+0000 7f03a3772740 20 client.5265 trim_cache size 0 max 16384 2023-10-14T10:34:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.481+0000 7f03a3772740 1 Processor -- start 2023-10-14T10:34:57.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.481+0000 7f03a3772740 1 -- start start 2023-10-14T10:34:57.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.482+0000 7f03a3772740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 0x5569e8540170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.482+0000 7f03a3772740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 0x5569e85450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.482+0000 7f03a3772740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e8546d10 0x5569e8545620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.482+0000 7f03a3772740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e81cdf20 con 0x5569e853e880 2023-10-14T10:34:57.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.482+0000 7f03a3772740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e8535fe0 con 0x5569e8546d10 2023-10-14T10:34:57.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.482+0000 7f03a3772740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569e853d000 con 0x5569e85419f0 2023-10-14T10:34:57.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.483+0000 7f039a59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 0x5569e8540170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.483+0000 7f039a59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 0x5569e8540170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42048/0 (socket says 172.21.15.8:42048) 2023-10-14T10:34:57.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.483+0000 7f039a59c640 1 -- 172.21.15.8:0/2261887997 learned_addr learned my addr 172.21.15.8:0/2261887997 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:57.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.483+0000 7f0393fff640 1 --2- 172.21.15.8:0/2261887997 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 0x5569e85450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.483+0000 7f039a59c640 1 -- 172.21.15.8:0/2261887997 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 msgr2=0x5569e85450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:57.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.483+0000 7f039a59c640 1 --2- 172.21.15.8:0/2261887997 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 0x5569e85450e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.483+0000 7f039a59c640 1 -- 172.21.15.8:0/2261887997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e8546d10 msgr2=0x5569e8545620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:57.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.483+0000 7f039a59c640 1 --2- 172.21.15.8:0/2261887997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e8546d10 0x5569e8545620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.483+0000 7f039a59c640 1 -- 172.21.15.8:0/2261887997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569e8406b80 con 0x5569e853e880 2023-10-14T10:34:57.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.483+0000 7f039a59c640 1 --2- 172.21.15.8:0/2261887997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 0x5569e8540170 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f038c00c5a0 tx=0x7f038c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee2d374dfc7d9b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:57.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.484+0000 7f0390ff9640 1 -- 172.21.15.8:0/2261887997 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c011070 con 0x5569e853e880 2023-10-14T10:34:57.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.484+0000 7f0390ff9640 1 -- 172.21.15.8:0/2261887997 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c017040 con 0x5569e853e880 2023-10-14T10:34:57.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.484+0000 7f0390ff9640 1 -- 172.21.15.8:0/2261887997 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c0115e0 con 0x5569e853e880 2023-10-14T10:34:57.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.484+0000 7f03a3772740 1 -- 172.21.15.8:0/2261887997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 msgr2=0x5569e8540170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:57.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.484+0000 7f03a3772740 1 --2- 172.21.15.8:0/2261887997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 0x5569e8540170 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f038c00c5a0 tx=0x7f038c01c000 comp rx=0 tx=0).stop 2023-10-14T10:34:57.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.484+0000 7f03a3772740 1 -- 172.21.15.8:0/2261887997 shutdown_connections 2023-10-14T10:34:57.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.484+0000 7f03a3772740 1 --2- 172.21.15.8:0/2261887997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e8546d10 0x5569e8545620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.484+0000 7f03a3772740 1 --2- 172.21.15.8:0/2261887997 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e85419f0 0x5569e85450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.484+0000 7f03a3772740 1 --2- 172.21.15.8:0/2261887997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e853e880 0x5569e8540170 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.484+0000 7f03a3772740 1 -- 172.21.15.8:0/2261887997 >> 172.21.15.8:0/2261887997 conn(0x5569e8504c20 msgr2=0x5569e8562b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:57.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.484+0000 7f03a3772740 1 -- 172.21.15.8:0/2261887997 shutdown_connections 2023-10-14T10:34:57.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.485+0000 7f03a3772740 1 -- 172.21.15.8:0/2261887997 wait complete. 2023-10-14T10:34:57.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.485+0000 7f03a3772740 1 -- start start 2023-10-14T10:34:57.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.485+0000 7f03a3772740 1 Processor -- start 2023-10-14T10:34:57.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.486+0000 7f03a3772740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e853e880 0x5569e8545270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.486+0000 7f03a3772740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e85419f0 0x5569e8543510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.486+0000 7f03a3772740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e8546d10 0x5569e85906b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.486+0000 7f03a3772740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e854b430 con 0x5569e85419f0 2023-10-14T10:34:57.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.487+0000 7f03a3772740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569e8549420 con 0x5569e853e880 2023-10-14T10:34:57.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.487+0000 7f03a3772740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569e85495c0 con 0x5569e8546d10 2023-10-14T10:34:57.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.487+0000 7f03a3772740 10 client.0 _ll_register_callbacks cb 0x7f038c00adf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:34:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.487+0000 7f0393fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e85419f0 0x5569e8543510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.487+0000 7f0393fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e85419f0 0x5569e8543510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42064/0 (socket says 172.21.15.8:42064) 2023-10-14T10:34:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.487+0000 7f0393fff640 1 -- 172.21.15.8:0/3072200436 learned_addr learned my addr 172.21.15.8:0/3072200436 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:34:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.487+0000 7f0393fff640 1 -- 172.21.15.8:0/3072200436 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e8546d10 msgr2=0x5569e85906b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:57.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.487+0000 7f0393fff640 1 --2- 172.21.15.8:0/3072200436 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e8546d10 0x5569e85906b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.487+0000 7f0393fff640 1 -- 172.21.15.8:0/3072200436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e853e880 msgr2=0x5569e8545270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:34:57.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.487+0000 7f0393fff640 1 --2- 172.21.15.8:0/3072200436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e853e880 0x5569e8545270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.487+0000 7f0393fff640 1 -- 172.21.15.8:0/3072200436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569e8467da0 con 0x5569e85419f0 2023-10-14T10:34:57.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.488+0000 7f0393fff640 1 --2- 172.21.15.8:0/3072200436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e85419f0 0x5569e8543510 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0384007000 tx=0x7f03840036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2965be9187ee3852 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:34:57.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.488+0000 7f03797fa640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:34:57.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.488+0000 7f03797fa640 1 -- 172.21.15.8:0/3072200436 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384023070 con 0x5569e85419f0 2023-10-14T10:34:57.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.488+0000 7f03797fa640 1 -- 172.21.15.8:0/3072200436 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f0384007c30 con 0x5569e85419f0 2023-10-14T10:34:57.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.488+0000 7f03a3772740 1 -- 172.21.15.8:0/3072200436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5569e8538590 con 0x5569e85419f0 2023-10-14T10:34:57.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.488+0000 7f03797fa640 1 -- 172.21.15.8:0/3072200436 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0384025310 con 0x5569e85419f0 2023-10-14T10:34:57.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.488+0000 7f03a3772740 10 client.5271 fetch_fsmap learned FSMap version 17 2023-10-14T10:34:57.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.488+0000 7f03a3772740 1 -- 172.21.15.8:0/3072200436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5569e842c170 con 0x5569e85419f0 2023-10-14T10:34:57.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.488+0000 7f03797fa640 1 -- 172.21.15.8:0/3072200436 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5569e8538590 con 0x5569e85419f0 2023-10-14T10:34:57.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.488+0000 7f03797fa640 1 -- 172.21.15.8:0/3072200436 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f0384019040 con 0x5569e85419f0 2023-10-14T10:34:57.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.488+0000 7f03a3772740 10 client.5271 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:34:57.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.489+0000 7f03a3772740 10 client.5271 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:34:57.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.489+0000 7f03a3772740 20 client.5271 populate_metadata read hostname 'smithi008' 2023-10-14T10:34:57.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.489+0000 7f03a3772740 1 --2- 172.21.15.8:0/3072200436 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5569e85abc30 0x5569e85ac010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:34:57.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.489+0000 7f03a3772740 4 client.5271 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T10:34:57.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.489+0000 7f03a3772740 1 -- 172.21.15.8:0/3072200436 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f03840053d0 con 0x5569e85abc30 2023-10-14T10:34:57.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.489+0000 7f039a59c640 1 --2- 172.21.15.8:0/3072200436 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5569e85abc30 0x5569e85ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:34:57.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.489+0000 7f039a59c640 1 --2- 172.21.15.8:0/3072200436 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5569e85abc30 0x5569e85ac010 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aabd31d22b5893a server_cookie=9f5310760f71d4ba in_seq=0 out_seq=0 2023-10-14T10:34:57.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.489+0000 7f03797fa640 10 client.5271 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:34:57.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03797fa640 1 -- 172.21.15.8:0/3072200436 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x7f03840053d0 con 0x5569e85abc30 2023-10-14T10:34:57.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03797fa640 10 client.5271 handle_command_reply: tid=0 2023-10-14T10:34:57.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03a3772740 1 client.5271 shutdown 2023-10-14T10:34:57.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03a3772740 1 -- 172.21.15.8:0/3072200436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e85419f0 msgr2=0x5569e8543510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:57.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03a3772740 1 --2- 172.21.15.8:0/3072200436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e85419f0 0x5569e8543510 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0384007000 tx=0x7f03840036f0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03a3772740 1 -- 172.21.15.8:0/3072200436 shutdown_connections 2023-10-14T10:34:57.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03a3772740 1 --2- 172.21.15.8:0/3072200436 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5569e85abc30 0x5569e85ac010 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03a3772740 1 --2- 172.21.15.8:0/3072200436 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5569e8546d10 0x5569e85906b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03a3772740 1 --2- 172.21.15.8:0/3072200436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569e85419f0 0x5569e8543510 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03797fa640 0 client.5271 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:34:57.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03a3772740 1 --2- 172.21.15.8:0/3072200436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5569e853e880 0x5569e8545270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03a3772740 1 -- 172.21.15.8:0/3072200436 >> 172.21.15.8:0/3072200436 conn(0x5569e8504c20 msgr2=0x5569e84f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:57.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03a3772740 1 -- 172.21.15.8:0/3072200436 shutdown_connections 2023-10-14T10:34:57.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03a3772740 1 -- 172.21.15.8:0/3072200436 wait complete. 2023-10-14T10:34:57.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.490+0000 7f03a3772740 20 client.5271 trim_cache size 0 max 16384 2023-10-14T10:34:57.507 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:34:57.507 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "452b10b4-f8ad-4e99-85d0-4d157f344356", 2023-10-14T10:34:57.507 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-14T10:34:57.508 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5052, 2023-10-14T10:34:57.508 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-14T10:34:57.508 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-14T10:34:57.508 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "testcephfs1", 2023-10-14T10:34:57.508 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 9.0136946049999995, 2023-10-14T10:34:57.509 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 17, 2023-10-14T10:34:57.509 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 34, 2023-10-14T10:34:57.509 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 34, 2023-10-14T10:34:57.509 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 18.23124254 2023-10-14T10:34:57.509 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:34:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.491+0000 7f039b59e640 1 -- 172.21.15.8:0/771329706 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f037c06ae70 msgr2=0x7f037c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.491+0000 7f039b59e640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f037c06ae70 0x7f037c06d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f038c00a870 tx=0x7f038c008040 comp rx=0 tx=0).stop 2023-10-14T10:34:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.491+0000 7f039b59e640 1 -- 172.21.15.8:0/771329706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f039c143cb0 msgr2=0x7f039c142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:34:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.491+0000 7f039b59e640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f039c143cb0 0x7f039c142360 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0394036040 tx=0x7f0394004a40 comp rx=0 tx=0).stop 2023-10-14T10:34:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.491+0000 7f039b59e640 1 -- 172.21.15.8:0/771329706 shutdown_connections 2023-10-14T10:34:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.491+0000 7f039b59e640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f037c06ae70 0x7f037c06d330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.491+0000 7f039b59e640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f039c143cb0 0x7f039c142360 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.491+0000 7f039b59e640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f039c0c23a0 0x7f039c141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.491+0000 7f039b59e640 1 --2- 172.21.15.8:0/771329706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f039c0aa030 0x7f039c06c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:34:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.491+0000 7f039b59e640 1 -- 172.21.15.8:0/771329706 >> 172.21.15.8:0/771329706 conn(0x7f039c06a200 msgr2=0x7f039c0ba3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:34:57.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.491+0000 7f039b59e640 1 -- 172.21.15.8:0/771329706 shutdown_connections 2023-10-14T10:34:57.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:34:57.491+0000 7f039b59e640 1 -- 172.21.15.8:0/771329706 wait complete. 2023-10-14T10:34:57.513 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T10:34:47.550249+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5052": { "addr": "172.21.15.8:6837/799022047", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6836", "nonce": 799022047, "type": "v2" }, { "addr": "172.21.15.8:6837", "nonce": 799022047, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5052, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T10:34:50.997788+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5052 } } } ], "standbys": [ { "addr": "172.21.15.8:6835/1474692193", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6834", "nonce": 1474692193, "type": "v2" }, { "addr": "172.21.15.8:6835", "nonce": 1474692193, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4532, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6835/2045070429", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6833", "nonce": 2045070429, "type": "v2" }, { "addr": "172.21.15.92:6835", "nonce": 2045070429, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4538, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6834/337485030", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6832", "nonce": 337485030, "type": "v2" }, { "addr": "172.21.15.92:6834", "nonce": 337485030, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4726, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T10:34:57.515 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': 2, 'name': 'a', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T10:34:57.515 INFO:tasks.cephfs.test_failover:current = [{'gid': 4532, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.8:6835/1474692193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6834', 'nonce': 1474692193}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 1474692193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 4726, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6834/337485030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 337485030}, {'type': 'v1', 'addr': '172.21.15.92:6834', 'nonce': 337485030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 4538, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6835/2045070429', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6833', 'nonce': 2045070429}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2045070429}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T10:34:57.516 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T10:34:57.516 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-14T10:35:02.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:35:02.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.749+0000 7f7e8f59e640 1 Processor -- start 2023-10-14T10:35:02.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.750+0000 7f7e8f59e640 1 -- start start 2023-10-14T10:35:02.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.751+0000 7f7e8f59e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7e900c50f0 0x7f7e900c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:02.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.751+0000 7f7e8f59e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e901543b0 con 0x7f7e901514c0 2023-10-14T10:35:02.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.751+0000 7f7e8f59e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e901518a0 con 0x7f7e9006b5d0 2023-10-14T10:35:02.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.751+0000 7f7e8f59e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9006c3c0 con 0x7f7e900c50f0 2023-10-14T10:35:02.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.751+0000 7f7e8e59c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7e901514c0 0x7f7e900c7530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53962/0 (socket says 172.21.15.8:53962) 2023-10-14T10:35:02.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.751+0000 7f7e8e59c640 1 -- 172.21.15.8:0/1270616 learned_addr learned my addr 172.21.15.8:0/1270616 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:02.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.752+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486703214 0 0) 0x7f7e901543b0 con 0x7f7e901514c0 2023-10-14T10:35:02.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.752+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e78003520 con 0x7f7e901514c0 2023-10-14T10:35:02.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.752+0000 7f7e8ed9d640 1 --2- 172.21.15.8:0/1270616 >> v2:172.21.15.92:3300/0 conn(0x7f7e900c50f0 0x7f7e900c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:02.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.752+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 805656316 0 0) 0x7f7e78003520 con 0x7f7e901514c0 2023-10-14T10:35:02.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.752+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 >> v2:172.21.15.92:3300/0 conn(0x7f7e900c50f0 msgr2=0x7f7e900c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:02.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.752+0000 7f7e8d59a640 1 --2- 172.21.15.8:0/1270616 >> v2:172.21.15.92:3300/0 conn(0x7f7e900c50f0 0x7f7e900c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:02.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.752+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 >> v1:172.21.15.92:6789/0 conn(0x7f7e9006b5d0 legacy=0x7f7e90154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:02.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.752+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e900c5890 con 0x7f7e901514c0 2023-10-14T10:35:02.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.752+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f7e80001670 con 0x7f7e901514c0 2023-10-14T10:35:02.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.752+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 >> v1:172.21.15.8:6789/0 conn(0x7f7e901514c0 legacy=0x7f7e900c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:02.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.752+0000 7f7e8d59a640 1 --2- 172.21.15.8:0/1270616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e780039f0 0x7f7e78003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:02.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.752+0000 7f7e8d59a640 1 --2- 172.21.15.8:0/1270616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e780047c0 0x7f7e78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:02.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.753+0000 7f7e8d59a640 1 --2- 172.21.15.8:0/1270616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e780052a0 0x7f7e7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:02.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.753+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7800c1c0 con 0x7f7e780052a0 2023-10-14T10:35:02.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.753+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7800c330 con 0x7f7e780047c0 2023-10-14T10:35:02.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.753+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7800c4f0 con 0x7f7e780039f0 2023-10-14T10:35:02.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.753+0000 7f7e8ed9d640 1 --2- 172.21.15.8:0/1270616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e780052a0 0x7f7e7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:02.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.753+0000 7f7e8e59c640 1 --2- 172.21.15.8:0/1270616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e780039f0 0x7f7e78003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:02.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.753+0000 7f7e8dd9b640 1 --2- 172.21.15.8:0/1270616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e780047c0 0x7f7e78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:02.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.753+0000 7f7e8ed9d640 1 -- 172.21.15.8:0/1270616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e780039f0 msgr2=0x7f7e78003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:02.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.753+0000 7f7e8ed9d640 1 --2- 172.21.15.8:0/1270616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e780039f0 0x7f7e78003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:02.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.753+0000 7f7e8ed9d640 1 -- 172.21.15.8:0/1270616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e780047c0 msgr2=0x7f7e78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:02.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.753+0000 7f7e8ed9d640 1 --2- 172.21.15.8:0/1270616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e780047c0 0x7f7e78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:02.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.753+0000 7f7e8ed9d640 1 -- 172.21.15.8:0/1270616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78003520 con 0x7f7e780052a0 2023-10-14T10:35:02.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.754+0000 7f7e8ed9d640 1 -- 172.21.15.8:0/1270616 reap_dead start 2023-10-14T10:35:02.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.755+0000 7f7e8ed9d640 1 --2- 172.21.15.8:0/1270616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e780052a0 0x7f7e7800b980 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7e88007330 tx=0x7f7e780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205d07eff5f47e39 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:02.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.755+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8802ccd0 con 0x7f7e780052a0 2023-10-14T10:35:02.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.755+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8802ce30 con 0x7f7e780052a0 2023-10-14T10:35:02.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.755+0000 7f7e8d59a640 1 -- 172.21.15.8:0/1270616 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88003bd0 con 0x7f7e780052a0 2023-10-14T10:35:02.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.756+0000 7f7e8f59e640 1 -- 172.21.15.8:0/1270616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e780052a0 msgr2=0x7f7e7800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:02.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.756+0000 7f7e8f59e640 1 --2- 172.21.15.8:0/1270616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e780052a0 0x7f7e7800b980 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7e88007330 tx=0x7f7e780057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:02.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.756+0000 7f7e8f59e640 1 -- 172.21.15.8:0/1270616 shutdown_connections 2023-10-14T10:35:02.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.756+0000 7f7e8f59e640 1 --2- 172.21.15.8:0/1270616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e780052a0 0x7f7e7800b980 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:02.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.756+0000 7f7e8f59e640 1 -- 172.21.15.8:0/1270616 >> 172.21.15.8:0/1270616 conn(0x7f7e900c60b0 msgr2=0x7f7e900c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:02.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.756+0000 7f7e8f59e640 1 -- 172.21.15.8:0/1270616 shutdown_connections 2023-10-14T10:35:02.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.756+0000 7f7e8f59e640 1 -- 172.21.15.8:0/1270616 wait complete. 2023-10-14T10:35:02.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.758+0000 7f7e8f59e640 1 Processor -- start 2023-10-14T10:35:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.758+0000 7f7e8f59e640 1 -- start start 2023-10-14T10:35:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.759+0000 7f7e8f59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e780052a0 0x7f7e901ecc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.759+0000 7f7e8f59e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e900bfa80 0x7f7e901e9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.759+0000 7f7e8f59e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e901e9780 0x7f7e90149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.759+0000 7f7e8f59e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e901ed170 con 0x7f7e900bfa80 2023-10-14T10:35:02.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.759+0000 7f7e8f59e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e901e8db0 con 0x7f7e780052a0 2023-10-14T10:35:02.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.759+0000 7f7e8f59e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e901e9c00 con 0x7f7e901e9780 2023-10-14T10:35:02.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.760+0000 7f7e8dd9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e900bfa80 0x7f7e901e9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:02.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.760+0000 7f7e8dd9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e900bfa80 0x7f7e901e9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42084/0 (socket says 172.21.15.8:42084) 2023-10-14T10:35:02.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.760+0000 7f7e8dd9b640 1 -- 172.21.15.8:0/3127725845 learned_addr learned my addr 172.21.15.8:0/3127725845 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:02.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.760+0000 7f7e8ed9d640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e901e9780 0x7f7e90149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:02.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.760+0000 7f7e8dd9b640 1 -- 172.21.15.8:0/3127725845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e901e9780 msgr2=0x7f7e90149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:02.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.760+0000 7f7e8dd9b640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e901e9780 0x7f7e90149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:02.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.760+0000 7f7e8dd9b640 1 -- 172.21.15.8:0/3127725845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e780052a0 msgr2=0x7f7e901ecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:02.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.760+0000 7f7e8dd9b640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e780052a0 0x7f7e901ecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:02.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.760+0000 7f7e8dd9b640 1 -- 172.21.15.8:0/3127725845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e900c0c40 con 0x7f7e900bfa80 2023-10-14T10:35:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.760+0000 7f7e8ed9d640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e901e9780 0x7f7e90149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.761+0000 7f7e8dd9b640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e900bfa80 0x7f7e901e9240 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400e4d0 tx=0x7f7e8400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.761+0000 7f7e7effd640 1 -- 172.21.15.8:0/3127725845 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840052e0 con 0x7f7e900bfa80 2023-10-14T10:35:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.761+0000 7f7e7effd640 1 -- 172.21.15.8:0/3127725845 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e84005440 con 0x7f7e900bfa80 2023-10-14T10:35:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.761+0000 7f7e7effd640 1 -- 172.21.15.8:0/3127725845 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84003810 con 0x7f7e900bfa80 2023-10-14T10:35:02.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.761+0000 7f7e8f59e640 1 -- 172.21.15.8:0/3127725845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e900c0f20 con 0x7f7e900bfa80 2023-10-14T10:35:02.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.761+0000 7f7e8f59e640 1 -- 172.21.15.8:0/3127725845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e900c14e0 con 0x7f7e900bfa80 2023-10-14T10:35:02.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.762+0000 7f7e8f59e640 1 -- 172.21.15.8:0/3127725845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9004e9b0 con 0x7f7e900bfa80 2023-10-14T10:35:02.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.763+0000 7f7e7effd640 1 -- 172.21.15.8:0/3127725845 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7e84003970 con 0x7f7e900bfa80 2023-10-14T10:35:02.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.764+0000 7f7e7effd640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7e7006ae70 0x7f7e7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:02.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.764+0000 7f7e7effd640 1 -- 172.21.15.8:0/3127725845 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f7e84089490 con 0x7f7e900bfa80 2023-10-14T10:35:02.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.764+0000 7f7e8e59c640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7e7006ae70 0x7f7e7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:02.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.765+0000 7f7e8e59c640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7e7006ae70 0x7f7e7006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7e80001050 tx=0x7f7e80000f60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:02.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:02.769+0000 7f7e7effd640 1 -- 172.21.15.8:0/3127725845 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e840543f0 con 0x7f7e900bfa80 2023-10-14T10:35:03.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.006+0000 7f7e8f59e640 1 -- 172.21.15.8:0/3127725845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e900c4330 con 0x7f7e900bfa80 2023-10-14T10:35:03.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.007+0000 7f7e7effd640 1 -- 172.21.15.8:0/3127725845 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f7e84057a10 con 0x7f7e900bfa80 2023-10-14T10:35:03.009 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:03.010 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:35:03.010 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:35:03.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.010+0000 7f7e8f59e640 1 -- 172.21.15.8:0/3127725845 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7e7006ae70 msgr2=0x7f7e7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.010+0000 7f7e8f59e640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7e7006ae70 0x7f7e7006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7e80001050 tx=0x7f7e80000f60 comp rx=0 tx=0).stop 2023-10-14T10:35:03.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.010+0000 7f7e8f59e640 1 -- 172.21.15.8:0/3127725845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e900bfa80 msgr2=0x7f7e901e9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.010+0000 7f7e8f59e640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e900bfa80 0x7f7e901e9240 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400e4d0 tx=0x7f7e8400e990 comp rx=0 tx=0).stop 2023-10-14T10:35:03.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.010+0000 7f7e8f59e640 1 -- 172.21.15.8:0/3127725845 shutdown_connections 2023-10-14T10:35:03.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.010+0000 7f7e8f59e640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7e7006ae70 0x7f7e7006d330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.010+0000 7f7e8f59e640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e901e9780 0x7f7e90149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.010+0000 7f7e8f59e640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e900bfa80 0x7f7e901e9240 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.010+0000 7f7e8f59e640 1 --2- 172.21.15.8:0/3127725845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e780052a0 0x7f7e901ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.010+0000 7f7e8f59e640 1 -- 172.21.15.8:0/3127725845 >> 172.21.15.8:0/3127725845 conn(0x7f7e900c60b0 msgr2=0x7f7e9006a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:03.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.010+0000 7f7e8f59e640 1 -- 172.21.15.8:0/3127725845 shutdown_connections 2023-10-14T10:35:03.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.011+0000 7f7e8f59e640 1 -- 172.21.15.8:0/3127725845 wait complete. 2023-10-14T10:35:03.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T10:34:47.550249+0000', 'modified': '2023-10-14T10:34:50.997788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5052': {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T10:35:03.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T10:35:03.436 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T10:35:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.669+0000 7f4b1d00d640 1 Processor -- start 2023-10-14T10:35:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.670+0000 7f4b1d00d640 1 -- start start 2023-10-14T10:35:03.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.671+0000 7f4b1d00d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b1806fb10 0x7f4b180c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.671+0000 7f4b1d00d640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b18152ac0 con 0x7f4b180c2670 2023-10-14T10:35:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.671+0000 7f4b1d00d640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b18151eb0 con 0x7f4b1813af90 2023-10-14T10:35:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.671+0000 7f4b1d00d640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b18152190 con 0x7f4b1806fb10 2023-10-14T10:35:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.672+0000 7f4b1c80c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4b180c2670 0x7f4b180bfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53966/0 (socket says 172.21.15.8:53966) 2023-10-14T10:35:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.672+0000 7f4b1c80c640 1 -- 172.21.15.8:0/3603150105 learned_addr learned my addr 172.21.15.8:0/3603150105 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.672+0000 7f4b0ffff640 1 --2- 172.21.15.8:0/3603150105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b1806fb10 0x7f4b180c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.672+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095484574 0 0) 0x7f4b18152ac0 con 0x7f4b180c2670 2023-10-14T10:35:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.672+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b04003520 con 0x7f4b180c2670 2023-10-14T10:35:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.672+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 999875847 0 0) 0x7f4b04003520 con 0x7f4b180c2670 2023-10-14T10:35:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.672+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b1806fb10 msgr2=0x7f4b180c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.672+0000 7f4b177fe640 1 --2- 172.21.15.8:0/3603150105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b1806fb10 0x7f4b180c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.672+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 >> v1:172.21.15.92:6789/0 conn(0x7f4b1813af90 legacy=0x7f4b180a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.672+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b18152470 con 0x7f4b180c2670 2023-10-14T10:35:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.672+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f4b100019f0 con 0x7f4b180c2670 2023-10-14T10:35:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.673+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 >> v1:172.21.15.8:6789/0 conn(0x7f4b180c2670 legacy=0x7f4b180bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.673+0000 7f4b177fe640 1 --2- 172.21.15.8:0/3603150105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b040039a0 0x7f4b04003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.673+0000 7f4b177fe640 1 --2- 172.21.15.8:0/3603150105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b1806fb10 0x7f4b040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.673+0000 7f4b177fe640 1 --2- 172.21.15.8:0/3603150105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b04004d00 0x7f4b04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.673+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b18152190 con 0x7f4b04004d00 2023-10-14T10:35:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.673+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0400bab0 con 0x7f4b040039a0 2023-10-14T10:35:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.673+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0400bc70 con 0x7f4b1806fb10 2023-10-14T10:35:03.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.673+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/3603150105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b04004d00 0x7f4b04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.673+0000 7f4b17fff640 1 --2- 172.21.15.8:0/3603150105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b040039a0 0x7f4b04003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.673+0000 7f4b0ffff640 1 --2- 172.21.15.8:0/3603150105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b1806fb10 0x7f4b040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.674+0000 7f4b1c80c640 1 -- 172.21.15.8:0/3603150105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b1806fb10 msgr2=0x7f4b040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:03.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.674+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/3603150105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b1806fb10 0x7f4b040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.674+0000 7f4b1c80c640 1 -- 172.21.15.8:0/3603150105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b040039a0 msgr2=0x7f4b04003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:03.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.674+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/3603150105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b040039a0 0x7f4b04003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.674+0000 7f4b1c80c640 1 -- 172.21.15.8:0/3603150105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04003520 con 0x7f4b04004d00 2023-10-14T10:35:03.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.675+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/3603150105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b04004d00 0x7f4b04005180 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000a820 tx=0x7f4b040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78002332420ec76f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:03.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.675+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b100072d0 con 0x7f4b04004d00 2023-10-14T10:35:03.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.675+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1002f070 con 0x7f4b04004d00 2023-10-14T10:35:03.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.675+0000 7f4b177fe640 1 -- 172.21.15.8:0/3603150105 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b10007690 con 0x7f4b04004d00 2023-10-14T10:35:03.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.675+0000 7f4b1d00d640 1 -- 172.21.15.8:0/3603150105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b04004d00 msgr2=0x7f4b04005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.675+0000 7f4b1d00d640 1 --2- 172.21.15.8:0/3603150105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b04004d00 0x7f4b04005180 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000a820 tx=0x7f4b040057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.675+0000 7f4b1c80c640 1 -- 172.21.15.8:0/3603150105 reap_dead start 2023-10-14T10:35:03.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.676+0000 7f4b1d00d640 1 -- 172.21.15.8:0/3603150105 shutdown_connections 2023-10-14T10:35:03.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.676+0000 7f4b1d00d640 1 -- 172.21.15.8:0/3603150105 >> 172.21.15.8:0/3603150105 conn(0x7f4b1806a200 msgr2=0x7f4b1806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:03.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.676+0000 7f4b1d00d640 1 -- 172.21.15.8:0/3603150105 shutdown_connections 2023-10-14T10:35:03.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.676+0000 7f4b1d00d640 1 -- 172.21.15.8:0/3603150105 wait complete. 2023-10-14T10:35:03.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.678+0000 7f4b1d00d640 1 Processor -- start 2023-10-14T10:35:03.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.678+0000 7f4b1d00d640 1 -- start start 2023-10-14T10:35:03.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.679+0000 7f4b1d00d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b04004d00 0x7f4b1806c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.679+0000 7f4b1d00d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b181372d0 0x7f4b18151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.679+0000 7f4b1d00d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b181e9180 0x7f4b181e9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.679+0000 7f4b1d00d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1806caf0 con 0x7f4b04004d00 2023-10-14T10:35:03.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.679+0000 7f4b1d00d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181ec710 con 0x7f4b181e9180 2023-10-14T10:35:03.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.679+0000 7f4b1d00d640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181e9b50 con 0x7f4b181372d0 2023-10-14T10:35:03.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.679+0000 7f4b17fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b04004d00 0x7f4b1806c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.679+0000 7f4b17fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b04004d00 0x7f4b1806c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42114/0 (socket says 172.21.15.8:42114) 2023-10-14T10:35:03.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.679+0000 7f4b17fff640 1 -- 172.21.15.8:0/1061677607 learned_addr learned my addr 172.21.15.8:0/1061677607 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:03.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.679+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b181e9180 0x7f4b181e9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.679+0000 7f4b17fff640 1 -- 172.21.15.8:0/1061677607 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b181372d0 msgr2=0x7f4b18151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.679+0000 7f4b17fff640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b181372d0 0x7f4b18151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.680+0000 7f4b17fff640 1 -- 172.21.15.8:0/1061677607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b181e9180 msgr2=0x7f4b181e9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.680+0000 7f4b17fff640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b181e9180 0x7f4b181e9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.680+0000 7f4b17fff640 1 -- 172.21.15.8:0/1061677607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b181ecf70 con 0x7f4b04004d00 2023-10-14T10:35:03.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.680+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b181e9180 0x7f4b181e9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:03.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.680+0000 7f4b17fff640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b04004d00 0x7f4b1806c230 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800e550 tx=0x7f4b0800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:03.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.680+0000 7f4b157fa640 1 -- 172.21.15.8:0/1061677607 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b080052e0 con 0x7f4b04004d00 2023-10-14T10:35:03.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.680+0000 7f4b157fa640 1 -- 172.21.15.8:0/1061677607 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b08005440 con 0x7f4b04004d00 2023-10-14T10:35:03.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.680+0000 7f4b157fa640 1 -- 172.21.15.8:0/1061677607 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08003810 con 0x7f4b04004d00 2023-10-14T10:35:03.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.680+0000 7f4b1d00d640 1 -- 172.21.15.8:0/1061677607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1806c810 con 0x7f4b04004d00 2023-10-14T10:35:03.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.680+0000 7f4b1d00d640 1 -- 172.21.15.8:0/1061677607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b181ecc00 con 0x7f4b04004d00 2023-10-14T10:35:03.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.682+0000 7f4b157fa640 1 -- 172.21.15.8:0/1061677607 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4b08003970 con 0x7f4b04004d00 2023-10-14T10:35:03.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.683+0000 7f4b157fa640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4af806aea0 0x7f4af806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.683+0000 7f4b157fa640 1 -- 172.21.15.8:0/1061677607 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4b08089480 con 0x7f4b04004d00 2023-10-14T10:35:03.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.684+0000 7f4b0ffff640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4af806aea0 0x7f4af806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.684+0000 7f4b20dfe740 1 Processor -- start 2023-10-14T10:35:03.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.684+0000 7f4b20dfe740 1 -- start start 2023-10-14T10:35:03.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.684+0000 7f4b0ffff640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4af806aea0 0x7f4af806d360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b181ea2b0 tx=0x7f4b00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:03.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.685+0000 7f4b20dfe740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55883077b880 0x55883077c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.685+0000 7f4b20dfe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558830741c20 0x55883077bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.685+0000 7f4b20dfe740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 0x5588307409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.685+0000 7f4b20dfe740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883065b7a0 con 0x55883077e9f0 2023-10-14T10:35:03.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.685+0000 7f4b20dfe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588306ad740 con 0x558830741c20 2023-10-14T10:35:03.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.685+0000 7f4b20dfe740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588306aae30 con 0x55883077b880 2023-10-14T10:35:03.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.685+0000 7f4b1c80c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 0x5588307409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.686+0000 7f4b1c80c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 0x5588307409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42120/0 (socket says 172.21.15.8:42120) 2023-10-14T10:35:03.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.686+0000 7f4b1c80c640 1 -- 172.21.15.8:0/3328554947 learned_addr learned my addr 172.21.15.8:0/3328554947 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:03.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.686+0000 7f4b17fff640 1 --2- 172.21.15.8:0/3328554947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55883077b880 0x55883077c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.686+0000 7f4b0ffff640 1 --2- 172.21.15.8:0/3328554947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558830741c20 0x55883077bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.686+0000 7f4b1c80c640 1 -- 172.21.15.8:0/3328554947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55883077b880 msgr2=0x55883077c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:03.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.686+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/3328554947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55883077b880 0x55883077c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.686+0000 7f4b1c80c640 1 -- 172.21.15.8:0/3328554947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558830741c20 msgr2=0x55883077bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:03.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.686+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/3328554947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558830741c20 0x55883077bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.686+0000 7f4b1c80c640 1 -- 172.21.15.8:0/3328554947 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55883066a910 con 0x55883077e9f0 2023-10-14T10:35:03.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.686+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/3328554947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 0x5588307409a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b10001580 tx=0x7f4b1002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979b1834303a43bb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:03.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.687+0000 7f4b0dffb640 1 -- 172.21.15.8:0/3328554947 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b100019b0 con 0x55883077e9f0 2023-10-14T10:35:03.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.687+0000 7f4b0dffb640 1 -- 172.21.15.8:0/3328554947 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b10001250 con 0x55883077e9f0 2023-10-14T10:35:03.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.687+0000 7f4b0dffb640 1 -- 172.21.15.8:0/3328554947 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b10004d60 con 0x55883077e9f0 2023-10-14T10:35:03.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.687+0000 7f4b20dfe740 1 -- 172.21.15.8:0/3328554947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 msgr2=0x5588307409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.687+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/3328554947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 0x5588307409a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b10001580 tx=0x7f4b1002f000 comp rx=0 tx=0).stop 2023-10-14T10:35:03.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.687+0000 7f4b20dfe740 1 -- 172.21.15.8:0/3328554947 shutdown_connections 2023-10-14T10:35:03.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.687+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/3328554947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 0x5588307409a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.687+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/3328554947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558830741c20 0x55883077bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.687+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/3328554947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55883077b880 0x55883077c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.687+0000 7f4b20dfe740 1 -- 172.21.15.8:0/3328554947 >> 172.21.15.8:0/3328554947 conn(0x55883073d260 msgr2=0x558830761c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:03.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.687+0000 7f4b20dfe740 1 -- 172.21.15.8:0/3328554947 shutdown_connections 2023-10-14T10:35:03.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.687+0000 7f4b20dfe740 1 -- 172.21.15.8:0/3328554947 wait complete. 2023-10-14T10:35:03.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.688+0000 7f4b20dfe740 1 -- start start 2023-10-14T10:35:03.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.688+0000 7f4b20dfe740 1 Processor -- start 2023-10-14T10:35:03.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.689+0000 7f4b20dfe740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077b880 0x5588307761e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.689+0000 7f4b20dfe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077e9f0 0x558830761190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.689+0000 7f4b20dfe740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5588307748a0 0x558830779610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.689+0000 7f4b20dfe740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588306a6720 con 0x55883077b880 2023-10-14T10:35:03.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.689+0000 7f4b20dfe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558830644970 con 0x55883077e9f0 2023-10-14T10:35:03.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.689+0000 7f4b20dfe740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x558830644610 con 0x5588307748a0 2023-10-14T10:35:03.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.689+0000 7f4b20dfe740 10 client.0 _ll_register_callbacks cb 0x5588306669d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:35:03.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.690+0000 7f4b17fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077b880 0x5588307761e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.690+0000 7f4b17fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077b880 0x5588307761e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42126/0 (socket says 172.21.15.8:42126) 2023-10-14T10:35:03.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.690+0000 7f4b17fff640 1 -- 172.21.15.8:0/4042787206 learned_addr learned my addr 172.21.15.8:0/4042787206 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:03.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.690+0000 7f4b17fff640 1 -- 172.21.15.8:0/4042787206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5588307748a0 msgr2=0x558830779610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.690+0000 7f4b0ffff640 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077e9f0 0x558830761190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.690+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5588307748a0 0x558830779610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.690+0000 7f4b17fff640 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5588307748a0 0x558830779610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.690+0000 7f4b17fff640 1 -- 172.21.15.8:0/4042787206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077e9f0 msgr2=0x558830761190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.690+0000 7f4b17fff640 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077e9f0 0x558830761190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.690+0000 7f4b17fff640 1 -- 172.21.15.8:0/4042787206 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b04003520 con 0x55883077b880 2023-10-14T10:35:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.690+0000 7f4b17fff640 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077b880 0x5588307761e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800ef10 tx=0x7f4b0800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59025273eb0bb59 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.690+0000 7f4af6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:35:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4af6ffd640 1 -- 172.21.15.8:0/4042787206 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0806f070 con 0x55883077b880 2023-10-14T10:35:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4af6ffd640 1 -- 172.21.15.8:0/4042787206 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4b0805c280 con 0x55883077b880 2023-10-14T10:35:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4042787206 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588306cd160 con 0x55883077b880 2023-10-14T10:35:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4af6ffd640 1 -- 172.21.15.8:0/4042787206 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b08060430 con 0x55883077b880 2023-10-14T10:35:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4b20dfe740 10 client.5289 fetch_fsmap learned FSMap version 17 2023-10-14T10:35:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4042787206 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5588306a4da0 con 0x55883077b880 2023-10-14T10:35:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4af6ffd640 1 -- 172.21.15.8:0/4042787206 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588306cd160 con 0x55883077b880 2023-10-14T10:35:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4af6ffd640 1 -- 172.21.15.8:0/4042787206 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f4b080890b0 con 0x55883077b880 2023-10-14T10:35:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4b20dfe740 10 client.5289 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:35:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4b20dfe740 10 client.5289 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:35:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4b20dfe740 20 client.5289 populate_metadata read hostname 'smithi008' 2023-10-14T10:35:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55883077a170 0x55883075e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4b20dfe740 4 client.5289 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T10:35:03.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.691+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4042787206 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558830678cc0 con 0x55883077a170 2023-10-14T10:35:03.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.692+0000 7f4b0ffff640 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55883077a170 0x55883075e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.692+0000 7f4b0ffff640 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55883077a170 0x55883075e3f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9acfd00117be3d4 server_cookie=1c13dbacc7276576 in_seq=0 out_seq=0 2023-10-14T10:35:03.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.692+0000 7f4af6ffd640 10 client.5289 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:03.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4af6ffd640 1 -- 172.21.15.8:0/4042787206 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558830678cc0 con 0x55883077a170 2023-10-14T10:35:03.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4af6ffd640 10 client.5289 handle_command_reply: tid=0 2023-10-14T10:35:03.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4b20dfe740 1 client.5289 shutdown 2023-10-14T10:35:03.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4042787206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077b880 msgr2=0x5588307761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077b880 0x5588307761e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800ef10 tx=0x7f4b0800cf00 comp rx=0 tx=0).stop 2023-10-14T10:35:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4042787206 shutdown_connections 2023-10-14T10:35:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55883077a170 0x55883075e3f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5588307748a0 0x558830779610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077e9f0 0x558830761190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4af6ffd640 0 client.5289 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:03.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/4042787206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077b880 0x5588307761e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4042787206 >> 172.21.15.8:0/4042787206 conn(0x558830741c20 msgr2=0x55883073a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:03.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4042787206 shutdown_connections 2023-10-14T10:35:03.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.693+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4042787206 wait complete. 2023-10-14T10:35:03.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.694+0000 7f4b20dfe740 20 client.5289 trim_cache size 0 max 16384 2023-10-14T10:35:03.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.710+0000 7f4b20dfe740 1 Processor -- start 2023-10-14T10:35:03.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.710+0000 7f4b20dfe740 1 -- start start 2023-10-14T10:35:03.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.711+0000 7f4b20dfe740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588307748a0 0x558830777ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.711+0000 7f4b20dfe740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55883077b880 0x55883073a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.711+0000 7f4b20dfe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077e9f0 0x55883077c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.711+0000 7f4b20dfe740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883040af20 con 0x5588307748a0 2023-10-14T10:35:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.711+0000 7f4b20dfe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558830761e80 con 0x55883077e9f0 2023-10-14T10:35:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.711+0000 7f4b20dfe740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x558830774ff0 con 0x55883077b880 2023-10-14T10:35:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.711+0000 7f4b17fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588307748a0 0x558830777ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.711+0000 7f4b17fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588307748a0 0x558830777ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42128/0 (socket says 172.21.15.8:42128) 2023-10-14T10:35:03.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.711+0000 7f4b17fff640 1 -- 172.21.15.8:0/4131209597 learned_addr learned my addr 172.21.15.8:0/4131209597 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:03.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.712+0000 7f4b17fff640 1 -- 172.21.15.8:0/4131209597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55883077b880 msgr2=0x55883073a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:03.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.712+0000 7f4b17fff640 1 --2- 172.21.15.8:0/4131209597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55883077b880 0x55883073a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.712+0000 7f4b17fff640 1 -- 172.21.15.8:0/4131209597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077e9f0 msgr2=0x55883077c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:03.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.712+0000 7f4b17fff640 1 --2- 172.21.15.8:0/4131209597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077e9f0 0x55883077c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.712+0000 7f4b17fff640 1 -- 172.21.15.8:0/4131209597 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558830643b80 con 0x5588307748a0 2023-10-14T10:35:03.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.712+0000 7f4b17fff640 1 --2- 172.21.15.8:0/4131209597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588307748a0 0x558830777ba0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4b08001eb0 tx=0x7f4b0805a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7ea3ab7e5f7660 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:03.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.712+0000 7f4b0e7fc640 1 -- 172.21.15.8:0/4131209597 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0806f040 con 0x5588307748a0 2023-10-14T10:35:03.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.712+0000 7f4b0e7fc640 1 -- 172.21.15.8:0/4131209597 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b08057c70 con 0x5588307748a0 2023-10-14T10:35:03.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.712+0000 7f4b0e7fc640 1 -- 172.21.15.8:0/4131209597 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08060430 con 0x5588307748a0 2023-10-14T10:35:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.713+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4131209597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588307748a0 msgr2=0x558830777ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.713+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/4131209597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588307748a0 0x558830777ba0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4b08001eb0 tx=0x7f4b0805a000 comp rx=0 tx=0).stop 2023-10-14T10:35:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.713+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4131209597 shutdown_connections 2023-10-14T10:35:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.713+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/4131209597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077e9f0 0x55883077c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.713+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/4131209597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55883077b880 0x55883073a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.713+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/4131209597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588307748a0 0x558830777ba0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.713+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4131209597 >> 172.21.15.8:0/4131209597 conn(0x558830741c20 msgr2=0x5588307733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.713+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4131209597 shutdown_connections 2023-10-14T10:35:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.713+0000 7f4b20dfe740 1 -- 172.21.15.8:0/4131209597 wait complete. 2023-10-14T10:35:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.714+0000 7f4b20dfe740 1 -- start start 2023-10-14T10:35:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.714+0000 7f4b20dfe740 1 Processor -- start 2023-10-14T10:35:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b20dfe740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5588307748a0 0x55883077c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b20dfe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077b880 0x5588307769d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b20dfe740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 0x5588307e1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b20dfe740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588307e80d0 con 0x55883077e9f0 2023-10-14T10:35:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b20dfe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883077d800 con 0x55883077b880 2023-10-14T10:35:03.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b20dfe740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x558830779750 con 0x5588307748a0 2023-10-14T10:35:03.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b20dfe740 10 client.0 _ll_register_callbacks cb 0x7f4b08001290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:35:03.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b1c80c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 0x5588307e1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b1c80c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 0x5588307e1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42140/0 (socket says 172.21.15.8:42140) 2023-10-14T10:35:03.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b1c80c640 1 -- 172.21.15.8:0/1136307704 learned_addr learned my addr 172.21.15.8:0/1136307704 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:03.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b17fff640 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5588307748a0 0x55883077c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b1c80c640 1 -- 172.21.15.8:0/1136307704 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5588307748a0 msgr2=0x55883077c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:03.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5588307748a0 0x55883077c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b0ffff640 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077b880 0x5588307769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b1c80c640 1 -- 172.21.15.8:0/1136307704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077b880 msgr2=0x5588307769d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.715+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077b880 0x5588307769d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.716+0000 7f4b1c80c640 1 -- 172.21.15.8:0/1136307704 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b04003520 con 0x55883077e9f0 2023-10-14T10:35:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.716+0000 7f4b1c80c640 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 0x5588307e1a50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000a7f0 tx=0x7f4b18152a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64ca76babd81587 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.716+0000 7f4af6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:35:03.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.716+0000 7f4af6ffd640 1 -- 172.21.15.8:0/1136307704 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b10050070 con 0x55883077e9f0 2023-10-14T10:35:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.716+0000 7f4af6ffd640 1 -- 172.21.15.8:0/1136307704 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4b10001730 con 0x55883077e9f0 2023-10-14T10:35:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.716+0000 7f4b20dfe740 1 -- 172.21.15.8:0/1136307704 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b10001250 con 0x55883077e9f0 2023-10-14T10:35:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.716+0000 7f4af6ffd640 1 -- 172.21.15.8:0/1136307704 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b100018f0 con 0x55883077e9f0 2023-10-14T10:35:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.716+0000 7f4b20dfe740 10 client.5295 fetch_fsmap learned FSMap version 17 2023-10-14T10:35:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.716+0000 7f4b20dfe740 1 -- 172.21.15.8:0/1136307704 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558830669170 con 0x55883077e9f0 2023-10-14T10:35:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.717+0000 7f4af6ffd640 1 -- 172.21.15.8:0/1136307704 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b10001250 con 0x55883077e9f0 2023-10-14T10:35:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.717+0000 7f4af6ffd640 1 -- 172.21.15.8:0/1136307704 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f4b10053020 con 0x55883077e9f0 2023-10-14T10:35:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.717+0000 7f4b20dfe740 10 client.5295 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:35:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.717+0000 7f4b20dfe740 10 client.5295 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:35:03.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.717+0000 7f4b20dfe740 20 client.5295 populate_metadata read hostname 'smithi008' 2023-10-14T10:35:03.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.717+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5588307e1f90 0x55883075f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:03.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.717+0000 7f4b20dfe740 4 client.5295 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T10:35:03.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.717+0000 7f4b20dfe740 1 -- 172.21.15.8:0/1136307704 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55883069f700 con 0x5588307e1f90 2023-10-14T10:35:03.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.717+0000 7f4b17fff640 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5588307e1f90 0x55883075f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:03.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b17fff640 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5588307e1f90 0x55883075f750 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e86214515cda68f server_cookie=d2ab771ba386e908 in_seq=0 out_seq=0 2023-10-14T10:35:03.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4af6ffd640 10 client.5295 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:03.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4af6ffd640 1 -- 172.21.15.8:0/1136307704 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x55883069f700 con 0x5588307e1f90 2023-10-14T10:35:03.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4af6ffd640 10 client.5295 handle_command_reply: tid=0 2023-10-14T10:35:03.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b20dfe740 1 client.5295 shutdown 2023-10-14T10:35:03.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b20dfe740 1 -- 172.21.15.8:0/1136307704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 msgr2=0x5588307e1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 0x5588307e1a50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000a7f0 tx=0x7f4b18152a30 comp rx=0 tx=0).stop 2023-10-14T10:35:03.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b20dfe740 1 -- 172.21.15.8:0/1136307704 shutdown_connections 2023-10-14T10:35:03.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5588307e1f90 0x55883075f750 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55883077e9f0 0x5588307e1a50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55883077b880 0x5588307769d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b20dfe740 1 --2- 172.21.15.8:0/1136307704 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5588307748a0 0x55883077c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4af6ffd640 0 client.5295 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:03.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b20dfe740 1 -- 172.21.15.8:0/1136307704 >> 172.21.15.8:0/1136307704 conn(0x558830741c20 msgr2=0x558830790370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:03.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b20dfe740 1 -- 172.21.15.8:0/1136307704 shutdown_connections 2023-10-14T10:35:03.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b20dfe740 1 -- 172.21.15.8:0/1136307704 wait complete. 2023-10-14T10:35:03.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.718+0000 7f4b20dfe740 20 client.5295 trim_cache size 0 max 16384 2023-10-14T10:35:03.735 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:03.735 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "452b10b4-f8ad-4e99-85d0-4d157f344356", 2023-10-14T10:35:03.735 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-14T10:35:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5052, 2023-10-14T10:35:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-14T10:35:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-14T10:35:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "testcephfs1", 2023-10-14T10:35:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 15.241855083000001, 2023-10-14T10:35:03.736 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 17, 2023-10-14T10:35:03.737 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 34, 2023-10-14T10:35:03.737 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 34, 2023-10-14T10:35:03.737 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 24.459403386999998 2023-10-14T10:35:03.737 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:03.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.719+0000 7f4b1d00d640 1 -- 172.21.15.8:0/1061677607 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4af806aea0 msgr2=0x7f4af806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.719+0000 7f4b1d00d640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4af806aea0 0x7f4af806d360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b181ea2b0 tx=0x7f4b00008040 comp rx=0 tx=0).stop 2023-10-14T10:35:03.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.719+0000 7f4b1d00d640 1 -- 172.21.15.8:0/1061677607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b04004d00 msgr2=0x7f4b1806c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:03.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.719+0000 7f4b1d00d640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b04004d00 0x7f4b1806c230 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800e550 tx=0x7f4b0800ea10 comp rx=0 tx=0).stop 2023-10-14T10:35:03.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.719+0000 7f4b1d00d640 1 -- 172.21.15.8:0/1061677607 shutdown_connections 2023-10-14T10:35:03.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.719+0000 7f4b1d00d640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4af806aea0 0x7f4af806d360 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.719+0000 7f4b1d00d640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b181e9180 0x7f4b181e9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.719+0000 7f4b1d00d640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b181372d0 0x7f4b18151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.719+0000 7f4b1d00d640 1 --2- 172.21.15.8:0/1061677607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b04004d00 0x7f4b1806c230 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:03.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.719+0000 7f4b1d00d640 1 -- 172.21.15.8:0/1061677607 >> 172.21.15.8:0/1061677607 conn(0x7f4b1806a200 msgr2=0x7f4b1806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:03.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.719+0000 7f4b1d00d640 1 -- 172.21.15.8:0/1061677607 shutdown_connections 2023-10-14T10:35:03.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:03.719+0000 7f4b1d00d640 1 -- 172.21.15.8:0/1061677607 wait complete. 2023-10-14T10:35:03.741 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T10:34:47.550249+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5052": { "addr": "172.21.15.8:6837/799022047", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6836", "nonce": 799022047, "type": "v2" }, { "addr": "172.21.15.8:6837", "nonce": 799022047, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5052, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T10:34:50.997788+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5052 } } } ], "standbys": [ { "addr": "172.21.15.8:6835/1474692193", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6834", "nonce": 1474692193, "type": "v2" }, { "addr": "172.21.15.8:6835", "nonce": 1474692193, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4532, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6835/2045070429", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6833", "nonce": 2045070429, "type": "v2" }, { "addr": "172.21.15.92:6835", "nonce": 2045070429, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4538, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6834/337485030", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6832", "nonce": 337485030, "type": "v2" }, { "addr": "172.21.15.92:6834", "nonce": 337485030, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4726, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T10:35:03.742 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': 2, 'name': 'a', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T10:35:03.743 INFO:tasks.cephfs.test_failover:current = [{'gid': 4532, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.8:6835/1474692193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6834', 'nonce': 1474692193}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 1474692193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 4726, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6834/337485030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 337485030}, {'type': 'v1', 'addr': '172.21.15.92:6834', 'nonce': 337485030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 4538, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6835/2045070429', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6833', 'nonce': 2045070429}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2045070429}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T10:35:03.743 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T10:35:03.744 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-14T10:35:08.745 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:35:08.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.980+0000 7fd9a96ec640 1 Processor -- start 2023-10-14T10:35:08.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.980+0000 7fd9a96ec640 1 -- start start 2023-10-14T10:35:08.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.981+0000 7fd9a96ec640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd9a41502e0 0x7fd9a41506c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:08.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.982+0000 7fd9a96ec640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a40a9310 con 0x7fd9a40aa470 2023-10-14T10:35:08.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.982+0000 7fd9a96ec640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a406fdd0 con 0x7fd9a40c0600 2023-10-14T10:35:08.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.982+0000 7fd9a96ec640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a40a9660 con 0x7fd9a41502e0 2023-10-14T10:35:08.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.982+0000 7fd9a37fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd9a40aa470 0x7fd9a4070500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45880/0 (socket says 172.21.15.8:45880) 2023-10-14T10:35:08.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.982+0000 7fd9a37fe640 1 -- 172.21.15.8:0/1490618942 learned_addr learned my addr 172.21.15.8:0/1490618942 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:08.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.982+0000 7fd9a3fff640 1 --2- 172.21.15.8:0/1490618942 >> v2:172.21.15.8:3300/0 conn(0x7fd9a41502e0 0x7fd9a41506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:08.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.982+0000 7fd9a2ffd640 1 -- 172.21.15.8:0/1490618942 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225377421 0 0) 0x7fd9a40a9310 con 0x7fd9a40aa470 2023-10-14T10:35:08.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.983+0000 7fd9a2ffd640 1 -- 172.21.15.8:0/1490618942 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd98c005730 con 0x7fd9a40aa470 2023-10-14T10:35:08.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.983+0000 7fd9a3fff640 1 -- 172.21.15.8:0/1490618942 >> v1:172.21.15.92:6789/0 conn(0x7fd9a40c0600 legacy=0x7fd9a415abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:08.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.983+0000 7fd9a3fff640 1 -- 172.21.15.8:0/1490618942 >> v1:172.21.15.8:6789/0 conn(0x7fd9a40aa470 legacy=0x7fd9a4070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:08.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.983+0000 7fd9a3fff640 1 -- 172.21.15.8:0/1490618942 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a406faf0 con 0x7fd9a41502e0 2023-10-14T10:35:08.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.984+0000 7fd9a3fff640 1 --2- 172.21.15.8:0/1490618942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41502e0 0x7fd9a41506c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd9940097a0 tx=0x7fd99402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9f59babcfafe04 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:08.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.984+0000 7fd9a2ffd640 1 -- 172.21.15.8:0/1490618942 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994030610 con 0x7fd9a41502e0 2023-10-14T10:35:08.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.984+0000 7fd9a2ffd640 1 -- 172.21.15.8:0/1490618942 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd994030770 con 0x7fd9a41502e0 2023-10-14T10:35:08.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.984+0000 7fd9a2ffd640 1 -- 172.21.15.8:0/1490618942 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994030b00 con 0x7fd9a41502e0 2023-10-14T10:35:08.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.985+0000 7fd9a96ec640 1 -- 172.21.15.8:0/1490618942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41502e0 msgr2=0x7fd9a41506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:08.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.985+0000 7fd9a96ec640 1 --2- 172.21.15.8:0/1490618942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41502e0 0x7fd9a41506c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd9940097a0 tx=0x7fd99402b960 comp rx=0 tx=0).stop 2023-10-14T10:35:08.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.985+0000 7fd9a96ec640 1 -- 172.21.15.8:0/1490618942 shutdown_connections 2023-10-14T10:35:08.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.985+0000 7fd9a96ec640 1 --2- 172.21.15.8:0/1490618942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41502e0 0x7fd9a41506c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:08.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.985+0000 7fd9a96ec640 1 -- 172.21.15.8:0/1490618942 >> 172.21.15.8:0/1490618942 conn(0x7fd9a406a200 msgr2=0x7fd9a406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:08.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.985+0000 7fd9a96ec640 1 -- 172.21.15.8:0/1490618942 shutdown_connections 2023-10-14T10:35:08.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.985+0000 7fd9a96ec640 1 -- 172.21.15.8:0/1490618942 wait complete. 2023-10-14T10:35:08.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.987+0000 7fd9a96ec640 1 Processor -- start 2023-10-14T10:35:08.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.987+0000 7fd9a96ec640 1 -- start start 2023-10-14T10:35:08.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.988+0000 7fd9a96ec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9a40c0600 0x7fd9a41536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:08.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.988+0000 7fd9a96ec640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9a41502e0 0x7fd9a40bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:08.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.988+0000 7fd9a96ec640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41486f0 0x7fd9a41e8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:08.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.988+0000 7fd9a96ec640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41e69a0 con 0x7fd9a41486f0 2023-10-14T10:35:08.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.988+0000 7fd9a96ec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a406b8c0 con 0x7fd9a40c0600 2023-10-14T10:35:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.988+0000 7fd9a96ec640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a40bf6f0 con 0x7fd9a41502e0 2023-10-14T10:35:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.989+0000 7fd9a8eeb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41486f0 0x7fd9a41e8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.989+0000 7fd9a8eeb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41486f0 0x7fd9a41e8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47188/0 (socket says 172.21.15.8:47188) 2023-10-14T10:35:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.989+0000 7fd9a8eeb640 1 -- 172.21.15.8:0/3946251215 learned_addr learned my addr 172.21.15.8:0/3946251215 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.989+0000 7fd9a3fff640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9a40c0600 0x7fd9a41536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:08.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.989+0000 7fd9a8eeb640 1 -- 172.21.15.8:0/3946251215 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9a41502e0 msgr2=0x7fd9a40bf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:08.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.989+0000 7fd9a37fe640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9a41502e0 0x7fd9a40bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:08.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.990+0000 7fd9a8eeb640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9a41502e0 0x7fd9a40bf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:08.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.990+0000 7fd9a8eeb640 1 -- 172.21.15.8:0/3946251215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9a40c0600 msgr2=0x7fd9a41536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:08.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.990+0000 7fd9a8eeb640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9a40c0600 0x7fd9a41536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:08.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.990+0000 7fd9a8eeb640 1 -- 172.21.15.8:0/3946251215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd994009400 con 0x7fd9a41486f0 2023-10-14T10:35:08.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.990+0000 7fd9a3fff640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9a40c0600 0x7fd9a41536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:35:08.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.990+0000 7fd9a37fe640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9a41502e0 0x7fd9a40bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:08.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.990+0000 7fd9a8eeb640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41486f0 0x7fd9a41e8c70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c700 tx=0x7fd99c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:08.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.990+0000 7fd9a0ff9640 1 -- 172.21.15.8:0/3946251215 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00aa50 con 0x7fd9a41486f0 2023-10-14T10:35:08.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.990+0000 7fd9a0ff9640 1 -- 172.21.15.8:0/3946251215 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c00abb0 con 0x7fd9a41486f0 2023-10-14T10:35:08.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.990+0000 7fd9a96ec640 1 -- 172.21.15.8:0/3946251215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a406bb10 con 0x7fd9a41486f0 2023-10-14T10:35:08.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.990+0000 7fd9a0ff9640 1 -- 172.21.15.8:0/3946251215 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00ce10 con 0x7fd9a41486f0 2023-10-14T10:35:08.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.990+0000 7fd9a96ec640 1 -- 172.21.15.8:0/3946251215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a4152ec0 con 0x7fd9a41486f0 2023-10-14T10:35:08.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.992+0000 7fd9a96ec640 1 -- 172.21.15.8:0/3946251215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a404e9b0 con 0x7fd9a41486f0 2023-10-14T10:35:08.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.993+0000 7fd9a0ff9640 1 -- 172.21.15.8:0/3946251215 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd99c012420 con 0x7fd9a41486f0 2023-10-14T10:35:08.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.994+0000 7fd9a0ff9640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd99006aea0 0x7fd99006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:08.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.994+0000 7fd9a0ff9640 1 -- 172.21.15.8:0/3946251215 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd99c089850 con 0x7fd9a41486f0 2023-10-14T10:35:08.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.994+0000 7fd9a3fff640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd99006aea0 0x7fd99006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.995+0000 7fd9a3fff640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd99006aea0 0x7fd99006d360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd994036000 tx=0x7fd99403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:09.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:08.998+0000 7fd9a0ff9640 1 -- 172.21.15.8:0/3946251215 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd99c054840 con 0x7fd9a41486f0 2023-10-14T10:35:09.215 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:35:09.224 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:35:09.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.230+0000 7fd9a96ec640 1 -- 172.21.15.8:0/3946251215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9a40a9b80 con 0x7fd9a41486f0 2023-10-14T10:35:09.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.230+0000 7fd9a0ff9640 1 -- 172.21.15.8:0/3946251215 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7fd99c016090 con 0x7fd9a41486f0 2023-10-14T10:35:09.233 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:09.234 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:35:09.234 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:35:09.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.233+0000 7fd9a96ec640 1 -- 172.21.15.8:0/3946251215 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd99006aea0 msgr2=0x7fd99006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:09.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.233+0000 7fd9a96ec640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd99006aea0 0x7fd99006d360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd994036000 tx=0x7fd99403b040 comp rx=0 tx=0).stop 2023-10-14T10:35:09.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.233+0000 7fd9a96ec640 1 -- 172.21.15.8:0/3946251215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41486f0 msgr2=0x7fd9a41e8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:09.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.233+0000 7fd9a96ec640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41486f0 0x7fd9a41e8c70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c700 tx=0x7fd99c00cbc0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.233+0000 7fd9a96ec640 1 -- 172.21.15.8:0/3946251215 shutdown_connections 2023-10-14T10:35:09.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.233+0000 7fd9a96ec640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd99006aea0 0x7fd99006d360 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.233+0000 7fd9a96ec640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9a41486f0 0x7fd9a41e8c70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.233+0000 7fd9a96ec640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9a41502e0 0x7fd9a40bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.233+0000 7fd9a96ec640 1 --2- 172.21.15.8:0/3946251215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9a40c0600 0x7fd9a41536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.233+0000 7fd9a96ec640 1 -- 172.21.15.8:0/3946251215 >> 172.21.15.8:0/3946251215 conn(0x7fd9a406a200 msgr2=0x7fd9a406ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:09.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.233+0000 7fd9a96ec640 1 -- 172.21.15.8:0/3946251215 shutdown_connections 2023-10-14T10:35:09.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.233+0000 7fd9a96ec640 1 -- 172.21.15.8:0/3946251215 wait complete. 2023-10-14T10:35:09.656 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T10:34:47.550249+0000', 'modified': '2023-10-14T10:34:50.997788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5052': {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T10:35:09.657 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T10:35:09.657 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T10:35:09.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.890+0000 7f6598904640 1 Processor -- start 2023-10-14T10:35:09.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.891+0000 7f6598904640 1 -- start start 2023-10-14T10:35:09.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.892+0000 7f6598904640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f659413af90 0x7f65940a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.892+0000 7f6598904640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f659406fb10 0x7f65940c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.892+0000 7f6598904640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f65940c2670 0x7f65940bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.892+0000 7f6598904640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6594152ac0 con 0x7f659406fb10 2023-10-14T10:35:09.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.892+0000 7f6598904640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6594151eb0 con 0x7f65940c2670 2023-10-14T10:35:09.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.892+0000 7f6598904640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6594152190 con 0x7f659413af90 2023-10-14T10:35:09.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.893+0000 7f658bfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f659406fb10 0x7f65940c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.893+0000 7f658bfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f659406fb10 0x7f65940c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47204/0 (socket says 172.21.15.8:47204) 2023-10-14T10:35:09.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.893+0000 7f658bfff640 1 -- 172.21.15.8:0/3889444763 learned_addr learned my addr 172.21.15.8:0/3889444763 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:09.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.893+0000 7f6592d9d640 1 --2- 172.21.15.8:0/3889444763 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f659413af90 0x7f65940a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.893+0000 7f659359e640 1 --2- 172.21.15.8:0/3889444763 >> v2:172.21.15.92:3300/0 conn(0x7f65940c2670 0x7f65940bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.893+0000 7f658bfff640 1 -- 172.21.15.8:0/3889444763 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f659413af90 msgr2=0x7f65940a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:09.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.893+0000 7f658bfff640 1 --2- 172.21.15.8:0/3889444763 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f659413af90 0x7f65940a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.893+0000 7f658bfff640 1 -- 172.21.15.8:0/3889444763 >> v2:172.21.15.92:3300/0 conn(0x7f65940c2670 msgr2=0x7f65940bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:09.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.893+0000 7f658bfff640 1 --2- 172.21.15.8:0/3889444763 >> v2:172.21.15.92:3300/0 conn(0x7f65940c2670 0x7f65940bfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.893+0000 7f658bfff640 1 -- 172.21.15.8:0/3889444763 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594152470 con 0x7f659406fb10 2023-10-14T10:35:09.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.893+0000 7f659359e640 1 --2- 172.21.15.8:0/3889444763 >> v2:172.21.15.92:3300/0 conn(0x7f65940c2670 0x7f65940bfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:35:09.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.894+0000 7f658bfff640 1 --2- 172.21.15.8:0/3889444763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659406fb10 0x7f65940c2130 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6594151da0 tx=0x7f657c02b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3d684c34200fc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:09.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.895+0000 7f659259c640 1 -- 172.21.15.8:0/3889444763 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c0317f0 con 0x7f659406fb10 2023-10-14T10:35:09.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.895+0000 7f659259c640 1 -- 172.21.15.8:0/3889444763 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c031950 con 0x7f659406fb10 2023-10-14T10:35:09.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.895+0000 7f659259c640 1 -- 172.21.15.8:0/3889444763 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c031ce0 con 0x7f659406fb10 2023-10-14T10:35:09.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.895+0000 7f6598904640 1 -- 172.21.15.8:0/3889444763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659406fb10 msgr2=0x7f65940c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:09.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.895+0000 7f6598904640 1 --2- 172.21.15.8:0/3889444763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659406fb10 0x7f65940c2130 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6594151da0 tx=0x7f657c02b890 comp rx=0 tx=0).stop 2023-10-14T10:35:09.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.896+0000 7f6598904640 1 -- 172.21.15.8:0/3889444763 shutdown_connections 2023-10-14T10:35:09.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.896+0000 7f6598904640 1 --2- 172.21.15.8:0/3889444763 >> v2:172.21.15.92:3300/0 conn(0x7f65940c2670 0x7f65940bfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.896+0000 7f6598904640 1 --2- 172.21.15.8:0/3889444763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659406fb10 0x7f65940c2130 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.896+0000 7f6598904640 1 --2- 172.21.15.8:0/3889444763 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f659413af90 0x7f65940a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.896+0000 7f6598904640 1 -- 172.21.15.8:0/3889444763 >> 172.21.15.8:0/3889444763 conn(0x7f659406a200 msgr2=0x7f659406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:09.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.896+0000 7f6598904640 1 -- 172.21.15.8:0/3889444763 shutdown_connections 2023-10-14T10:35:09.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.896+0000 7f6598904640 1 -- 172.21.15.8:0/3889444763 wait complete. 2023-10-14T10:35:09.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.897+0000 7f6598904640 1 Processor -- start 2023-10-14T10:35:09.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.898+0000 7f6598904640 1 -- start start 2023-10-14T10:35:09.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f6598904640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f659406fb10 0x7f6594155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f6598904640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65940c2670 0x7f65941ec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f6598904640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659413af90 0x7f6594154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f6598904640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65941ecee0 con 0x7f659413af90 2023-10-14T10:35:09.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f6598904640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65941ed1c0 con 0x7f659406fb10 2023-10-14T10:35:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f6598904640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6594154310 con 0x7f65940c2670 2023-10-14T10:35:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f659359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659413af90 0x7f6594154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f659359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659413af90 0x7f6594154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47214/0 (socket says 172.21.15.8:47214) 2023-10-14T10:35:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f659359e640 1 -- 172.21.15.8:0/2184339624 learned_addr learned my addr 172.21.15.8:0/2184339624 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:09.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f6592d9d640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f659406fb10 0x7f6594155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f658bfff640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65940c2670 0x7f65941ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f659359e640 1 -- 172.21.15.8:0/2184339624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65940c2670 msgr2=0x7f65941ec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f659359e640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65940c2670 0x7f65941ec6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f659359e640 1 -- 172.21.15.8:0/2184339624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f659406fb10 msgr2=0x7f6594155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:09.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.899+0000 7f659359e640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f659406fb10 0x7f6594155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.900+0000 7f659359e640 1 -- 172.21.15.8:0/2184339624 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c0094d0 con 0x7f659413af90 2023-10-14T10:35:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.900+0000 7f6592d9d640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f659406fb10 0x7f6594155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:35:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.900+0000 7f659359e640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659413af90 0x7f6594154b10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f658c007db0 tx=0x7f658c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.900+0000 7f658b7fe640 1 -- 172.21.15.8:0/2184339624 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c003990 con 0x7f659413af90 2023-10-14T10:35:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.900+0000 7f6598904640 1 -- 172.21.15.8:0/2184339624 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65941545f0 con 0x7f659413af90 2023-10-14T10:35:09.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.900+0000 7f658b7fe640 1 -- 172.21.15.8:0/2184339624 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c00f040 con 0x7f659413af90 2023-10-14T10:35:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.900+0000 7f658b7fe640 1 -- 172.21.15.8:0/2184339624 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c003d50 con 0x7f659413af90 2023-10-14T10:35:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.900+0000 7f6598904640 1 -- 172.21.15.8:0/2184339624 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65940c4b10 con 0x7f659413af90 2023-10-14T10:35:09.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.902+0000 7f658b7fe640 1 -- 172.21.15.8:0/2184339624 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f658c004030 con 0x7f659413af90 2023-10-14T10:35:09.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.903+0000 7f658b7fe640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f657406ae70 0x7f657406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.903+0000 7f658b7fe640 1 -- 172.21.15.8:0/2184339624 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f658c0899c0 con 0x7f659413af90 2023-10-14T10:35:09.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.904+0000 7f6592d9d640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f657406ae70 0x7f657406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.904+0000 7f659bd73740 1 Processor -- start 2023-10-14T10:35:09.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.904+0000 7f6592d9d640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f657406ae70 0x7f657406d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6584009b90 tx=0x7f6584008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:09.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.904+0000 7f659bd73740 1 -- start start 2023-10-14T10:35:09.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.905+0000 7f659bd73740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 0x557e3e9699f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.905+0000 7f659bd73740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e92ec20 0x557e3e968c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.905+0000 7f659bd73740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e96b9f0 0x557e3e92d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.905+0000 7f659bd73740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e3e8487a0 con 0x557e3e968880 2023-10-14T10:35:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.905+0000 7f659bd73740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e3e89a740 con 0x557e3e92ec20 2023-10-14T10:35:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.905+0000 7f659bd73740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e3e897e30 con 0x557e3e96b9f0 2023-10-14T10:35:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.906+0000 7f6592d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 0x557e3e9699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.906+0000 7f6592d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 0x557e3e9699f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47218/0 (socket says 172.21.15.8:47218) 2023-10-14T10:35:09.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.906+0000 7f6592d9d640 1 -- 172.21.15.8:0/3088431467 learned_addr learned my addr 172.21.15.8:0/3088431467 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.906+0000 7f659359e640 1 --2- 172.21.15.8:0/3088431467 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e96b9f0 0x557e3e92d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.906+0000 7f658bfff640 1 --2- 172.21.15.8:0/3088431467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e92ec20 0x557e3e968c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.906+0000 7f6592d9d640 1 -- 172.21.15.8:0/3088431467 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e96b9f0 msgr2=0x557e3e92d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.906+0000 7f6592d9d640 1 --2- 172.21.15.8:0/3088431467 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e96b9f0 0x557e3e92d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.906+0000 7f6592d9d640 1 -- 172.21.15.8:0/3088431467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e92ec20 msgr2=0x557e3e968c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:09.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.906+0000 7f6592d9d640 1 --2- 172.21.15.8:0/3088431467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e92ec20 0x557e3e968c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.906+0000 7f6592d9d640 1 -- 172.21.15.8:0/3088431467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e3e857910 con 0x557e3e968880 2023-10-14T10:35:09.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.906+0000 7f6592d9d640 1 --2- 172.21.15.8:0/3088431467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 0x557e3e9699f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6584011e60 tx=0x7f6584014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e24f6e5010e4d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:09.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.907+0000 7f6588ff9640 1 -- 172.21.15.8:0/3088431467 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584015e50 con 0x557e3e968880 2023-10-14T10:35:09.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.907+0000 7f6588ff9640 1 -- 172.21.15.8:0/3088431467 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6584021440 con 0x557e3e968880 2023-10-14T10:35:09.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.907+0000 7f6588ff9640 1 -- 172.21.15.8:0/3088431467 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840217b0 con 0x557e3e968880 2023-10-14T10:35:09.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.907+0000 7f659bd73740 1 -- 172.21.15.8:0/3088431467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 msgr2=0x557e3e9699f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:09.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.907+0000 7f659bd73740 1 --2- 172.21.15.8:0/3088431467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 0x557e3e9699f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6584011e60 tx=0x7f6584014000 comp rx=0 tx=0).stop 2023-10-14T10:35:09.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.908+0000 7f659bd73740 1 -- 172.21.15.8:0/3088431467 shutdown_connections 2023-10-14T10:35:09.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.908+0000 7f659bd73740 1 --2- 172.21.15.8:0/3088431467 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e96b9f0 0x557e3e92d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.908+0000 7f659bd73740 1 --2- 172.21.15.8:0/3088431467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e92ec20 0x557e3e968c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.908+0000 7f659bd73740 1 --2- 172.21.15.8:0/3088431467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 0x557e3e9699f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.908+0000 7f659bd73740 1 -- 172.21.15.8:0/3088431467 >> 172.21.15.8:0/3088431467 conn(0x557e3e92a260 msgr2=0x557e3e94ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.908+0000 7f659bd73740 1 -- 172.21.15.8:0/3088431467 shutdown_connections 2023-10-14T10:35:09.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.908+0000 7f659bd73740 1 -- 172.21.15.8:0/3088431467 wait complete. 2023-10-14T10:35:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.908+0000 7f659bd73740 1 -- start start 2023-10-14T10:35:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.909+0000 7f659bd73740 1 Processor -- start 2023-10-14T10:35:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.909+0000 7f659bd73740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e968880 0x557e3e962780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.909+0000 7f659bd73740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e96b9f0 0x557e3e9615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.909+0000 7f659bd73740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 0x557e3e94b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.909+0000 7f659bd73740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e3e893720 con 0x557e3e970810 2023-10-14T10:35:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.909+0000 7f659bd73740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e3e831970 con 0x557e3e96b9f0 2023-10-14T10:35:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.909+0000 7f659bd73740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e3e831610 con 0x557e3e968880 2023-10-14T10:35:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.910+0000 7f659bd73740 10 client.0 _ll_register_callbacks cb 0x557e3e8539d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:35:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.910+0000 7f659359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 0x557e3e94b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.910+0000 7f659359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 0x557e3e94b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47234/0 (socket says 172.21.15.8:47234) 2023-10-14T10:35:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.910+0000 7f659359e640 1 -- 172.21.15.8:0/3457725650 learned_addr learned my addr 172.21.15.8:0/3457725650 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.910+0000 7f6592d9d640 1 --2- 172.21.15.8:0/3457725650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e968880 0x557e3e962780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.910+0000 7f659359e640 1 -- 172.21.15.8:0/3457725650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e968880 msgr2=0x557e3e962780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.910+0000 7f659359e640 1 --2- 172.21.15.8:0/3457725650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e968880 0x557e3e962780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.910+0000 7f659359e640 1 -- 172.21.15.8:0/3457725650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e96b9f0 msgr2=0x557e3e9615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:09.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.910+0000 7f659359e640 1 --2- 172.21.15.8:0/3457725650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e96b9f0 0x557e3e9615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.910+0000 7f659359e640 1 -- 172.21.15.8:0/3457725650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6584011b40 con 0x557e3e970810 2023-10-14T10:35:09.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f659359e640 1 --2- 172.21.15.8:0/3457725650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 0x557e3e94b700 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f658c00d9a0 tx=0x7f658c058e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24df864f0a946e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:09.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f6571ffb640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:35:09.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f6571ffb640 1 -- 172.21.15.8:0/3457725650 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c058a50 con 0x557e3e970810 2023-10-14T10:35:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f659bd73740 1 -- 172.21.15.8:0/3457725650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e3e8ba160 con 0x557e3e970810 2023-10-14T10:35:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f6571ffb640 1 -- 172.21.15.8:0/3457725650 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f658c057ae0 con 0x557e3e970810 2023-10-14T10:35:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f6571ffb640 1 -- 172.21.15.8:0/3457725650 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f658c057cf0 con 0x557e3e970810 2023-10-14T10:35:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f659bd73740 10 client.5316 fetch_fsmap learned FSMap version 17 2023-10-14T10:35:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f659bd73740 1 -- 172.21.15.8:0/3457725650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557e3e891da0 con 0x557e3e970810 2023-10-14T10:35:09.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f6571ffb640 1 -- 172.21.15.8:0/3457725650 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c085030 con 0x557e3e970810 2023-10-14T10:35:09.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f6571ffb640 1 -- 172.21.15.8:0/3457725650 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f658c012070 con 0x557e3e970810 2023-10-14T10:35:09.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f659bd73740 10 client.5316 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:35:09.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f659bd73740 10 client.5316 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:35:09.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.911+0000 7f659bd73740 20 client.5316 populate_metadata read hostname 'smithi008' 2023-10-14T10:35:09.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.912+0000 7f659bd73740 1 --2- 172.21.15.8:0/3457725650 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x557e3e979890 0x557e3e979c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.912+0000 7f659bd73740 4 client.5316 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T10:35:09.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.912+0000 7f659bd73740 1 -- 172.21.15.8:0/3457725650 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e3e865cc0 con 0x557e3e979890 2023-10-14T10:35:09.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.912+0000 7f6592d9d640 1 --2- 172.21.15.8:0/3457725650 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x557e3e979890 0x557e3e979c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.912+0000 7f6592d9d640 1 --2- 172.21.15.8:0/3457725650 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x557e3e979890 0x557e3e979c70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3f39bedcd38f4a3 server_cookie=becc378027719d8c in_seq=0 out_seq=0 2023-10-14T10:35:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.912+0000 7f6571ffb640 10 client.5316 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.913+0000 7f6571ffb640 1 -- 172.21.15.8:0/3457725650 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557e3e865cc0 con 0x557e3e979890 2023-10-14T10:35:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.913+0000 7f6571ffb640 10 client.5316 handle_command_reply: tid=0 2023-10-14T10:35:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.913+0000 7f659bd73740 1 client.5316 shutdown 2023-10-14T10:35:09.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.913+0000 7f659bd73740 1 -- 172.21.15.8:0/3457725650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 msgr2=0x557e3e94b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.913+0000 7f659bd73740 1 --2- 172.21.15.8:0/3457725650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 0x557e3e94b700 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f658c00d9a0 tx=0x7f658c058e30 comp rx=0 tx=0).stop 2023-10-14T10:35:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.913+0000 7f659bd73740 1 -- 172.21.15.8:0/3457725650 shutdown_connections 2023-10-14T10:35:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.913+0000 7f659bd73740 1 --2- 172.21.15.8:0/3457725650 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x557e3e979890 0x557e3e979c70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.913+0000 7f659bd73740 1 --2- 172.21.15.8:0/3457725650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 0x557e3e94b700 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.913+0000 7f659bd73740 1 --2- 172.21.15.8:0/3457725650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e96b9f0 0x557e3e9615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.913+0000 7f659bd73740 1 --2- 172.21.15.8:0/3457725650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e968880 0x557e3e962780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.913+0000 7f659bd73740 1 -- 172.21.15.8:0/3457725650 >> 172.21.15.8:0/3457725650 conn(0x557e3e92ec20 msgr2=0x557e3e969f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.913+0000 7f6571ffb640 0 client.5316 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.914+0000 7f659bd73740 1 -- 172.21.15.8:0/3457725650 shutdown_connections 2023-10-14T10:35:09.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.914+0000 7f659bd73740 1 -- 172.21.15.8:0/3457725650 wait complete. 2023-10-14T10:35:09.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.914+0000 7f659bd73740 20 client.5316 trim_cache size 0 max 16384 2023-10-14T10:35:09.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.931+0000 7f659bd73740 1 Processor -- start 2023-10-14T10:35:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.931+0000 7f659bd73740 1 -- start start 2023-10-14T10:35:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.931+0000 7f659bd73740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 0x557e3e969f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.931+0000 7f659bd73740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e96b9f0 0x557e3e96fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.931+0000 7f659bd73740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e970810 0x557e3e970100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.931+0000 7f659bd73740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e3e5f7f20 con 0x557e3e968880 2023-10-14T10:35:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.931+0000 7f659bd73740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e3e966b20 con 0x557e3e970810 2023-10-14T10:35:09.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.931+0000 7f659bd73740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e3e966420 con 0x557e3e96b9f0 2023-10-14T10:35:09.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.932+0000 7f6592d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 0x557e3e969f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.932+0000 7f6592d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 0x557e3e969f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47244/0 (socket says 172.21.15.8:47244) 2023-10-14T10:35:09.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.932+0000 7f6592d9d640 1 -- 172.21.15.8:0/3309365591 learned_addr learned my addr 172.21.15.8:0/3309365591 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:09.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.932+0000 7f658bfff640 1 --2- 172.21.15.8:0/3309365591 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e96b9f0 0x557e3e96fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.932+0000 7f6592d9d640 1 -- 172.21.15.8:0/3309365591 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e96b9f0 msgr2=0x557e3e96fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:09.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.932+0000 7f659359e640 1 --2- 172.21.15.8:0/3309365591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e970810 0x557e3e970100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.932+0000 7f6592d9d640 1 --2- 172.21.15.8:0/3309365591 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e96b9f0 0x557e3e96fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.932+0000 7f6592d9d640 1 -- 172.21.15.8:0/3309365591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e970810 msgr2=0x557e3e970100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:09.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.932+0000 7f6592d9d640 1 --2- 172.21.15.8:0/3309365591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e970810 0x557e3e970100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.932+0000 7f6592d9d640 1 -- 172.21.15.8:0/3309365591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e3e830b80 con 0x557e3e968880 2023-10-14T10:35:09.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.933+0000 7f6592d9d640 1 --2- 172.21.15.8:0/3309365591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 0x557e3e969f80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6584023040 tx=0x7f6584017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b51ee6ed2c8e98 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:09.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.933+0000 7f65897fa640 1 -- 172.21.15.8:0/3309365591 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584034330 con 0x557e3e968880 2023-10-14T10:35:09.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.933+0000 7f65897fa640 1 -- 172.21.15.8:0/3309365591 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6584034490 con 0x557e3e968880 2023-10-14T10:35:09.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.933+0000 7f65897fa640 1 -- 172.21.15.8:0/3309365591 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584034a10 con 0x557e3e968880 2023-10-14T10:35:09.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.933+0000 7f659bd73740 1 -- 172.21.15.8:0/3309365591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 msgr2=0x557e3e969f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:09.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.933+0000 7f659bd73740 1 --2- 172.21.15.8:0/3309365591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 0x557e3e969f80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6584023040 tx=0x7f6584017000 comp rx=0 tx=0).stop 2023-10-14T10:35:09.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.934+0000 7f659bd73740 1 -- 172.21.15.8:0/3309365591 shutdown_connections 2023-10-14T10:35:09.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.934+0000 7f659bd73740 1 --2- 172.21.15.8:0/3309365591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e970810 0x557e3e970100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.934+0000 7f659bd73740 1 --2- 172.21.15.8:0/3309365591 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e96b9f0 0x557e3e96fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.934+0000 7f659bd73740 1 --2- 172.21.15.8:0/3309365591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e968880 0x557e3e969f80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.934+0000 7f659bd73740 1 -- 172.21.15.8:0/3309365591 >> 172.21.15.8:0/3309365591 conn(0x557e3e92ec20 msgr2=0x557e3e923810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:09.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.934+0000 7f659bd73740 1 -- 172.21.15.8:0/3309365591 shutdown_connections 2023-10-14T10:35:09.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.934+0000 7f659bd73740 1 -- 172.21.15.8:0/3309365591 wait complete. 2023-10-14T10:35:09.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.934+0000 7f659bd73740 1 -- start start 2023-10-14T10:35:09.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.934+0000 7f659bd73740 1 Processor -- start 2023-10-14T10:35:09.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.935+0000 7f659bd73740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e968880 0x557e3e961630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.935+0000 7f659bd73740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e96b9f0 0x557e3e965420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.935+0000 7f659bd73740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 0x557e3e9cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.935+0000 7f659bd73740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e3e982030 con 0x557e3e970810 2023-10-14T10:35:09.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.935+0000 7f659bd73740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e3e965ff0 con 0x557e3e96b9f0 2023-10-14T10:35:09.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.935+0000 7f659bd73740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e3e96e0b0 con 0x557e3e968880 2023-10-14T10:35:09.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.935+0000 7f659bd73740 10 client.0 _ll_register_callbacks cb 0x7f658c007d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:35:09.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.936+0000 7f659359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 0x557e3e9cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.936+0000 7f659359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 0x557e3e9cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47248/0 (socket says 172.21.15.8:47248) 2023-10-14T10:35:09.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.936+0000 7f659359e640 1 -- 172.21.15.8:0/2871299483 learned_addr learned my addr 172.21.15.8:0/2871299483 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:09.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.936+0000 7f6592d9d640 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e968880 0x557e3e961630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.936+0000 7f658bfff640 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e96b9f0 0x557e3e965420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.936+0000 7f659359e640 1 -- 172.21.15.8:0/2871299483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e968880 msgr2=0x557e3e961630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:09.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.936+0000 7f659359e640 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e968880 0x557e3e961630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.936+0000 7f659359e640 1 -- 172.21.15.8:0/2871299483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e96b9f0 msgr2=0x557e3e965420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:09.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.936+0000 7f659359e640 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e96b9f0 0x557e3e965420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.936+0000 7f659359e640 1 -- 172.21.15.8:0/2871299483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e3e857910 con 0x557e3e970810 2023-10-14T10:35:09.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.936+0000 7f6592d9d640 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e968880 0x557e3e961630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:35:09.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.936+0000 7f658bfff640 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e96b9f0 0x557e3e965420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:09.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.937+0000 7f659359e640 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 0x557e3e9cb8d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f658c0603c0 tx=0x7f658c087d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49daad7a3ffce59e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:09.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.937+0000 7f6571ffb640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:35:09.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.937+0000 7f6571ffb640 1 -- 172.21.15.8:0/2871299483 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c057ce0 con 0x557e3e970810 2023-10-14T10:35:09.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.937+0000 7f6571ffb640 1 -- 172.21.15.8:0/2871299483 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f658c075b50 con 0x557e3e970810 2023-10-14T10:35:09.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.937+0000 7f659bd73740 1 -- 172.21.15.8:0/2871299483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6584021440 con 0x557e3e970810 2023-10-14T10:35:09.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.937+0000 7f6571ffb640 1 -- 172.21.15.8:0/2871299483 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f658c060710 con 0x557e3e970810 2023-10-14T10:35:09.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.937+0000 7f659bd73740 10 client.5322 fetch_fsmap learned FSMap version 17 2023-10-14T10:35:09.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.937+0000 7f659bd73740 1 -- 172.21.15.8:0/2871299483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557e3e856170 con 0x557e3e970810 2023-10-14T10:35:09.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.937+0000 7f6571ffb640 1 -- 172.21.15.8:0/2871299483 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6584021440 con 0x557e3e970810 2023-10-14T10:35:09.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.937+0000 7f6571ffb640 1 -- 172.21.15.8:0/2871299483 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f658c012040 con 0x557e3e970810 2023-10-14T10:35:09.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.937+0000 7f659bd73740 10 client.5322 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:35:09.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.937+0000 7f659bd73740 10 client.5322 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:35:09.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.938+0000 7f659bd73740 20 client.5322 populate_metadata read hostname 'smithi008' 2023-10-14T10:35:09.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.938+0000 7f659bd73740 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x557e3e9cbe10 0x557e3e96cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:09.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.938+0000 7f659bd73740 4 client.5322 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T10:35:09.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.938+0000 7f659bd73740 1 -- 172.21.15.8:0/2871299483 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557e3e88c700 con 0x557e3e9cbe10 2023-10-14T10:35:09.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.938+0000 7f6592d9d640 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x557e3e9cbe10 0x557e3e96cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:09.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.938+0000 7f6592d9d640 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x557e3e9cbe10 0x557e3e96cec0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b96d2552751ff9 server_cookie=e04a888b796e5161 in_seq=0 out_seq=0 2023-10-14T10:35:09.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.938+0000 7f6571ffb640 10 client.5322 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:09.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f6571ffb640 1 -- 172.21.15.8:0/2871299483 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x557e3e88c700 con 0x557e3e9cbe10 2023-10-14T10:35:09.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f6571ffb640 10 client.5322 handle_command_reply: tid=0 2023-10-14T10:35:09.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f659bd73740 1 client.5322 shutdown 2023-10-14T10:35:09.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f659bd73740 1 -- 172.21.15.8:0/2871299483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 msgr2=0x557e3e9cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:09.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f659bd73740 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 0x557e3e9cb8d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f658c0603c0 tx=0x7f658c087d00 comp rx=0 tx=0).stop 2023-10-14T10:35:09.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f659bd73740 1 -- 172.21.15.8:0/2871299483 shutdown_connections 2023-10-14T10:35:09.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f659bd73740 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x557e3e9cbe10 0x557e3e96cec0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f659bd73740 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e3e970810 0x557e3e9cb8d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f659bd73740 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3e96b9f0 0x557e3e965420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f659bd73740 1 --2- 172.21.15.8:0/2871299483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x557e3e968880 0x557e3e961630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f6571ffb640 0 client.5322 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:09.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f659bd73740 1 -- 172.21.15.8:0/2871299483 >> 172.21.15.8:0/2871299483 conn(0x557e3e92ec20 msgr2=0x557e3e923810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:09.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f659bd73740 1 -- 172.21.15.8:0/2871299483 shutdown_connections 2023-10-14T10:35:09.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f659bd73740 1 -- 172.21.15.8:0/2871299483 wait complete. 2023-10-14T10:35:09.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.939+0000 7f659bd73740 20 client.5322 trim_cache size 0 max 16384 2023-10-14T10:35:09.955 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:09.955 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "452b10b4-f8ad-4e99-85d0-4d157f344356", 2023-10-14T10:35:09.955 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-14T10:35:09.956 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5052, 2023-10-14T10:35:09.956 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-14T10:35:09.956 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-14T10:35:09.956 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "testcephfs1", 2023-10-14T10:35:09.956 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 21.462695964000002, 2023-10-14T10:35:09.957 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 17, 2023-10-14T10:35:09.957 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 34, 2023-10-14T10:35:09.957 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 34, 2023-10-14T10:35:09.957 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 30.680244913999999 2023-10-14T10:35:09.957 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.940+0000 7f6598904640 1 -- 172.21.15.8:0/2184339624 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f657406ae70 msgr2=0x7f657406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.940+0000 7f6598904640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f657406ae70 0x7f657406d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6584009b90 tx=0x7f6584008040 comp rx=0 tx=0).stop 2023-10-14T10:35:09.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.940+0000 7f6598904640 1 -- 172.21.15.8:0/2184339624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659413af90 msgr2=0x7f6594154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:09.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.940+0000 7f6598904640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659413af90 0x7f6594154b10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f658c007db0 tx=0x7f658c00d4a0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.940+0000 7f6598904640 1 -- 172.21.15.8:0/2184339624 shutdown_connections 2023-10-14T10:35:09.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.940+0000 7f6598904640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f657406ae70 0x7f657406d330 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.940+0000 7f6598904640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f659413af90 0x7f6594154b10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.940+0000 7f6598904640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65940c2670 0x7f65941ec6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.940+0000 7f6598904640 1 --2- 172.21.15.8:0/2184339624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f659406fb10 0x7f6594155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:09.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.940+0000 7f6598904640 1 -- 172.21.15.8:0/2184339624 >> 172.21.15.8:0/2184339624 conn(0x7f659406a200 msgr2=0x7f659406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:09.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.940+0000 7f6598904640 1 -- 172.21.15.8:0/2184339624 shutdown_connections 2023-10-14T10:35:09.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:09.940+0000 7f6598904640 1 -- 172.21.15.8:0/2184339624 wait complete. 2023-10-14T10:35:09.961 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T10:34:47.550249+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5052": { "addr": "172.21.15.8:6837/799022047", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6836", "nonce": 799022047, "type": "v2" }, { "addr": "172.21.15.8:6837", "nonce": 799022047, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5052, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T10:34:50.997788+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5052 } } } ], "standbys": [ { "addr": "172.21.15.8:6835/1474692193", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6834", "nonce": 1474692193, "type": "v2" }, { "addr": "172.21.15.8:6835", "nonce": 1474692193, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4532, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6835/2045070429", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6833", "nonce": 2045070429, "type": "v2" }, { "addr": "172.21.15.92:6835", "nonce": 2045070429, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4538, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6834/337485030", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6832", "nonce": 337485030, "type": "v2" }, { "addr": "172.21.15.92:6834", "nonce": 337485030, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4726, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T10:35:09.963 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': 2, 'name': 'a', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T10:35:09.963 INFO:tasks.cephfs.test_failover:current = [{'gid': 4532, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.8:6835/1474692193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6834', 'nonce': 1474692193}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 1474692193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 4726, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6834/337485030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 337485030}, {'type': 'v1', 'addr': '172.21.15.92:6834', 'nonce': 337485030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 4538, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6835/2045070429', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6833', 'nonce': 2045070429}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2045070429}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T10:35:09.963 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T10:35:09.964 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-14T10:35:14.965 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:35:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.199+0000 7f7a510c3640 1 Processor -- start 2023-10-14T10:35:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.199+0000 7f7a510c3640 1 -- start start 2023-10-14T10:35:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.201+0000 7f7a510c3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a4c152670 0x7f7a4c0c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.201+0000 7f7a510c3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7a4c06b6e0 0x7f7a4c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.201+0000 7f7a510c3640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c151bf0 con 0x7f7a4c0c2650 2023-10-14T10:35:15.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.201+0000 7f7a510c3640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c0bffd0 con 0x7f7a4c152670 2023-10-14T10:35:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.201+0000 7f7a510c3640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c0c02b0 con 0x7f7a4c06b6e0 2023-10-14T10:35:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.201+0000 7f7a4bfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a4c152670 0x7f7a4c0c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.202+0000 7f7a4bfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a4c152670 0x7f7a4c0c2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47258/0 (socket says 172.21.15.8:47258) 2023-10-14T10:35:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.202+0000 7f7a4bfff640 1 -- 172.21.15.8:0/217392307 learned_addr learned my addr 172.21.15.8:0/217392307 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.202+0000 7f7a508c2640 1 --2- 172.21.15.8:0/217392307 >> v2:172.21.15.92:3300/0 conn(0x7f7a4c06b6e0 0x7f7a4c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.202+0000 7f7a4bfff640 1 -- 172.21.15.8:0/217392307 >> v2:172.21.15.92:3300/0 conn(0x7f7a4c06b6e0 msgr2=0x7f7a4c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.202+0000 7f7a4bfff640 1 --2- 172.21.15.8:0/217392307 >> v2:172.21.15.92:3300/0 conn(0x7f7a4c06b6e0 0x7f7a4c155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.202+0000 7f7a4bfff640 1 -- 172.21.15.8:0/217392307 >> v1:172.21.15.92:6789/0 conn(0x7f7a4c0c2650 legacy=0x7f7a4c1555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.202+0000 7f7a4bfff640 1 -- 172.21.15.8:0/217392307 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0c0590 con 0x7f7a4c152670 2023-10-14T10:35:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.202+0000 7f7a508c2640 1 --2- 172.21.15.8:0/217392307 >> v2:172.21.15.92:3300/0 conn(0x7f7a4c06b6e0 0x7f7a4c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.203+0000 7f7a4bfff640 1 --2- 172.21.15.8:0/217392307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4c152670 0x7f7a4c0c2110 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0c2af0 tx=0x7f7a3c02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3e4ebe564e9e37 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.204+0000 7f7a4b7fe640 1 -- 172.21.15.8:0/217392307 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c031800 con 0x7f7a4c152670 2023-10-14T10:35:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.204+0000 7f7a4b7fe640 1 -- 172.21.15.8:0/217392307 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c031960 con 0x7f7a4c152670 2023-10-14T10:35:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.204+0000 7f7a4b7fe640 1 -- 172.21.15.8:0/217392307 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c031cf0 con 0x7f7a4c152670 2023-10-14T10:35:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.204+0000 7f7a510c3640 1 -- 172.21.15.8:0/217392307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4c152670 msgr2=0x7f7a4c0c2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.204+0000 7f7a510c3640 1 --2- 172.21.15.8:0/217392307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4c152670 0x7f7a4c0c2110 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0c2af0 tx=0x7f7a3c02b8a0 comp rx=0 tx=0).stop 2023-10-14T10:35:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.204+0000 7f7a510c3640 1 -- 172.21.15.8:0/217392307 shutdown_connections 2023-10-14T10:35:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.204+0000 7f7a510c3640 1 --2- 172.21.15.8:0/217392307 >> v2:172.21.15.92:3300/0 conn(0x7f7a4c06b6e0 0x7f7a4c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.204+0000 7f7a510c3640 1 --2- 172.21.15.8:0/217392307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4c152670 0x7f7a4c0c2110 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.205+0000 7f7a510c3640 1 -- 172.21.15.8:0/217392307 >> 172.21.15.8:0/217392307 conn(0x7f7a4c06a200 msgr2=0x7f7a4c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.205+0000 7f7a510c3640 1 -- 172.21.15.8:0/217392307 shutdown_connections 2023-10-14T10:35:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.205+0000 7f7a510c3640 1 -- 172.21.15.8:0/217392307 wait complete. 2023-10-14T10:35:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.206+0000 7f7a510c3640 1 Processor -- start 2023-10-14T10:35:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.207+0000 7f7a510c3640 1 -- start start 2023-10-14T10:35:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.207+0000 7f7a510c3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a4c06b6e0 0x7f7a4c14cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:15.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.207+0000 7f7a510c3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c0c2650 0x7f7a4c154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:15.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.207+0000 7f7a510c3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4c152670 0x7f7a4c0c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:15.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.207+0000 7f7a510c3640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c14c6b0 con 0x7f7a4c152670 2023-10-14T10:35:15.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a510c3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c154b50 con 0x7f7a4c0c2650 2023-10-14T10:35:15.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a510c3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c151890 con 0x7f7a4c06b6e0 2023-10-14T10:35:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a508c2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4c152670 0x7f7a4c0c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a508c2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4c152670 0x7f7a4c0c4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47262/0 (socket says 172.21.15.8:47262) 2023-10-14T10:35:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a508c2640 1 -- 172.21.15.8:0/1374012970 learned_addr learned my addr 172.21.15.8:0/1374012970 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a4bfff640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a4c06b6e0 0x7f7a4c14cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a508c2640 1 -- 172.21.15.8:0/1374012970 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a4c06b6e0 msgr2=0x7f7a4c14cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a508c2640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a4c06b6e0 0x7f7a4c14cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a437fe640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c0c2650 0x7f7a4c154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a508c2640 1 -- 172.21.15.8:0/1374012970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c0c2650 msgr2=0x7f7a4c154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a508c2640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c0c2650 0x7f7a4c154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a508c2640 1 -- 172.21.15.8:0/1374012970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c0094d0 con 0x7f7a4c152670 2023-10-14T10:35:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.208+0000 7f7a437fe640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c0c2650 0x7f7a4c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.209+0000 7f7a508c2640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4c152670 0x7f7a4c0c4100 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400cf20 tx=0x7f7a4400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.209+0000 7f7a497fa640 1 -- 172.21.15.8:0/1374012970 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4400d840 con 0x7f7a4c152670 2023-10-14T10:35:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.209+0000 7f7a497fa640 1 -- 172.21.15.8:0/1374012970 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4400d9a0 con 0x7f7a4c152670 2023-10-14T10:35:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.209+0000 7f7a510c3640 1 -- 172.21.15.8:0/1374012970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c14b230 con 0x7f7a4c152670 2023-10-14T10:35:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.209+0000 7f7a497fa640 1 -- 172.21.15.8:0/1374012970 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4400dd50 con 0x7f7a4c152670 2023-10-14T10:35:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.209+0000 7f7a510c3640 1 -- 172.21.15.8:0/1374012970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c0c4eb0 con 0x7f7a4c152670 2023-10-14T10:35:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.210+0000 7f7a510c3640 1 -- 172.21.15.8:0/1374012970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c14c820 con 0x7f7a4c152670 2023-10-14T10:35:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.212+0000 7f7a497fa640 1 -- 172.21.15.8:0/1374012970 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7a4401e3b0 con 0x7f7a4c152670 2023-10-14T10:35:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.213+0000 7f7a497fa640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7a2c06ae70 0x7f7a2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.213+0000 7f7a497fa640 1 -- 172.21.15.8:0/1374012970 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f7a4408a230 con 0x7f7a4c152670 2023-10-14T10:35:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.214+0000 7f7a4bfff640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7a2c06ae70 0x7f7a2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.214+0000 7f7a4bfff640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7a2c06ae70 0x7f7a2c06d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c036000 tx=0x7f7a3c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:15.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.218+0000 7f7a497fa640 1 -- 172.21.15.8:0/1374012970 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a4c14c820 con 0x7f7a4c152670 2023-10-14T10:35:15.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.447+0000 7f7a510c3640 1 -- 172.21.15.8:0/1374012970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a4c14c7f0 con 0x7f7a4c152670 2023-10-14T10:35:15.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.448+0000 7f7a497fa640 1 -- 172.21.15.8:0/1374012970 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f7a4401a090 con 0x7f7a4c152670 2023-10-14T10:35:15.451 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:15.451 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:35:15.451 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:35:15.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.451+0000 7f7a510c3640 1 -- 172.21.15.8:0/1374012970 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7a2c06ae70 msgr2=0x7f7a2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:15.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.451+0000 7f7a510c3640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7a2c06ae70 0x7f7a2c06d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c036000 tx=0x7f7a3c03c040 comp rx=0 tx=0).stop 2023-10-14T10:35:15.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.451+0000 7f7a510c3640 1 -- 172.21.15.8:0/1374012970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4c152670 msgr2=0x7f7a4c0c4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:15.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.451+0000 7f7a510c3640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4c152670 0x7f7a4c0c4100 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400cf20 tx=0x7f7a4400a7d0 comp rx=0 tx=0).stop 2023-10-14T10:35:15.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.451+0000 7f7a510c3640 1 -- 172.21.15.8:0/1374012970 shutdown_connections 2023-10-14T10:35:15.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.451+0000 7f7a510c3640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7a2c06ae70 0x7f7a2c06d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:15.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.451+0000 7f7a510c3640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4c152670 0x7f7a4c0c4100 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:15.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.451+0000 7f7a510c3640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4c0c2650 0x7f7a4c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:15.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.451+0000 7f7a510c3640 1 --2- 172.21.15.8:0/1374012970 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a4c06b6e0 0x7f7a4c14cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:15.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.451+0000 7f7a510c3640 1 -- 172.21.15.8:0/1374012970 >> 172.21.15.8:0/1374012970 conn(0x7f7a4c06a200 msgr2=0x7f7a4c0be560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:15.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.451+0000 7f7a510c3640 1 -- 172.21.15.8:0/1374012970 shutdown_connections 2023-10-14T10:35:15.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:15.451+0000 7f7a510c3640 1 -- 172.21.15.8:0/1374012970 wait complete. 2023-10-14T10:35:15.875 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T10:34:47.550249+0000', 'modified': '2023-10-14T10:34:50.997788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5052': {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T10:35:15.876 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T10:35:15.876 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T10:35:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.110+0000 7fd280ac2640 1 Processor -- start 2023-10-14T10:35:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.110+0000 7fd280ac2640 1 -- start start 2023-10-14T10:35:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.112+0000 7fd280ac2640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd27c0a8a30 0x7fd27c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.112+0000 7fd280ac2640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd27c150ea0 0x7fd27c1512f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.112+0000 7fd280ac2640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27c1552e0 con 0x7fd27c14e4b0 2023-10-14T10:35:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.112+0000 7fd280ac2640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c0c0b70 con 0x7fd27c0a8a30 2023-10-14T10:35:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.112+0000 7fd280ac2640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c0c1670 con 0x7fd27c150ea0 2023-10-14T10:35:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.112+0000 7fd27a59c640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd27c14e4b0 0x7fd27c0c57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:45882/0 (socket says 172.21.15.8:45882) 2023-10-14T10:35:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.112+0000 7fd279d9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd27c0a8a30 0x7fd27c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.112+0000 7fd27a59c640 1 -- 172.21.15.8:0/2020622314 learned_addr learned my addr 172.21.15.8:0/2020622314 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.113+0000 7fd27ad9d640 1 --2- 172.21.15.8:0/2020622314 >> v2:172.21.15.92:3300/0 conn(0x7fd27c150ea0 0x7fd27c1512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.113+0000 7fd279d9b640 1 -- 172.21.15.8:0/2020622314 >> v2:172.21.15.92:3300/0 conn(0x7fd27c150ea0 msgr2=0x7fd27c1512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.113+0000 7fd279d9b640 1 --2- 172.21.15.8:0/2020622314 >> v2:172.21.15.92:3300/0 conn(0x7fd27c150ea0 0x7fd27c1512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.113+0000 7fd279d9b640 1 -- 172.21.15.8:0/2020622314 >> v1:172.21.15.8:6789/0 conn(0x7fd27c14e4b0 legacy=0x7fd27c0c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:16.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.113+0000 7fd279d9b640 1 -- 172.21.15.8:0/2020622314 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c0c0540 con 0x7fd27c0a8a30 2023-10-14T10:35:16.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.114+0000 7fd279d9b640 1 --2- 172.21.15.8:0/2020622314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd27c0a8a30 0x7fd27c154da0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd27c06fd50 tx=0x7fd27002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae378fb34a9b2448 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:16.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.114+0000 7fd27959a640 1 -- 172.21.15.8:0/2020622314 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27002e070 con 0x7fd27c0a8a30 2023-10-14T10:35:16.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.114+0000 7fd27959a640 1 -- 172.21.15.8:0/2020622314 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2700315a0 con 0x7fd27c0a8a30 2023-10-14T10:35:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.114+0000 7fd27959a640 1 -- 172.21.15.8:0/2020622314 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270031930 con 0x7fd27c0a8a30 2023-10-14T10:35:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.115+0000 7fd280ac2640 1 -- 172.21.15.8:0/2020622314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd27c0a8a30 msgr2=0x7fd27c154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.115+0000 7fd280ac2640 1 --2- 172.21.15.8:0/2020622314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd27c0a8a30 0x7fd27c154da0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd27c06fd50 tx=0x7fd27002b840 comp rx=0 tx=0).stop 2023-10-14T10:35:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.115+0000 7fd280ac2640 1 -- 172.21.15.8:0/2020622314 shutdown_connections 2023-10-14T10:35:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.115+0000 7fd280ac2640 1 --2- 172.21.15.8:0/2020622314 >> v2:172.21.15.92:3300/0 conn(0x7fd27c150ea0 0x7fd27c1512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.115+0000 7fd280ac2640 1 --2- 172.21.15.8:0/2020622314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd27c0a8a30 0x7fd27c154da0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.115+0000 7fd280ac2640 1 -- 172.21.15.8:0/2020622314 >> 172.21.15.8:0/2020622314 conn(0x7fd27c0a74d0 msgr2=0x7fd27c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:16.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.115+0000 7fd280ac2640 1 -- 172.21.15.8:0/2020622314 shutdown_connections 2023-10-14T10:35:16.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.115+0000 7fd280ac2640 1 -- 172.21.15.8:0/2020622314 wait complete. 2023-10-14T10:35:16.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.117+0000 7fd280ac2640 1 Processor -- start 2023-10-14T10:35:16.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.117+0000 7fd280ac2640 1 -- start start 2023-10-14T10:35:16.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.118+0000 7fd280ac2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd27c0a8a30 0x7fd27c0c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.118+0000 7fd280ac2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd27c14e4b0 0x7fd27c0bf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.118+0000 7fd280ac2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd27c150ea0 0x7fd27c14edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.118+0000 7fd280ac2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c1e6aa0 con 0x7fd27c14e4b0 2023-10-14T10:35:16.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.118+0000 7fd280ac2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c1e6d60 con 0x7fd27c150ea0 2023-10-14T10:35:16.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.118+0000 7fd280ac2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c1e7040 con 0x7fd27c0a8a30 2023-10-14T10:35:16.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.118+0000 7fd279d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd27c14e4b0 0x7fd27c0bf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.118+0000 7fd279d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd27c14e4b0 0x7fd27c0bf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47276/0 (socket says 172.21.15.8:47276) 2023-10-14T10:35:16.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.118+0000 7fd279d9b640 1 -- 172.21.15.8:0/2872533481 learned_addr learned my addr 172.21.15.8:0/2872533481 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:16.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd27ad9d640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd27c150ea0 0x7fd27c14edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd27a59c640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd27c0a8a30 0x7fd27c0c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd279d9b640 1 -- 172.21.15.8:0/2872533481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd27c0a8a30 msgr2=0x7fd27c0c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:16.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd279d9b640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd27c0a8a30 0x7fd27c0c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd279d9b640 1 -- 172.21.15.8:0/2872533481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd27c150ea0 msgr2=0x7fd27c14edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:16.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd279d9b640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd27c150ea0 0x7fd27c14edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd279d9b640 1 -- 172.21.15.8:0/2872533481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd270009400 con 0x7fd27c14e4b0 2023-10-14T10:35:16.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd27ad9d640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd27c150ea0 0x7fd27c14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:16.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd27a59c640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd27c0a8a30 0x7fd27c0c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:16.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd279d9b640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd27c14e4b0 0x7fd27c0bf4b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd270009890 tx=0x7fd2700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:16.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd26affd640 1 -- 172.21.15.8:0/2872533481 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270032840 con 0x7fd27c14e4b0 2023-10-14T10:35:16.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd26affd640 1 -- 172.21.15.8:0/2872533481 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2700329a0 con 0x7fd27c14e4b0 2023-10-14T10:35:16.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd26affd640 1 -- 172.21.15.8:0/2872533481 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270032d50 con 0x7fd27c14e4b0 2023-10-14T10:35:16.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.119+0000 7fd280ac2640 1 -- 172.21.15.8:0/2872533481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c1e7320 con 0x7fd27c14e4b0 2023-10-14T10:35:16.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.120+0000 7fd280ac2640 1 -- 172.21.15.8:0/2872533481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c0c4b60 con 0x7fd27c14e4b0 2023-10-14T10:35:16.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.122+0000 7fd26affd640 1 -- 172.21.15.8:0/2872533481 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd27003b3f0 con 0x7fd27c14e4b0 2023-10-14T10:35:16.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.123+0000 7fd26affd640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd25c06ae70 0x7fd25c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.123+0000 7fd26affd640 1 -- 172.21.15.8:0/2872533481 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd2700ab5f0 con 0x7fd27c14e4b0 2023-10-14T10:35:16.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.123+0000 7fd27a59c640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd25c06ae70 0x7fd25c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.123+0000 7fd28364b740 1 Processor -- start 2023-10-14T10:35:16.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.124+0000 7fd28364b740 1 -- start start 2023-10-14T10:35:16.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.124+0000 7fd27a59c640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd25c06ae70 0x7fd25c06d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd26c007fd0 tx=0x7fd26c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd28364b740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57bc300 0x55e2f57fc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd28364b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f57c1a30 0x55e2f57fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd28364b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57bae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd28364b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2f56db7a0 con 0x55e2f57c0b70 2023-10-14T10:35:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd28364b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2f572d740 con 0x55e2f57c1a30 2023-10-14T10:35:16.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd28364b740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2f572ae30 con 0x55e2f57bc300 2023-10-14T10:35:16.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd27ad9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd27ad9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57bae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47278/0 (socket says 172.21.15.8:47278) 2023-10-14T10:35:16.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd27ad9d640 1 -- 172.21.15.8:0/2855928921 learned_addr learned my addr 172.21.15.8:0/2855928921 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:16.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd27ad9d640 1 -- 172.21.15.8:0/2855928921 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57bc300 msgr2=0x55e2f57fc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:16.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd279d9b640 1 --2- 172.21.15.8:0/2855928921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f57c1a30 0x55e2f57fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd27a59c640 1 --2- 172.21.15.8:0/2855928921 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57bc300 0x55e2f57fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd27ad9d640 1 --2- 172.21.15.8:0/2855928921 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57bc300 0x55e2f57fc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd27ad9d640 1 -- 172.21.15.8:0/2855928921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f57c1a30 msgr2=0x55e2f57fcbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:16.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd27ad9d640 1 --2- 172.21.15.8:0/2855928921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f57c1a30 0x55e2f57fcbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.125+0000 7fd27ad9d640 1 -- 172.21.15.8:0/2855928921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2f56ea910 con 0x55e2f57c0b70 2023-10-14T10:35:16.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.126+0000 7fd279d9b640 1 --2- 172.21.15.8:0/2855928921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f57c1a30 0x55e2f57fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:16.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.126+0000 7fd27ad9d640 1 --2- 172.21.15.8:0/2855928921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57bae80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd274009fc0 tx=0x7fd2740077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7ad7c6f5ed9677 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:16.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.126+0000 7fd25bfff640 1 -- 172.21.15.8:0/2855928921 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274003b90 con 0x55e2f57c0b70 2023-10-14T10:35:16.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.126+0000 7fd25bfff640 1 -- 172.21.15.8:0/2855928921 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27400f050 con 0x55e2f57c0b70 2023-10-14T10:35:16.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.126+0000 7fd25bfff640 1 -- 172.21.15.8:0/2855928921 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274004030 con 0x55e2f57c0b70 2023-10-14T10:35:16.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.127+0000 7fd28364b740 1 -- 172.21.15.8:0/2855928921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 msgr2=0x55e2f57bae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:16.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.127+0000 7fd28364b740 1 --2- 172.21.15.8:0/2855928921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57bae80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd274009fc0 tx=0x7fd2740077c0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.127+0000 7fd28364b740 1 -- 172.21.15.8:0/2855928921 shutdown_connections 2023-10-14T10:35:16.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.127+0000 7fd28364b740 1 --2- 172.21.15.8:0/2855928921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57bae80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.127+0000 7fd28364b740 1 --2- 172.21.15.8:0/2855928921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f57c1a30 0x55e2f57fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.127+0000 7fd28364b740 1 --2- 172.21.15.8:0/2855928921 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57bc300 0x55e2f57fc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.127+0000 7fd28364b740 1 -- 172.21.15.8:0/2855928921 >> 172.21.15.8:0/2855928921 conn(0x55e2f57bd070 msgr2=0x55e2f57e1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:16.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.127+0000 7fd28364b740 1 -- 172.21.15.8:0/2855928921 shutdown_connections 2023-10-14T10:35:16.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.127+0000 7fd28364b740 1 -- 172.21.15.8:0/2855928921 wait complete. 2023-10-14T10:35:16.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.128+0000 7fd28364b740 1 -- start start 2023-10-14T10:35:16.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.128+0000 7fd28364b740 1 Processor -- start 2023-10-14T10:35:16.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.129+0000 7fd28364b740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57c0b70 0x55e2f57e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.129+0000 7fd28364b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c1a30 0x55e2f5801860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.129+0000 7fd28364b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f5801310 0x55e2f58071d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.129+0000 7fd28364b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2f5726720 con 0x55e2f57c1a30 2023-10-14T10:35:16.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.129+0000 7fd28364b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2f56c4970 con 0x55e2f5801310 2023-10-14T10:35:16.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.129+0000 7fd28364b740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2f56c4610 con 0x55e2f57c0b70 2023-10-14T10:35:16.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.129+0000 7fd28364b740 10 client.0 _ll_register_callbacks cb 0x55e2f56e69d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:35:16.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.129+0000 7fd279d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c1a30 0x55e2f5801860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.129+0000 7fd279d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c1a30 0x55e2f5801860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47288/0 (socket says 172.21.15.8:47288) 2023-10-14T10:35:16.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.129+0000 7fd279d9b640 1 -- 172.21.15.8:0/4213932805 learned_addr learned my addr 172.21.15.8:0/4213932805 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:16.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.130+0000 7fd27a59c640 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57c0b70 0x55e2f57e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.130+0000 7fd27ad9d640 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f5801310 0x55e2f58071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.130+0000 7fd279d9b640 1 -- 172.21.15.8:0/4213932805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57c0b70 msgr2=0x55e2f57e4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:16.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.130+0000 7fd279d9b640 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57c0b70 0x55e2f57e4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.130+0000 7fd279d9b640 1 -- 172.21.15.8:0/4213932805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f5801310 msgr2=0x55e2f58071d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:16.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.130+0000 7fd279d9b640 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f5801310 0x55e2f58071d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.130+0000 7fd279d9b640 1 -- 172.21.15.8:0/4213932805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd274009bf0 con 0x55e2f57c1a30 2023-10-14T10:35:16.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.130+0000 7fd279d9b640 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c1a30 0x55e2f5801860 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd27007a2c0 tx=0x7fd27007aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a674f351f65b31d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:16.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.130+0000 7fd2597fa640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:35:16.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.130+0000 7fd2597fa640 1 -- 172.21.15.8:0/4213932805 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270082630 con 0x55e2f57c1a30 2023-10-14T10:35:16.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.130+0000 7fd2597fa640 1 -- 172.21.15.8:0/4213932805 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd27007e030 con 0x55e2f57c1a30 2023-10-14T10:35:16.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.130+0000 7fd28364b740 1 -- 172.21.15.8:0/4213932805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e2f574d160 con 0x55e2f57c1a30 2023-10-14T10:35:16.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.131+0000 7fd2597fa640 1 -- 172.21.15.8:0/4213932805 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd27007e240 con 0x55e2f57c1a30 2023-10-14T10:35:16.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.131+0000 7fd28364b740 10 client.5343 fetch_fsmap learned FSMap version 17 2023-10-14T10:35:16.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.131+0000 7fd28364b740 1 -- 172.21.15.8:0/4213932805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e2f5724da0 con 0x55e2f57c1a30 2023-10-14T10:35:16.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.131+0000 7fd2597fa640 1 -- 172.21.15.8:0/4213932805 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e2f574d160 con 0x55e2f57c1a30 2023-10-14T10:35:16.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.131+0000 7fd2597fa640 1 -- 172.21.15.8:0/4213932805 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fd27007a590 con 0x55e2f57c1a30 2023-10-14T10:35:16.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.131+0000 7fd28364b740 10 client.5343 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:35:16.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.131+0000 7fd28364b740 10 client.5343 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:35:16.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.131+0000 7fd28364b740 20 client.5343 populate_metadata read hostname 'smithi008' 2023-10-14T10:35:16.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.131+0000 7fd28364b740 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55e2f57f6b60 0x55e2f57f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.131+0000 7fd28364b740 4 client.5343 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T10:35:16.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.131+0000 7fd28364b740 1 -- 172.21.15.8:0/4213932805 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e2f56f8cc0 con 0x55e2f57f6b60 2023-10-14T10:35:16.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.131+0000 7fd27a59c640 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55e2f57f6b60 0x55e2f57f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.132+0000 7fd27a59c640 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55e2f57f6b60 0x55e2f57f6f40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49d55bd385ab17f8 server_cookie=6bb41856ca850339 in_seq=0 out_seq=0 2023-10-14T10:35:16.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.132+0000 7fd2597fa640 10 client.5343 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:16.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.132+0000 7fd2597fa640 1 -- 172.21.15.8:0/4213932805 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e2f56f8cc0 con 0x55e2f57f6b60 2023-10-14T10:35:16.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd2597fa640 10 client.5343 handle_command_reply: tid=0 2023-10-14T10:35:16.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd28364b740 1 client.5343 shutdown 2023-10-14T10:35:16.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd28364b740 1 -- 172.21.15.8:0/4213932805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c1a30 msgr2=0x55e2f5801860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:16.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd28364b740 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c1a30 0x55e2f5801860 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd27007a2c0 tx=0x7fd27007aaf0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd28364b740 1 -- 172.21.15.8:0/4213932805 shutdown_connections 2023-10-14T10:35:16.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd28364b740 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55e2f57f6b60 0x55e2f57f6f40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd28364b740 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f5801310 0x55e2f58071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd28364b740 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c1a30 0x55e2f5801860 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd28364b740 1 --2- 172.21.15.8:0/4213932805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57c0b70 0x55e2f57e4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd2597fa640 0 client.5343 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:16.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd28364b740 1 -- 172.21.15.8:0/4213932805 >> 172.21.15.8:0/4213932805 conn(0x55e2f57bc300 msgr2=0x55e2f57fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:16.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd28364b740 1 -- 172.21.15.8:0/4213932805 shutdown_connections 2023-10-14T10:35:16.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd28364b740 1 -- 172.21.15.8:0/4213932805 wait complete. 2023-10-14T10:35:16.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.133+0000 7fd28364b740 20 client.5343 trim_cache size 0 max 16384 2023-10-14T10:35:16.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.150+0000 7fd28364b740 1 Processor -- start 2023-10-14T10:35:16.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.150+0000 7fd28364b740 1 -- start start 2023-10-14T10:35:16.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.151+0000 7fd28364b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57fd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.151+0000 7fd28364b740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57c1a30 0x55e2f57f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.151+0000 7fd28364b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f5801310 0x55e2f58023e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.151+0000 7fd28364b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2f548af20 con 0x55e2f57c0b70 2023-10-14T10:35:16.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.151+0000 7fd28364b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2f57c15d0 con 0x55e2f5801310 2023-10-14T10:35:16.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.151+0000 7fd28364b740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2f5811670 con 0x55e2f57c1a30 2023-10-14T10:35:16.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.151+0000 7fd27a59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57fd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.151+0000 7fd27a59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57fd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47304/0 (socket says 172.21.15.8:47304) 2023-10-14T10:35:16.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.151+0000 7fd27a59c640 1 -- 172.21.15.8:0/3357438551 learned_addr learned my addr 172.21.15.8:0/3357438551 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:16.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.152+0000 7fd27ad9d640 1 --2- 172.21.15.8:0/3357438551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f5801310 0x55e2f58023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.152+0000 7fd279d9b640 1 --2- 172.21.15.8:0/3357438551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57c1a30 0x55e2f57f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.152+0000 7fd27a59c640 1 -- 172.21.15.8:0/3357438551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57c1a30 msgr2=0x55e2f57f6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:16.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.152+0000 7fd27a59c640 1 --2- 172.21.15.8:0/3357438551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57c1a30 0x55e2f57f6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.152+0000 7fd27a59c640 1 -- 172.21.15.8:0/3357438551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f5801310 msgr2=0x55e2f58023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:16.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.152+0000 7fd27a59c640 1 --2- 172.21.15.8:0/3357438551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f5801310 0x55e2f58023e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.152+0000 7fd27a59c640 1 -- 172.21.15.8:0/3357438551 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2f56c3b80 con 0x55e2f57c0b70 2023-10-14T10:35:16.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.152+0000 7fd27a59c640 1 --2- 172.21.15.8:0/3357438551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57fd200 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd26c000f60 tx=0x7fd26c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e4ec6e3b2a4f7b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:16.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.153+0000 7fd268ff9640 1 -- 172.21.15.8:0/3357438551 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c019040 con 0x55e2f57c0b70 2023-10-14T10:35:16.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.153+0000 7fd268ff9640 1 -- 172.21.15.8:0/3357438551 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c01a040 con 0x55e2f57c0b70 2023-10-14T10:35:16.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.153+0000 7fd268ff9640 1 -- 172.21.15.8:0/3357438551 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c007560 con 0x55e2f57c0b70 2023-10-14T10:35:16.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.153+0000 7fd28364b740 1 -- 172.21.15.8:0/3357438551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 msgr2=0x55e2f57fd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:16.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.153+0000 7fd28364b740 1 --2- 172.21.15.8:0/3357438551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57fd200 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd26c000f60 tx=0x7fd26c011000 comp rx=0 tx=0).stop 2023-10-14T10:35:16.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.153+0000 7fd28364b740 1 -- 172.21.15.8:0/3357438551 shutdown_connections 2023-10-14T10:35:16.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.153+0000 7fd28364b740 1 --2- 172.21.15.8:0/3357438551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f5801310 0x55e2f58023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.153+0000 7fd28364b740 1 --2- 172.21.15.8:0/3357438551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f57c1a30 0x55e2f57f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.153+0000 7fd28364b740 1 --2- 172.21.15.8:0/3357438551 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57fd200 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.153+0000 7fd28364b740 1 -- 172.21.15.8:0/3357438551 >> 172.21.15.8:0/3357438551 conn(0x55e2f57bc300 msgr2=0x55e2f5803330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:16.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.154+0000 7fd28364b740 1 -- 172.21.15.8:0/3357438551 shutdown_connections 2023-10-14T10:35:16.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.154+0000 7fd28364b740 1 -- 172.21.15.8:0/3357438551 wait complete. 2023-10-14T10:35:16.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.154+0000 7fd28364b740 1 -- start start 2023-10-14T10:35:16.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.154+0000 7fd28364b740 1 Processor -- start 2023-10-14T10:35:16.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.155+0000 7fd28364b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57fc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.155+0000 7fd28364b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f57c1a30 0x55e2f580df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.155+0000 7fd28364b740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f5801310 0x55e2f58664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.155+0000 7fd28364b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2f580e440 con 0x55e2f57c0b70 2023-10-14T10:35:16.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.155+0000 7fd28364b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2f5818c70 con 0x55e2f57c1a30 2023-10-14T10:35:16.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.155+0000 7fd28364b740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2f57c02d0 con 0x55e2f5801310 2023-10-14T10:35:16.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.156+0000 7fd28364b740 10 client.0 _ll_register_callbacks cb 0x7fd2740097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:35:16.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.156+0000 7fd27a59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57fc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.156+0000 7fd27a59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57fc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47316/0 (socket says 172.21.15.8:47316) 2023-10-14T10:35:16.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.156+0000 7fd27a59c640 1 -- 172.21.15.8:0/1217987995 learned_addr learned my addr 172.21.15.8:0/1217987995 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:16.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.156+0000 7fd27ad9d640 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f5801310 0x55e2f58664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.156+0000 7fd279d9b640 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f57c1a30 0x55e2f580df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.156+0000 7fd27a59c640 1 -- 172.21.15.8:0/1217987995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f5801310 msgr2=0x55e2f58664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:16.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.156+0000 7fd27a59c640 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f5801310 0x55e2f58664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.156+0000 7fd27a59c640 1 -- 172.21.15.8:0/1217987995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f57c1a30 msgr2=0x55e2f580df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:16.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.156+0000 7fd27a59c640 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f57c1a30 0x55e2f580df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.156+0000 7fd27a59c640 1 -- 172.21.15.8:0/1217987995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e2f56e9170 con 0x55e2f57c0b70 2023-10-14T10:35:16.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.157+0000 7fd27a59c640 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57fc680 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009010 tx=0x7fd26c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa37d03ae3b434da server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:16.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.157+0000 7fd2597fa640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:35:16.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.157+0000 7fd2597fa640 1 -- 172.21.15.8:0/1217987995 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c022d00 con 0x55e2f57c0b70 2023-10-14T10:35:16.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.157+0000 7fd2597fa640 1 -- 172.21.15.8:0/1217987995 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd26c019070 con 0x55e2f57c0b70 2023-10-14T10:35:16.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.157+0000 7fd28364b740 1 -- 172.21.15.8:0/1217987995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd27400f050 con 0x55e2f57c0b70 2023-10-14T10:35:16.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.157+0000 7fd2597fa640 1 -- 172.21.15.8:0/1217987995 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd26c022e60 con 0x55e2f57c0b70 2023-10-14T10:35:16.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.157+0000 7fd28364b740 10 client.5349 fetch_fsmap learned FSMap version 17 2023-10-14T10:35:16.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.157+0000 7fd28364b740 1 -- 172.21.15.8:0/1217987995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e2f56cff40 con 0x55e2f57c0b70 2023-10-14T10:35:16.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.158+0000 7fd2597fa640 1 -- 172.21.15.8:0/1217987995 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27400f050 con 0x55e2f57c0b70 2023-10-14T10:35:16.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.158+0000 7fd2597fa640 1 -- 172.21.15.8:0/1217987995 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fd26c01f040 con 0x55e2f57c0b70 2023-10-14T10:35:16.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.158+0000 7fd28364b740 10 client.5349 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:35:16.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.158+0000 7fd28364b740 10 client.5349 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:35:16.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.158+0000 7fd28364b740 20 client.5349 populate_metadata read hostname 'smithi008' 2023-10-14T10:35:16.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.158+0000 7fd28364b740 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55e2f5866ad0 0x55e2f57ffd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:16.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.158+0000 7fd28364b740 4 client.5349 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T10:35:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.158+0000 7fd28364b740 1 -- 172.21.15.8:0/1217987995 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e2f571f700 con 0x55e2f5866ad0 2023-10-14T10:35:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.158+0000 7fd279d9b640 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55e2f5866ad0 0x55e2f57ffd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.158+0000 7fd279d9b640 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55e2f5866ad0 0x55e2f57ffd00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da6ec11dd0d99d38 server_cookie=e5050e98c9f1fea2 in_seq=0 out_seq=0 2023-10-14T10:35:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.158+0000 7fd2597fa640 10 client.5349 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd2597fa640 1 -- 172.21.15.8:0/1217987995 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x55e2f571f700 con 0x55e2f5866ad0 2023-10-14T10:35:16.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd2597fa640 10 client.5349 handle_command_reply: tid=0 2023-10-14T10:35:16.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd28364b740 1 client.5349 shutdown 2023-10-14T10:35:16.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd28364b740 1 -- 172.21.15.8:0/1217987995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 msgr2=0x55e2f57fc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:16.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd28364b740 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57fc680 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009010 tx=0x7fd26c000ed0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd28364b740 1 -- 172.21.15.8:0/1217987995 shutdown_connections 2023-10-14T10:35:16.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd28364b740 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55e2f5866ad0 0x55e2f57ffd00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd28364b740 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55e2f5801310 0x55e2f58664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd28364b740 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e2f57c1a30 0x55e2f580df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd2597fa640 0 client.5349 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:16.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd28364b740 1 --2- 172.21.15.8:0/1217987995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e2f57c0b70 0x55e2f57fc680 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd28364b740 1 -- 172.21.15.8:0/1217987995 >> 172.21.15.8:0/1217987995 conn(0x55e2f57bc300 msgr2=0x55e2f57e4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:16.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd28364b740 1 -- 172.21.15.8:0/1217987995 shutdown_connections 2023-10-14T10:35:16.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd28364b740 1 -- 172.21.15.8:0/1217987995 wait complete. 2023-10-14T10:35:16.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.159+0000 7fd28364b740 20 client.5349 trim_cache size 0 max 16384 2023-10-14T10:35:16.174 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "452b10b4-f8ad-4e99-85d0-4d157f344356", 2023-10-14T10:35:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-14T10:35:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5052, 2023-10-14T10:35:16.175 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-14T10:35:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-14T10:35:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "testcephfs1", 2023-10-14T10:35:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 27.682786416999999, 2023-10-14T10:35:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 17, 2023-10-14T10:35:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 34, 2023-10-14T10:35:16.176 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 34, 2023-10-14T10:35:16.177 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 36.900335075000001 2023-10-14T10:35:16.177 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:16.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.160+0000 7fd280ac2640 1 -- 172.21.15.8:0/2872533481 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd25c06ae70 msgr2=0x7fd25c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:16.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.160+0000 7fd280ac2640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd25c06ae70 0x7fd25c06d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd26c007fd0 tx=0x7fd26c009040 comp rx=0 tx=0).stop 2023-10-14T10:35:16.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.160+0000 7fd280ac2640 1 -- 172.21.15.8:0/2872533481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd27c14e4b0 msgr2=0x7fd27c0bf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:16.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.160+0000 7fd280ac2640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd27c14e4b0 0x7fd27c0bf4b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd270009890 tx=0x7fd2700046c0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.160+0000 7fd280ac2640 1 -- 172.21.15.8:0/2872533481 shutdown_connections 2023-10-14T10:35:16.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.160+0000 7fd280ac2640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd25c06ae70 0x7fd25c06d330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.160+0000 7fd280ac2640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd27c150ea0 0x7fd27c14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.160+0000 7fd280ac2640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd27c14e4b0 0x7fd27c0bf4b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.160+0000 7fd280ac2640 1 --2- 172.21.15.8:0/2872533481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd27c0a8a30 0x7fd27c0c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:16.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.160+0000 7fd280ac2640 1 -- 172.21.15.8:0/2872533481 >> 172.21.15.8:0/2872533481 conn(0x7fd27c0a74d0 msgr2=0x7fd27c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:16.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.160+0000 7fd280ac2640 1 -- 172.21.15.8:0/2872533481 shutdown_connections 2023-10-14T10:35:16.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:16.160+0000 7fd280ac2640 1 -- 172.21.15.8:0/2872533481 wait complete. 2023-10-14T10:35:16.181 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T10:34:47.550249+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5052": { "addr": "172.21.15.8:6837/799022047", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6836", "nonce": 799022047, "type": "v2" }, { "addr": "172.21.15.8:6837", "nonce": 799022047, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5052, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T10:34:50.997788+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5052 } } } ], "standbys": [ { "addr": "172.21.15.8:6835/1474692193", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6834", "nonce": 1474692193, "type": "v2" }, { "addr": "172.21.15.8:6835", "nonce": 1474692193, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4532, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6835/2045070429", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6833", "nonce": 2045070429, "type": "v2" }, { "addr": "172.21.15.92:6835", "nonce": 2045070429, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4538, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6834/337485030", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6832", "nonce": 337485030, "type": "v2" }, { "addr": "172.21.15.92:6834", "nonce": 337485030, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4726, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T10:35:16.182 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': 2, 'name': 'a', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T10:35:16.182 INFO:tasks.cephfs.test_failover:current = [{'gid': 4532, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.8:6835/1474692193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6834', 'nonce': 1474692193}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 1474692193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 4726, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6834/337485030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 337485030}, {'type': 'v1', 'addr': '172.21.15.92:6834', 'nonce': 337485030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 4538, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6835/2045070429', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6833', 'nonce': 2045070429}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2045070429}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T10:35:16.183 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T10:35:16.183 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-14T10:35:21.185 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:35:21.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.422+0000 7feec880f640 1 Processor -- start 2023-10-14T10:35:21.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.422+0000 7feec880f640 1 -- start start 2023-10-14T10:35:21.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.424+0000 7feec880f640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7feec40a9610 0x7feec4151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:21.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.424+0000 7feec880f640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feec406faf0 0x7feec406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:21.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.424+0000 7feec880f640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec4071650 con 0x7feec414abb0 2023-10-14T10:35:21.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.424+0000 7feec880f640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec40a9280 con 0x7feec406faf0 2023-10-14T10:35:21.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.424+0000 7feec880f640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec40aa6f0 con 0x7feec40a9610 2023-10-14T10:35:21.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.424+0000 7feec359e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7feec406faf0 0x7feec406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:21.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.424+0000 7feec2d9d640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7feec414abb0 0x7feec40c2110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53872/0 (socket says 172.21.15.8:53872) 2023-10-14T10:35:21.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.425+0000 7feec2d9d640 1 -- 172.21.15.8:0/3244173122 learned_addr learned my addr 172.21.15.8:0/3244173122 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:21.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.425+0000 7feec259c640 1 --2- 172.21.15.8:0/3244173122 >> v2:172.21.15.92:3300/0 conn(0x7feec40a9610 0x7feec4151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:21.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.425+0000 7feec359e640 1 -- 172.21.15.8:0/3244173122 >> v2:172.21.15.92:3300/0 conn(0x7feec40a9610 msgr2=0x7feec4151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:21.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.425+0000 7feec359e640 1 --2- 172.21.15.8:0/3244173122 >> v2:172.21.15.92:3300/0 conn(0x7feec40a9610 0x7feec4151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:21.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.425+0000 7feec359e640 1 -- 172.21.15.8:0/3244173122 >> v1:172.21.15.8:6789/0 conn(0x7feec414abb0 legacy=0x7feec40c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:21.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.425+0000 7feec359e640 1 -- 172.21.15.8:0/3244173122 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40a81e0 con 0x7feec406faf0 2023-10-14T10:35:21.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.426+0000 7feec359e640 1 --2- 172.21.15.8:0/3244173122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec406faf0 0x7feec406ff60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7feec40c15d0 tx=0x7feebc02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659e006fb9e6df35 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:21.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.426+0000 7feec1d9b640 1 -- 172.21.15.8:0/3244173122 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc02cc70 con 0x7feec406faf0 2023-10-14T10:35:21.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.427+0000 7feec1d9b640 1 -- 172.21.15.8:0/3244173122 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc02cdd0 con 0x7feec406faf0 2023-10-14T10:35:21.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.427+0000 7feec1d9b640 1 -- 172.21.15.8:0/3244173122 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc034660 con 0x7feec406faf0 2023-10-14T10:35:21.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.427+0000 7feec880f640 1 -- 172.21.15.8:0/3244173122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec406faf0 msgr2=0x7feec406ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.427+0000 7feec880f640 1 --2- 172.21.15.8:0/3244173122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec406faf0 0x7feec406ff60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7feec40c15d0 tx=0x7feebc02bec0 comp rx=0 tx=0).stop 2023-10-14T10:35:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.427+0000 7feec880f640 1 -- 172.21.15.8:0/3244173122 shutdown_connections 2023-10-14T10:35:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.427+0000 7feec880f640 1 --2- 172.21.15.8:0/3244173122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec406faf0 0x7feec406ff60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.427+0000 7feec880f640 1 --2- 172.21.15.8:0/3244173122 >> v2:172.21.15.92:3300/0 conn(0x7feec40a9610 0x7feec4151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.427+0000 7feec880f640 1 -- 172.21.15.8:0/3244173122 >> 172.21.15.8:0/3244173122 conn(0x7feec406a200 msgr2=0x7feec406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:21.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.427+0000 7feec880f640 1 -- 172.21.15.8:0/3244173122 shutdown_connections 2023-10-14T10:35:21.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.427+0000 7feec880f640 1 -- 172.21.15.8:0/3244173122 wait complete. 2023-10-14T10:35:21.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.429+0000 7feec880f640 1 Processor -- start 2023-10-14T10:35:21.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.430+0000 7feec880f640 1 -- start start 2023-10-14T10:35:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.431+0000 7feec880f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec406faf0 0x7feec41464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.431+0000 7feec880f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feec40a9610 0x7feec4145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:21.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.431+0000 7feec880f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec414abb0 0x7feec413c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.431+0000 7feec880f640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec414c330 con 0x7feec414abb0 2023-10-14T10:35:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.431+0000 7feec880f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec414bfe0 con 0x7feec406faf0 2023-10-14T10:35:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.431+0000 7feec880f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec4147ae0 con 0x7feec40a9610 2023-10-14T10:35:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.431+0000 7feec359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec414abb0 0x7feec413c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:21.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.431+0000 7feec359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec414abb0 0x7feec413c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53706/0 (socket says 172.21.15.8:53706) 2023-10-14T10:35:21.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.431+0000 7feec359e640 1 -- 172.21.15.8:0/728531148 learned_addr learned my addr 172.21.15.8:0/728531148 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:21.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.431+0000 7feec259c640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feec40a9610 0x7feec4145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:21.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.432+0000 7feec2d9d640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec406faf0 0x7feec41464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:21.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.432+0000 7feec359e640 1 -- 172.21.15.8:0/728531148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feec40a9610 msgr2=0x7feec4145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:21.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.432+0000 7feec359e640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feec40a9610 0x7feec4145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:21.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.432+0000 7feec359e640 1 -- 172.21.15.8:0/728531148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec406faf0 msgr2=0x7feec41464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:21.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.432+0000 7feec359e640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec406faf0 0x7feec41464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:21.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.432+0000 7feec359e640 1 -- 172.21.15.8:0/728531148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc009a70 con 0x7feec414abb0 2023-10-14T10:35:21.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.432+0000 7feec259c640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feec40a9610 0x7feec4145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:21.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.432+0000 7feec359e640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec414abb0 0x7feec413c860 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7feebc009e50 tx=0x7feebc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:21.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.432+0000 7feeab7fe640 1 -- 172.21.15.8:0/728531148 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc03e610 con 0x7feec414abb0 2023-10-14T10:35:21.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.432+0000 7feeab7fe640 1 -- 172.21.15.8:0/728531148 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc03e770 con 0x7feec414abb0 2023-10-14T10:35:21.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.432+0000 7feeab7fe640 1 -- 172.21.15.8:0/728531148 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc03eb00 con 0x7feec414abb0 2023-10-14T10:35:21.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.432+0000 7feec880f640 1 -- 172.21.15.8:0/728531148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec414e290 con 0x7feec414abb0 2023-10-14T10:35:21.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.433+0000 7feec880f640 1 -- 172.21.15.8:0/728531148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec414e850 con 0x7feec414abb0 2023-10-14T10:35:21.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.434+0000 7feec880f640 1 -- 172.21.15.8:0/728531148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec404e9b0 con 0x7feec414abb0 2023-10-14T10:35:21.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.435+0000 7feeab7fe640 1 -- 172.21.15.8:0/728531148 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feebc03b050 con 0x7feec414abb0 2023-10-14T10:35:21.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.436+0000 7feeab7fe640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7feeb006aea0 0x7feeb006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:21.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.437+0000 7feeab7fe640 1 -- 172.21.15.8:0/728531148 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7feebc0abec0 con 0x7feec414abb0 2023-10-14T10:35:21.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.437+0000 7feec2d9d640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7feeb006aea0 0x7feeb006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:21.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.438+0000 7feec2d9d640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7feeb006aea0 0x7feeb006d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feeb4000f60 tx=0x7feeb4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:21.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.442+0000 7feeab7fe640 1 -- 172.21.15.8:0/728531148 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feebc076f40 con 0x7feec414abb0 2023-10-14T10:35:21.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.677+0000 7feec880f640 1 -- 172.21.15.8:0/728531148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feec40720a0 con 0x7feec414abb0 2023-10-14T10:35:21.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.679+0000 7feeab7fe640 1 -- 172.21.15.8:0/728531148 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7feebc07a560 con 0x7feec414abb0 2023-10-14T10:35:21.681 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:21.681 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:35:21.682 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:35:21.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.681+0000 7feec880f640 1 -- 172.21.15.8:0/728531148 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7feeb006aea0 msgr2=0x7feeb006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:21.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.681+0000 7feec880f640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7feeb006aea0 0x7feeb006d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feeb4000f60 tx=0x7feeb4009040 comp rx=0 tx=0).stop 2023-10-14T10:35:21.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.681+0000 7feec880f640 1 -- 172.21.15.8:0/728531148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec414abb0 msgr2=0x7feec413c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:21.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.681+0000 7feec880f640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec414abb0 0x7feec413c860 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7feebc009e50 tx=0x7feebc004a40 comp rx=0 tx=0).stop 2023-10-14T10:35:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.682+0000 7feec880f640 1 -- 172.21.15.8:0/728531148 shutdown_connections 2023-10-14T10:35:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.682+0000 7feec880f640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7feeb006aea0 0x7feeb006d360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.682+0000 7feec880f640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec414abb0 0x7feec413c860 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.682+0000 7feec880f640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feec40a9610 0x7feec4145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.682+0000 7feec880f640 1 --2- 172.21.15.8:0/728531148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec406faf0 0x7feec41464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.682+0000 7feec880f640 1 -- 172.21.15.8:0/728531148 >> 172.21.15.8:0/728531148 conn(0x7feec406a200 msgr2=0x7feec406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.682+0000 7feec880f640 1 -- 172.21.15.8:0/728531148 shutdown_connections 2023-10-14T10:35:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:21.682+0000 7feec880f640 1 -- 172.21.15.8:0/728531148 wait complete. 2023-10-14T10:35:22.105 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T10:34:47.550249+0000', 'modified': '2023-10-14T10:34:50.997788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5052': {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T10:35:22.106 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T10:35:22.107 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T10:35:22.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.347+0000 7fd0ad4c3640 1 Processor -- start 2023-10-14T10:35:22.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.347+0000 7fd0ad4c3640 1 -- start start 2023-10-14T10:35:22.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.349+0000 7fd0ad4c3640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd0a8155a80 0x7fd0a80719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.349+0000 7fd0ad4c3640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a8072060 con 0x7fd0a80ba3e0 2023-10-14T10:35:22.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.349+0000 7fd0ad4c3640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a81584f0 con 0x7fd0a815b940 2023-10-14T10:35:22.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.349+0000 7fd0ad4c3640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a8159270 con 0x7fd0a8155a80 2023-10-14T10:35:22.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.349+0000 7fd0a7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd0a8155a80 0x7fd0a80719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.350+0000 7fd0a77fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd0a80ba3e0 0x7fd0a80c2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53874/0 (socket says 172.21.15.8:53874) 2023-10-14T10:35:22.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.350+0000 7fd0a77fe640 1 -- 172.21.15.8:0/1332305904 learned_addr learned my addr 172.21.15.8:0/1332305904 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:22.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.350+0000 7fd0a6ffd640 1 -- 172.21.15.8:0/1332305904 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419397940 0 0) 0x7fd0a8072060 con 0x7fd0a80ba3e0 2023-10-14T10:35:22.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.350+0000 7fd0a7fff640 1 -- 172.21.15.8:0/1332305904 >> v1:172.21.15.92:6789/0 conn(0x7fd0a815b940 legacy=0x7fd0a815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:22.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.350+0000 7fd0a7fff640 1 -- 172.21.15.8:0/1332305904 >> v1:172.21.15.8:6789/0 conn(0x7fd0a80ba3e0 legacy=0x7fd0a80c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:22.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.350+0000 7fd0a7fff640 1 -- 172.21.15.8:0/1332305904 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a8158790 con 0x7fd0a8155a80 2023-10-14T10:35:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.352+0000 7fd0a7fff640 1 --2- 172.21.15.8:0/1332305904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0a8155a80 0x7fd0a80719f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd098009d90 tx=0x7fd09802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee446ae4627d9a17 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.352+0000 7fd0a6ffd640 1 -- 172.21.15.8:0/1332305904 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09802cbd0 con 0x7fd0a8155a80 2023-10-14T10:35:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.352+0000 7fd0a6ffd640 1 -- 172.21.15.8:0/1332305904 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09802cd30 con 0x7fd0a8155a80 2023-10-14T10:35:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.352+0000 7fd0a6ffd640 1 -- 172.21.15.8:0/1332305904 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09802cea0 con 0x7fd0a8155a80 2023-10-14T10:35:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.353+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/1332305904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0a8155a80 msgr2=0x7fd0a80719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.353+0000 7fd0ad4c3640 1 --2- 172.21.15.8:0/1332305904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0a8155a80 0x7fd0a80719f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd098009d90 tx=0x7fd09802be20 comp rx=0 tx=0).stop 2023-10-14T10:35:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.353+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/1332305904 shutdown_connections 2023-10-14T10:35:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.353+0000 7fd0ad4c3640 1 --2- 172.21.15.8:0/1332305904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0a8155a80 0x7fd0a80719f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.353+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/1332305904 >> 172.21.15.8:0/1332305904 conn(0x7fd0a806a200 msgr2=0x7fd0a806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:22.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.353+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/1332305904 shutdown_connections 2023-10-14T10:35:22.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.353+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/1332305904 wait complete. 2023-10-14T10:35:22.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.355+0000 7fd0ad4c3640 1 Processor -- start 2023-10-14T10:35:22.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.356+0000 7fd0ad4c3640 1 -- start start 2023-10-14T10:35:22.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.357+0000 7fd0ad4c3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a80ba3e0 0x7fd0a81f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.357+0000 7fd0ad4c3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a8155a80 0x7fd0a80bb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.357+0000 7fd0ad4c3640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0a815b940 0x7fd0a81214c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.357+0000 7fd0ad4c3640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a81f1820 con 0x7fd0a815b940 2023-10-14T10:35:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.357+0000 7fd0ad4c3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a811e470 con 0x7fd0a80ba3e0 2023-10-14T10:35:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.357+0000 7fd0ad4c3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8151920 con 0x7fd0a8155a80 2023-10-14T10:35:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.357+0000 7fd0accc2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0a815b940 0x7fd0a81214c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.357+0000 7fd0accc2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0a815b940 0x7fd0a81214c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53718/0 (socket says 172.21.15.8:53718) 2023-10-14T10:35:22.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.357+0000 7fd0accc2640 1 -- 172.21.15.8:0/2713777289 learned_addr learned my addr 172.21.15.8:0/2713777289 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:22.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.357+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a8155a80 0x7fd0a80bb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.357+0000 7fd0a7fff640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a80ba3e0 0x7fd0a81f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.358+0000 7fd0accc2640 1 -- 172.21.15.8:0/2713777289 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a8155a80 msgr2=0x7fd0a80bb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:22.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.358+0000 7fd0accc2640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a8155a80 0x7fd0a80bb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.358+0000 7fd0accc2640 1 -- 172.21.15.8:0/2713777289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a80ba3e0 msgr2=0x7fd0a81f12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:22.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.358+0000 7fd0accc2640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a80ba3e0 0x7fd0a81f12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.358+0000 7fd0accc2640 1 -- 172.21.15.8:0/2713777289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd098009a70 con 0x7fd0a815b940 2023-10-14T10:35:22.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.358+0000 7fd0accc2640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0a815b940 0x7fd0a81214c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000c410 tx=0x7fd0a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:22.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.358+0000 7fd0a4ff9640 1 -- 172.21.15.8:0/2713777289 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0011790 con 0x7fd0a815b940 2023-10-14T10:35:22.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.358+0000 7fd0a4ff9640 1 -- 172.21.15.8:0/2713777289 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a00118f0 con 0x7fd0a815b940 2023-10-14T10:35:22.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.358+0000 7fd0a4ff9640 1 -- 172.21.15.8:0/2713777289 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0011ce0 con 0x7fd0a815b940 2023-10-14T10:35:22.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.358+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/2713777289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a8151d00 con 0x7fd0a815b940 2023-10-14T10:35:22.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.359+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/2713777289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a811e710 con 0x7fd0a815b940 2023-10-14T10:35:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.361+0000 7fd0a4ff9640 1 -- 172.21.15.8:0/2713777289 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd0a001c460 con 0x7fd0a815b940 2023-10-14T10:35:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.362+0000 7fd0a4ff9640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd08806ae70 0x7fd08806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.362+0000 7fd0a4ff9640 1 -- 172.21.15.8:0/2713777289 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd0a0089310 con 0x7fd0a815b940 2023-10-14T10:35:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.362+0000 7fd0b1392740 1 Processor -- start 2023-10-14T10:35:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.362+0000 7fd0a7fff640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd08806ae70 0x7fd08806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.363+0000 7fd0b1392740 1 -- start start 2023-10-14T10:35:22.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.363+0000 7fd0a7fff640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd08806ae70 0x7fd08806d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd098036000 tx=0x7fd098030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:22.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0b1392740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91d0880 0x5561b91d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0b1392740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b9196c20 0x5561b91d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0b1392740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d39f0 0x5561b91959a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0b1392740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b90b07a0 con 0x5561b9196c20 2023-10-14T10:35:22.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0b1392740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b9102740 con 0x5561b91d0880 2023-10-14T10:35:22.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0b1392740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561b90ffe30 con 0x5561b91d39f0 2023-10-14T10:35:22.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0a77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b9196c20 0x5561b91d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0a77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b9196c20 0x5561b91d0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53728/0 (socket says 172.21.15.8:53728) 2023-10-14T10:35:22.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0a77fe640 1 -- 172.21.15.8:0/1071491427 learned_addr learned my addr 172.21.15.8:0/1071491427 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:22.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0a7fff640 1 --2- 172.21.15.8:0/1071491427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91d0880 0x5561b91d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0accc2640 1 --2- 172.21.15.8:0/1071491427 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d39f0 0x5561b91959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0a77fe640 1 -- 172.21.15.8:0/1071491427 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d39f0 msgr2=0x5561b91959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:22.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/1071491427 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d39f0 0x5561b91959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0a77fe640 1 -- 172.21.15.8:0/1071491427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91d0880 msgr2=0x5561b91d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:22.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/1071491427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91d0880 0x5561b91d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.364+0000 7fd0a77fe640 1 -- 172.21.15.8:0/1071491427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561b90bf910 con 0x5561b9196c20 2023-10-14T10:35:22.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.365+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/1071491427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b9196c20 0x5561b91d0c60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd090007520 tx=0x7fd090005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2eea68bb86f1bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:22.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.365+0000 7fd09dffb640 1 -- 172.21.15.8:0/1071491427 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090001730 con 0x5561b9196c20 2023-10-14T10:35:22.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.365+0000 7fd09dffb640 1 -- 172.21.15.8:0/1071491427 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0900018b0 con 0x5561b9196c20 2023-10-14T10:35:22.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.365+0000 7fd09dffb640 1 -- 172.21.15.8:0/1071491427 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090001c60 con 0x5561b9196c20 2023-10-14T10:35:22.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.366+0000 7fd0b1392740 1 -- 172.21.15.8:0/1071491427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b9196c20 msgr2=0x5561b91d0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:22.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.366+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1071491427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b9196c20 0x5561b91d0c60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd090007520 tx=0x7fd090005bc0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.366+0000 7fd0b1392740 1 -- 172.21.15.8:0/1071491427 shutdown_connections 2023-10-14T10:35:22.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.366+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1071491427 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d39f0 0x5561b91959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.366+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1071491427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b9196c20 0x5561b91d0c60 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.366+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1071491427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91d0880 0x5561b91d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.366+0000 7fd0b1392740 1 -- 172.21.15.8:0/1071491427 >> 172.21.15.8:0/1071491427 conn(0x5561b9192260 msgr2=0x5561b91b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:22.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.366+0000 7fd0b1392740 1 -- 172.21.15.8:0/1071491427 shutdown_connections 2023-10-14T10:35:22.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.366+0000 7fd0b1392740 1 -- 172.21.15.8:0/1071491427 wait complete. 2023-10-14T10:35:22.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.367+0000 7fd0b1392740 1 -- start start 2023-10-14T10:35:22.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.367+0000 7fd0b1392740 1 Processor -- start 2023-10-14T10:35:22.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.368+0000 7fd0b1392740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d0880 0x5561b91b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.368+0000 7fd0b1392740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 0x5561b91e3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.368+0000 7fd0b1392740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91e3590 0x5561b91b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.368+0000 7fd0b1392740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b90fb720 con 0x5561b91d39f0 2023-10-14T10:35:22.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.368+0000 7fd0b1392740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b9099970 con 0x5561b91e3590 2023-10-14T10:35:22.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.368+0000 7fd0b1392740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561b9099610 con 0x5561b91d0880 2023-10-14T10:35:22.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.368+0000 7fd0b1392740 10 client.0 _ll_register_callbacks cb 0x5561b90bb9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:35:22.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.368+0000 7fd0a77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 0x5561b91e3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.368+0000 7fd0a77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 0x5561b91e3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53732/0 (socket says 172.21.15.8:53732) 2023-10-14T10:35:22.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.368+0000 7fd0a77fe640 1 -- 172.21.15.8:0/4167934517 learned_addr learned my addr 172.21.15.8:0/4167934517 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:22.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.369+0000 7fd0a7fff640 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d0880 0x5561b91b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.369+0000 7fd0accc2640 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91e3590 0x5561b91b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.369+0000 7fd0a77fe640 1 -- 172.21.15.8:0/4167934517 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d0880 msgr2=0x5561b91b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:22.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.369+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d0880 0x5561b91b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.369+0000 7fd0a77fe640 1 -- 172.21.15.8:0/4167934517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91e3590 msgr2=0x5561b91b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:22.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.369+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91e3590 0x5561b91b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.369+0000 7fd0a77fe640 1 -- 172.21.15.8:0/4167934517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09000f040 con 0x5561b91d39f0 2023-10-14T10:35:22.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.369+0000 7fd0accc2640 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91e3590 0x5561b91b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:35:22.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.369+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 0x5561b91e3050 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd090017040 tx=0x7fd090000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff82fb26e2656680 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:22.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.369+0000 7fd086ffd640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:35:22.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.370+0000 7fd086ffd640 1 -- 172.21.15.8:0/4167934517 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090001730 con 0x5561b91d39f0 2023-10-14T10:35:22.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.370+0000 7fd086ffd640 1 -- 172.21.15.8:0/4167934517 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd090014690 con 0x5561b91d39f0 2023-10-14T10:35:22.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.370+0000 7fd0b1392740 1 -- 172.21.15.8:0/4167934517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561b9122160 con 0x5561b91d39f0 2023-10-14T10:35:22.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.370+0000 7fd086ffd640 1 -- 172.21.15.8:0/4167934517 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd090014850 con 0x5561b91d39f0 2023-10-14T10:35:22.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.370+0000 7fd0b1392740 10 client.5373 fetch_fsmap learned FSMap version 17 2023-10-14T10:35:22.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.370+0000 7fd0b1392740 1 -- 172.21.15.8:0/4167934517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5561b90f9da0 con 0x5561b91d39f0 2023-10-14T10:35:22.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.370+0000 7fd086ffd640 1 -- 172.21.15.8:0/4167934517 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561b9122160 con 0x5561b91d39f0 2023-10-14T10:35:22.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.370+0000 7fd086ffd640 1 -- 172.21.15.8:0/4167934517 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fd09001f450 con 0x5561b91d39f0 2023-10-14T10:35:22.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.370+0000 7fd0b1392740 10 client.5373 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:35:22.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.370+0000 7fd0b1392740 10 client.5373 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:35:22.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.371+0000 7fd0b1392740 20 client.5373 populate_metadata read hostname 'smithi008' 2023-10-14T10:35:22.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.371+0000 7fd0b1392740 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5561b91e5150 0x5561b91e5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.371+0000 7fd0b1392740 4 client.5373 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T10:35:22.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.371+0000 7fd0b1392740 1 -- 172.21.15.8:0/4167934517 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561b90cdcc0 con 0x5561b91e5150 2023-10-14T10:35:22.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.371+0000 7fd0a7fff640 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5561b91e5150 0x5561b91e5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.371+0000 7fd0a7fff640 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5561b91e5150 0x5561b91e5530 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1231014e560cc15 server_cookie=a8460240f766a396 in_seq=0 out_seq=0 2023-10-14T10:35:22.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.371+0000 7fd086ffd640 10 client.5373 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:22.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.372+0000 7fd086ffd640 1 -- 172.21.15.8:0/4167934517 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5561b90cdcc0 con 0x5561b91e5150 2023-10-14T10:35:22.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.372+0000 7fd086ffd640 10 client.5373 handle_command_reply: tid=0 2023-10-14T10:35:22.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.372+0000 7fd0b1392740 1 client.5373 shutdown 2023-10-14T10:35:22.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.372+0000 7fd0b1392740 1 -- 172.21.15.8:0/4167934517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 msgr2=0x5561b91e3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:22.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.372+0000 7fd0b1392740 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 0x5561b91e3050 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd090017040 tx=0x7fd090000ed0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.372+0000 7fd0b1392740 1 -- 172.21.15.8:0/4167934517 shutdown_connections 2023-10-14T10:35:22.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.372+0000 7fd0b1392740 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5561b91e5150 0x5561b91e5530 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.372+0000 7fd0b1392740 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91e3590 0x5561b91b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.372+0000 7fd0b1392740 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 0x5561b91e3050 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.372+0000 7fd0b1392740 1 --2- 172.21.15.8:0/4167934517 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d0880 0x5561b91b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.372+0000 7fd086ffd640 0 client.5373 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:22.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.372+0000 7fd0b1392740 1 -- 172.21.15.8:0/4167934517 >> 172.21.15.8:0/4167934517 conn(0x5561b9196c20 msgr2=0x5561b9195770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:22.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.373+0000 7fd0b1392740 1 -- 172.21.15.8:0/4167934517 shutdown_connections 2023-10-14T10:35:22.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.373+0000 7fd0b1392740 1 -- 172.21.15.8:0/4167934517 wait complete. 2023-10-14T10:35:22.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.373+0000 7fd0b1392740 20 client.5373 trim_cache size 0 max 16384 2023-10-14T10:35:22.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.390+0000 7fd0b1392740 1 Processor -- start 2023-10-14T10:35:22.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.390+0000 7fd0b1392740 1 -- start start 2023-10-14T10:35:22.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0b1392740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d0880 0x5561b91c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0b1392740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 0x5561b9190530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0b1392740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91e3180 0x5561b9190a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0b1392740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b8e5ff20 con 0x5561b91d39f0 2023-10-14T10:35:22.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0b1392740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b90baf10 con 0x5561b91e3180 2023-10-14T10:35:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0b1392740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561b91ce910 con 0x5561b91d0880 2023-10-14T10:35:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0a77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 0x5561b9190530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0a77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 0x5561b9190530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53734/0 (socket says 172.21.15.8:53734) 2023-10-14T10:35:22.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0a77fe640 1 -- 172.21.15.8:0/1156036258 learned_addr learned my addr 172.21.15.8:0/1156036258 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0a77fe640 1 -- 172.21.15.8:0/1156036258 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d0880 msgr2=0x5561b91c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/1156036258 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d0880 0x5561b91c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0a77fe640 1 -- 172.21.15.8:0/1156036258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91e3180 msgr2=0x5561b9190a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:22.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/1156036258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91e3180 0x5561b9190a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.391+0000 7fd0a77fe640 1 -- 172.21.15.8:0/1156036258 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561b9098b80 con 0x5561b91d39f0 2023-10-14T10:35:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.392+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/1156036258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 0x5561b9190530 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd090007e10 tx=0x7fd09001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61357591749edade server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.392+0000 7fd09e7fc640 1 -- 172.21.15.8:0/1156036258 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090007180 con 0x5561b91d39f0 2023-10-14T10:35:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.392+0000 7fd09e7fc640 1 -- 172.21.15.8:0/1156036258 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09000b040 con 0x5561b91d39f0 2023-10-14T10:35:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.392+0000 7fd09e7fc640 1 -- 172.21.15.8:0/1156036258 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090007370 con 0x5561b91d39f0 2023-10-14T10:35:22.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.392+0000 7fd0b1392740 1 -- 172.21.15.8:0/1156036258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 msgr2=0x5561b9190530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:22.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.392+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1156036258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 0x5561b9190530 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd090007e10 tx=0x7fd09001e000 comp rx=0 tx=0).stop 2023-10-14T10:35:22.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.393+0000 7fd0b1392740 1 -- 172.21.15.8:0/1156036258 shutdown_connections 2023-10-14T10:35:22.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.393+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1156036258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91e3180 0x5561b9190a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.393+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1156036258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d39f0 0x5561b9190530 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.393+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1156036258 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91d0880 0x5561b91c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.393+0000 7fd0b1392740 1 -- 172.21.15.8:0/1156036258 >> 172.21.15.8:0/1156036258 conn(0x5561b9196c20 msgr2=0x5561b918b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.393+0000 7fd0b1392740 1 -- 172.21.15.8:0/1156036258 shutdown_connections 2023-10-14T10:35:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.393+0000 7fd0b1392740 1 -- 172.21.15.8:0/1156036258 wait complete. 2023-10-14T10:35:22.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.393+0000 7fd0b1392740 1 -- start start 2023-10-14T10:35:22.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.394+0000 7fd0b1392740 1 Processor -- start 2023-10-14T10:35:22.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0b1392740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d0880 0x5561b91d2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0b1392740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91d39f0 0x5561b918f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0b1392740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91e3180 0x5561b918f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0b1392740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b91c81d0 con 0x5561b91d0880 2023-10-14T10:35:22.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0b1392740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561b91e22d0 con 0x5561b91d39f0 2023-10-14T10:35:22.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0b1392740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561b91c7fc0 con 0x5561b91e3180 2023-10-14T10:35:22.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0b1392740 10 client.0 _ll_register_callbacks cb 0x5561b91d1840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:35:22.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0a7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d0880 0x5561b91d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0a7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d0880 0x5561b91d2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53736/0 (socket says 172.21.15.8:53736) 2023-10-14T10:35:22.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0a7fff640 1 -- 172.21.15.8:0/1897456453 learned_addr learned my addr 172.21.15.8:0/1897456453 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:22.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91d39f0 0x5561b918f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0a7fff640 1 -- 172.21.15.8:0/1897456453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91e3180 msgr2=0x5561b918f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:22.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0a7fff640 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91e3180 0x5561b918f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0a7fff640 1 -- 172.21.15.8:0/1897456453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91d39f0 msgr2=0x5561b918f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:22.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0a7fff640 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91d39f0 0x5561b918f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0a7fff640 1 -- 172.21.15.8:0/1897456453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561b90f9da0 con 0x5561b91d0880 2023-10-14T10:35:22.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.395+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91d39f0 0x5561b918f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:22.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.396+0000 7fd0a7fff640 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d0880 0x5561b91d2060 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd09802be60 tx=0x7fd098004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58196ea27b31b31 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:22.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.396+0000 7fd086ffd640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:35:22.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.396+0000 7fd086ffd640 1 -- 172.21.15.8:0/1897456453 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098053040 con 0x5561b91d0880 2023-10-14T10:35:22.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.396+0000 7fd086ffd640 1 -- 172.21.15.8:0/1897456453 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd098056540 con 0x5561b91d0880 2023-10-14T10:35:22.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.396+0000 7fd0b1392740 1 -- 172.21.15.8:0/1897456453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0900018b0 con 0x5561b91d0880 2023-10-14T10:35:22.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.396+0000 7fd086ffd640 1 -- 172.21.15.8:0/1897456453 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd09802cea0 con 0x5561b91d0880 2023-10-14T10:35:22.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.396+0000 7fd0b1392740 10 client.5379 fetch_fsmap learned FSMap version 17 2023-10-14T10:35:22.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.396+0000 7fd0b1392740 1 -- 172.21.15.8:0/1897456453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5561b90be170 con 0x5561b91d0880 2023-10-14T10:35:22.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.397+0000 7fd086ffd640 1 -- 172.21.15.8:0/1897456453 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0900018b0 con 0x5561b91d0880 2023-10-14T10:35:22.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.397+0000 7fd086ffd640 1 -- 172.21.15.8:0/1897456453 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fd098056050 con 0x5561b91d0880 2023-10-14T10:35:22.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.397+0000 7fd0b1392740 10 client.5379 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:35:22.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.397+0000 7fd0b1392740 10 client.5379 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:35:22.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.397+0000 7fd0b1392740 20 client.5379 populate_metadata read hostname 'smithi008' 2023-10-14T10:35:22.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.397+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5561b91b4be0 0x5561b91b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:22.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.397+0000 7fd0b1392740 4 client.5379 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T10:35:22.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.397+0000 7fd0b1392740 1 -- 172.21.15.8:0/1897456453 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5561b90f4700 con 0x5561b91b4be0 2023-10-14T10:35:22.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.397+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5561b91b4be0 0x5561b91b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:22.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd0a77fe640 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5561b91b4be0 0x5561b91b4fc0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f733d9e1fd7f7108 server_cookie=6b5741812dbfa8a3 in_seq=0 out_seq=0 2023-10-14T10:35:22.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd086ffd640 10 client.5379 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:22.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd086ffd640 1 -- 172.21.15.8:0/1897456453 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5561b90f4700 con 0x5561b91b4be0 2023-10-14T10:35:22.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd086ffd640 10 client.5379 handle_command_reply: tid=0 2023-10-14T10:35:22.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd0b1392740 1 client.5379 shutdown 2023-10-14T10:35:22.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd0b1392740 1 -- 172.21.15.8:0/1897456453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d0880 msgr2=0x5561b91d2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:22.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d0880 0x5561b91d2060 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd09802be60 tx=0x7fd098004a40 comp rx=0 tx=0).stop 2023-10-14T10:35:22.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd0b1392740 1 -- 172.21.15.8:0/1897456453 shutdown_connections 2023-10-14T10:35:22.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x5561b91b4be0 0x5561b91b4fc0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5561b91e3180 0x5561b918f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561b91d39f0 0x5561b918f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd086ffd640 0 client.5379 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:22.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd0b1392740 1 --2- 172.21.15.8:0/1897456453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5561b91d0880 0x5561b91d2060 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd0b1392740 1 -- 172.21.15.8:0/1897456453 >> 172.21.15.8:0/1897456453 conn(0x5561b9196c20 msgr2=0x5561b91c7460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:22.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.398+0000 7fd0b1392740 1 -- 172.21.15.8:0/1897456453 shutdown_connections 2023-10-14T10:35:22.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.399+0000 7fd0b1392740 1 -- 172.21.15.8:0/1897456453 wait complete. 2023-10-14T10:35:22.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.399+0000 7fd0b1392740 20 client.5379 trim_cache size 0 max 16384 2023-10-14T10:35:22.413 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:22.414 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "452b10b4-f8ad-4e99-85d0-4d157f344356", 2023-10-14T10:35:22.414 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-14T10:35:22.414 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5052, 2023-10-14T10:35:22.414 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-14T10:35:22.414 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-14T10:35:22.415 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "testcephfs1", 2023-10-14T10:35:22.415 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 33.921985868, 2023-10-14T10:35:22.415 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 17, 2023-10-14T10:35:22.415 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 34, 2023-10-14T10:35:22.415 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 34, 2023-10-14T10:35:22.416 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 43.139534253999997 2023-10-14T10:35:22.416 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:22.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.399+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/2713777289 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd08806ae70 msgr2=0x7fd08806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:22.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.399+0000 7fd0ad4c3640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd08806ae70 0x7fd08806d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd098036000 tx=0x7fd098030000 comp rx=0 tx=0).stop 2023-10-14T10:35:22.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.399+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/2713777289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0a815b940 msgr2=0x7fd0a81214c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:22.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.399+0000 7fd0ad4c3640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0a815b940 0x7fd0a81214c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000c410 tx=0x7fd0a000c8d0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.399+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/2713777289 shutdown_connections 2023-10-14T10:35:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.399+0000 7fd0ad4c3640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fd08806ae70 0x7fd08806d330 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.399+0000 7fd0ad4c3640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0a815b940 0x7fd0a81214c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.399+0000 7fd0ad4c3640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a8155a80 0x7fd0a80bb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.399+0000 7fd0ad4c3640 1 --2- 172.21.15.8:0/2713777289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a80ba3e0 0x7fd0a81f12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:22.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.399+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/2713777289 >> 172.21.15.8:0/2713777289 conn(0x7fd0a806a200 msgr2=0x7fd0a8152b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:22.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.400+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/2713777289 shutdown_connections 2023-10-14T10:35:22.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:22.400+0000 7fd0ad4c3640 1 -- 172.21.15.8:0/2713777289 wait complete. 2023-10-14T10:35:22.420 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T10:34:47.550249+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5052": { "addr": "172.21.15.8:6837/799022047", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6836", "nonce": 799022047, "type": "v2" }, { "addr": "172.21.15.8:6837", "nonce": 799022047, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5052, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T10:34:50.997788+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5052 } } } ], "standbys": [ { "addr": "172.21.15.8:6835/1474692193", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6834", "nonce": 1474692193, "type": "v2" }, { "addr": "172.21.15.8:6835", "nonce": 1474692193, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4532, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6835/2045070429", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6833", "nonce": 2045070429, "type": "v2" }, { "addr": "172.21.15.92:6835", "nonce": 2045070429, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4538, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6834/337485030", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6832", "nonce": 337485030, "type": "v2" }, { "addr": "172.21.15.92:6834", "nonce": 337485030, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4726, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T10:35:22.421 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': 2, 'name': 'a', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T10:35:22.421 INFO:tasks.cephfs.test_failover:current = [{'gid': 4532, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.8:6835/1474692193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6834', 'nonce': 1474692193}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 1474692193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 4726, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6834/337485030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 337485030}, {'type': 'v1', 'addr': '172.21.15.92:6834', 'nonce': 337485030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 4538, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6835/2045070429', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6833', 'nonce': 2045070429}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2045070429}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T10:35:22.422 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T10:35:22.422 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-14T10:35:27.424 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:35:27.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.651+0000 7f98f3739640 1 Processor -- start 2023-10-14T10:35:27.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.651+0000 7f98f3739640 1 -- start start 2023-10-14T10:35:27.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.653+0000 7f98f3739640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec14e640 0x7f98ec154d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:27.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.653+0000 7f98f3739640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f98ec0a84d0 0x7f98ec0a8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:27.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.653+0000 7f98f3739640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ec1552d0 con 0x7f98ec0c1720 2023-10-14T10:35:27.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.653+0000 7f98f3739640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ec0a8e80 con 0x7f98ec0a84d0 2023-10-14T10:35:27.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.653+0000 7f98f3739640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec0c1cc0 con 0x7f98ec14e640 2023-10-14T10:35:27.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.653+0000 7f98f14d5640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec14e640 0x7f98ec154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.653+0000 7f98f14d5640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec14e640 0x7f98ec154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:60546/0 (socket says 172.21.15.8:60546) 2023-10-14T10:35:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.653+0000 7f98f14d5640 1 -- 172.21.15.8:0/1110137294 learned_addr learned my addr 172.21.15.8:0/1110137294 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.653+0000 7f98f1cd6640 1 --2- 172.21.15.8:0/1110137294 >> v2:172.21.15.92:3300/0 conn(0x7f98ec0a84d0 0x7f98ec0a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.653+0000 7f98f0cd4640 1 --1- 172.21.15.8:0/1110137294 >> v1:172.21.15.92:6789/0 conn(0x7f98ec0c1720 0x7f98ec0c57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:60020/0 (socket says 172.21.15.8:60020) 2023-10-14T10:35:27.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.654+0000 7f98f14d5640 1 -- 172.21.15.8:0/1110137294 >> v2:172.21.15.92:3300/0 conn(0x7f98ec0a84d0 msgr2=0x7f98ec0a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:27.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.654+0000 7f98f14d5640 1 --2- 172.21.15.8:0/1110137294 >> v2:172.21.15.92:3300/0 conn(0x7f98ec0a84d0 0x7f98ec0a8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:27.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.654+0000 7f98f14d5640 1 -- 172.21.15.8:0/1110137294 >> v1:172.21.15.92:6789/0 conn(0x7f98ec0c1720 legacy=0x7f98ec0c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:27.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.654+0000 7f98f14d5640 1 -- 172.21.15.8:0/1110137294 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec06cce0 con 0x7f98ec14e640 2023-10-14T10:35:27.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.656+0000 7f98f14d5640 1 --2- 172.21.15.8:0/1110137294 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec14e640 0x7f98ec154d90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009870 tx=0x7f98e802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3d8989752b467f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:27.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.656+0000 7f98e3fff640 1 -- 172.21.15.8:0/1110137294 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8030840 con 0x7f98ec14e640 2023-10-14T10:35:27.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.656+0000 7f98e3fff640 1 -- 172.21.15.8:0/1110137294 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e80309a0 con 0x7f98ec14e640 2023-10-14T10:35:27.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.656+0000 7f98e3fff640 1 -- 172.21.15.8:0/1110137294 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8030d30 con 0x7f98ec14e640 2023-10-14T10:35:27.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.657+0000 7f98f3739640 1 -- 172.21.15.8:0/1110137294 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec14e640 msgr2=0x7f98ec154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:27.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.657+0000 7f98f3739640 1 --2- 172.21.15.8:0/1110137294 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec14e640 0x7f98ec154d90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009870 tx=0x7f98e802b980 comp rx=0 tx=0).stop 2023-10-14T10:35:27.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.657+0000 7f98f3739640 1 -- 172.21.15.8:0/1110137294 shutdown_connections 2023-10-14T10:35:27.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.657+0000 7f98f3739640 1 --2- 172.21.15.8:0/1110137294 >> v2:172.21.15.92:3300/0 conn(0x7f98ec0a84d0 0x7f98ec0a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:27.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.657+0000 7f98f3739640 1 --2- 172.21.15.8:0/1110137294 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec14e640 0x7f98ec154d90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:27.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.657+0000 7f98f3739640 1 -- 172.21.15.8:0/1110137294 >> 172.21.15.8:0/1110137294 conn(0x7f98ec0a74d0 msgr2=0x7f98ec0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:27.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.657+0000 7f98f3739640 1 -- 172.21.15.8:0/1110137294 shutdown_connections 2023-10-14T10:35:27.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.657+0000 7f98f3739640 1 -- 172.21.15.8:0/1110137294 wait complete. 2023-10-14T10:35:27.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.659+0000 7f98f3739640 1 Processor -- start 2023-10-14T10:35:27.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.659+0000 7f98f3739640 1 -- start start 2023-10-14T10:35:27.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.660+0000 7f98f3739640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98ec0a84d0 0x7f98ec152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:27.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.660+0000 7f98f3739640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98ec0c1720 0x7f98ec0bf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:27.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.660+0000 7f98f3739640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec14e640 0x7f98ec1ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:27.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.660+0000 7f98f3739640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec153d40 con 0x7f98ec0c1720 2023-10-14T10:35:27.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.660+0000 7f98f3739640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec14f030 con 0x7f98ec0a84d0 2023-10-14T10:35:27.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.660+0000 7f98f3739640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec151d10 con 0x7f98ec14e640 2023-10-14T10:35:27.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.660+0000 7f98f0cd4640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98ec0c1720 0x7f98ec0bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:27.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.660+0000 7f98f0cd4640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98ec0c1720 0x7f98ec0bf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54112/0 (socket says 172.21.15.8:54112) 2023-10-14T10:35:27.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.660+0000 7f98f0cd4640 1 -- 172.21.15.8:0/386462013 learned_addr learned my addr 172.21.15.8:0/386462013 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:27.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.660+0000 7f98f1cd6640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec14e640 0x7f98ec1ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:27.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.661+0000 7f98f0cd4640 1 -- 172.21.15.8:0/386462013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec14e640 msgr2=0x7f98ec1ed180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:27.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.661+0000 7f98f14d5640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98ec0a84d0 0x7f98ec152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:27.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.661+0000 7f98f0cd4640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec14e640 0x7f98ec1ed180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:27.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.661+0000 7f98f0cd4640 1 -- 172.21.15.8:0/386462013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98ec0a84d0 msgr2=0x7f98ec152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:27.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.661+0000 7f98f0cd4640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98ec0a84d0 0x7f98ec152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:27.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.661+0000 7f98f0cd4640 1 -- 172.21.15.8:0/386462013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80094d0 con 0x7f98ec0c1720 2023-10-14T10:35:27.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.661+0000 7f98f14d5640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98ec0a84d0 0x7f98ec152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:27.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.661+0000 7f98f0cd4640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98ec0c1720 0x7f98ec0bf550 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00c7d0 tx=0x7f98dc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:27.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.661+0000 7f98e1ffb640 1 -- 172.21.15.8:0/386462013 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc00a640 con 0x7f98ec0c1720 2023-10-14T10:35:27.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.661+0000 7f98e1ffb640 1 -- 172.21.15.8:0/386462013 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc00a7a0 con 0x7f98ec0c1720 2023-10-14T10:35:27.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.661+0000 7f98e1ffb640 1 -- 172.21.15.8:0/386462013 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc00ab10 con 0x7f98ec0c1720 2023-10-14T10:35:27.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.661+0000 7f98f3739640 1 -- 172.21.15.8:0/386462013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ec1eccf0 con 0x7f98ec0c1720 2023-10-14T10:35:27.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.662+0000 7f98f3739640 1 -- 172.21.15.8:0/386462013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec1526c0 con 0x7f98ec0c1720 2023-10-14T10:35:27.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.663+0000 7f98f3739640 1 -- 172.21.15.8:0/386462013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ec1ece80 con 0x7f98ec0c1720 2023-10-14T10:35:27.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.664+0000 7f98e1ffb640 1 -- 172.21.15.8:0/386462013 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f98dc00ac70 con 0x7f98ec0c1720 2023-10-14T10:35:27.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.665+0000 7f98e1ffb640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f98d006aea0 0x7f98d006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:27.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.665+0000 7f98e1ffb640 1 -- 172.21.15.8:0/386462013 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f98dc088cc0 con 0x7f98ec0c1720 2023-10-14T10:35:27.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.665+0000 7f98f14d5640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f98d006aea0 0x7f98d006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:27.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.666+0000 7f98f14d5640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f98d006aea0 0x7f98d006d360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f98e8036000 tx=0x7f98e803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:27.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.670+0000 7f98e1ffb640 1 -- 172.21.15.8:0/386462013 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f98dc053e90 con 0x7f98ec0c1720 2023-10-14T10:35:27.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.907+0000 7f98f3739640 1 -- 172.21.15.8:0/386462013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98ec06cf90 con 0x7f98ec0c1720 2023-10-14T10:35:27.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.908+0000 7f98e1ffb640 1 -- 172.21.15.8:0/386462013 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f98dc017020 con 0x7f98ec0c1720 2023-10-14T10:35:27.911 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:27.911 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:35:27.911 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:35:27.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.911+0000 7f98f3739640 1 -- 172.21.15.8:0/386462013 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f98d006aea0 msgr2=0x7f98d006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:27.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.911+0000 7f98f3739640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f98d006aea0 0x7f98d006d360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f98e8036000 tx=0x7f98e803b040 comp rx=0 tx=0).stop 2023-10-14T10:35:27.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.911+0000 7f98f3739640 1 -- 172.21.15.8:0/386462013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98ec0c1720 msgr2=0x7f98ec0bf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:27.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.911+0000 7f98f3739640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98ec0c1720 0x7f98ec0bf550 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00c7d0 tx=0x7f98dc00cc90 comp rx=0 tx=0).stop 2023-10-14T10:35:27.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.911+0000 7f98f3739640 1 -- 172.21.15.8:0/386462013 shutdown_connections 2023-10-14T10:35:27.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.911+0000 7f98f3739640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f98d006aea0 0x7f98d006d360 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:27.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.911+0000 7f98f3739640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec14e640 0x7f98ec1ed180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:27.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.911+0000 7f98f3739640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98ec0c1720 0x7f98ec0bf550 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:27.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.911+0000 7f98f3739640 1 --2- 172.21.15.8:0/386462013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98ec0a84d0 0x7f98ec152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:27.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.911+0000 7f98f3739640 1 -- 172.21.15.8:0/386462013 >> 172.21.15.8:0/386462013 conn(0x7f98ec0a74d0 msgr2=0x7f98ec0be850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:27.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.912+0000 7f98f3739640 1 -- 172.21.15.8:0/386462013 shutdown_connections 2023-10-14T10:35:27.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:27.912+0000 7f98f3739640 1 -- 172.21.15.8:0/386462013 wait complete. 2023-10-14T10:35:28.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T10:34:47.550249+0000', 'modified': '2023-10-14T10:34:50.997788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5052': {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T10:35:28.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T10:35:28.336 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T10:35:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.572+0000 7fb943fff640 1 Processor -- start 2023-10-14T10:35:28.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.572+0000 7fb943fff640 1 -- start start 2023-10-14T10:35:28.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.574+0000 7fb943fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb94406fb10 0x7fb9440c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.574+0000 7fb943fff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb944152ac0 con 0x7fb9440c2670 2023-10-14T10:35:28.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.574+0000 7fb943fff640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb944151eb0 con 0x7fb94413af90 2023-10-14T10:35:28.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.574+0000 7fb943fff640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb944152190 con 0x7fb94406fb10 2023-10-14T10:35:28.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.574+0000 7fb9437fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb9440c2670 0x7fb9440bfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59952/0 (socket says 172.21.15.8:59952) 2023-10-14T10:35:28.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.574+0000 7fb9437fe640 1 -- 172.21.15.8:0/1918853291 learned_addr learned my addr 172.21.15.8:0/1918853291 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:28.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb93bfff640 1 --2- 172.21.15.8:0/1918853291 >> v2:172.21.15.92:3300/0 conn(0x7fb94406fb10 0x7fb9440c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914654618 0 0) 0x7fb944152ac0 con 0x7fb9440c2670 2023-10-14T10:35:28.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb930003520 con 0x7fb9440c2670 2023-10-14T10:35:28.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3390644541 0 0) 0x7fb930003520 con 0x7fb9440c2670 2023-10-14T10:35:28.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 >> v2:172.21.15.92:3300/0 conn(0x7fb94406fb10 msgr2=0x7fb9440c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:28.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 --2- 172.21.15.8:0/1918853291 >> v2:172.21.15.92:3300/0 conn(0x7fb94406fb10 0x7fb9440c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 >> v1:172.21.15.92:6789/0 conn(0x7fb94413af90 legacy=0x7fb9440a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:28.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb944152470 con 0x7fb9440c2670 2023-10-14T10:35:28.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fb93c0019f0 con 0x7fb9440c2670 2023-10-14T10:35:28.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 >> v1:172.21.15.8:6789/0 conn(0x7fb9440c2670 legacy=0x7fb9440bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:28.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 --2- 172.21.15.8:0/1918853291 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9300039c0 0x7fb930003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 --2- 172.21.15.8:0/1918853291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9300047c0 0x7fb930004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 --2- 172.21.15.8:0/1918853291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9300052a0 0x7fb93000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb944152190 con 0x7fb9300052a0 2023-10-14T10:35:28.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93000c1c0 con 0x7fb9300047c0 2023-10-14T10:35:28.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.575+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93000c380 con 0x7fb9300039c0 2023-10-14T10:35:28.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.576+0000 7fb9437fe640 1 --2- 172.21.15.8:0/1918853291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9300052a0 0x7fb93000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.576+0000 7fb942ffd640 1 --2- 172.21.15.8:0/1918853291 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9300039c0 0x7fb930003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.576+0000 7fb93bfff640 1 --2- 172.21.15.8:0/1918853291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9300047c0 0x7fb930004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.576+0000 7fb9437fe640 1 -- 172.21.15.8:0/1918853291 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9300039c0 msgr2=0x7fb930003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:28.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.576+0000 7fb9437fe640 1 --2- 172.21.15.8:0/1918853291 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9300039c0 0x7fb930003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.576+0000 7fb9437fe640 1 -- 172.21.15.8:0/1918853291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9300047c0 msgr2=0x7fb930004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:28.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.576+0000 7fb9437fe640 1 --2- 172.21.15.8:0/1918853291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9300047c0 0x7fb930004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.576+0000 7fb9437fe640 1 -- 172.21.15.8:0/1918853291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb930003520 con 0x7fb9300052a0 2023-10-14T10:35:28.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.577+0000 7fb9437fe640 1 -- 172.21.15.8:0/1918853291 reap_dead start 2023-10-14T10:35:28.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.577+0000 7fb9437fe640 1 --2- 172.21.15.8:0/1918853291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9300052a0 0x7fb93000b980 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00a760 tx=0x7fb9300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45e29b8b2942e9f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:28.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.578+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c034630 con 0x7fb9300052a0 2023-10-14T10:35:28.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.578+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c02f070 con 0x7fb9300052a0 2023-10-14T10:35:28.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.578+0000 7fb9427fc640 1 -- 172.21.15.8:0/1918853291 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c034a10 con 0x7fb9300052a0 2023-10-14T10:35:28.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.578+0000 7fb943fff640 1 -- 172.21.15.8:0/1918853291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9300052a0 msgr2=0x7fb93000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:28.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.578+0000 7fb943fff640 1 --2- 172.21.15.8:0/1918853291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9300052a0 0x7fb93000b980 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00a760 tx=0x7fb9300057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.578+0000 7fb943fff640 1 -- 172.21.15.8:0/1918853291 shutdown_connections 2023-10-14T10:35:28.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.578+0000 7fb943fff640 1 --2- 172.21.15.8:0/1918853291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9300052a0 0x7fb93000b980 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.578+0000 7fb943fff640 1 -- 172.21.15.8:0/1918853291 >> 172.21.15.8:0/1918853291 conn(0x7fb94406a200 msgr2=0x7fb94406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:28.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.578+0000 7fb943fff640 1 -- 172.21.15.8:0/1918853291 shutdown_connections 2023-10-14T10:35:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.579+0000 7fb943fff640 1 -- 172.21.15.8:0/1918853291 wait complete. 2023-10-14T10:35:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.580+0000 7fb943fff640 1 Processor -- start 2023-10-14T10:35:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.580+0000 7fb943fff640 1 -- start start 2023-10-14T10:35:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.581+0000 7fb943fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9300052a0 0x7fb94406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.581+0000 7fb943fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9441378e0 0x7fb9441ec890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.581+0000 7fb943fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9440c46c0 0x7fb944136820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.581+0000 7fb943fff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb944155830 con 0x7fb9441378e0 2023-10-14T10:35:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.581+0000 7fb943fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9441373b0 con 0x7fb9300052a0 2023-10-14T10:35:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.581+0000 7fb943fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94406d6e0 con 0x7fb9440c46c0 2023-10-14T10:35:28.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.581+0000 7fb93bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9441378e0 0x7fb9441ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.582+0000 7fb93bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9441378e0 0x7fb9441ec890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54132/0 (socket says 172.21.15.8:54132) 2023-10-14T10:35:28.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.582+0000 7fb93bfff640 1 -- 172.21.15.8:0/3822058670 learned_addr learned my addr 172.21.15.8:0/3822058670 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:28.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.582+0000 7fb942ffd640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9300052a0 0x7fb94406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.582+0000 7fb9437fe640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9440c46c0 0x7fb944136820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.582+0000 7fb93bfff640 1 -- 172.21.15.8:0/3822058670 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9440c46c0 msgr2=0x7fb944136820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:28.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.582+0000 7fb93bfff640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9440c46c0 0x7fb944136820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.582+0000 7fb93bfff640 1 -- 172.21.15.8:0/3822058670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9300052a0 msgr2=0x7fb94406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:28.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.582+0000 7fb93bfff640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9300052a0 0x7fb94406db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.582+0000 7fb93bfff640 1 -- 172.21.15.8:0/3822058670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94406e0b0 con 0x7fb9441378e0 2023-10-14T10:35:28.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.582+0000 7fb93bfff640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9441378e0 0x7fb9441ec890 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00f510 tx=0x7fb92c00f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:28.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.583+0000 7fb93b7fe640 1 -- 172.21.15.8:0/3822058670 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c014870 con 0x7fb9441378e0 2023-10-14T10:35:28.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.583+0000 7fb93b7fe640 1 -- 172.21.15.8:0/3822058670 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c0149d0 con 0x7fb9441378e0 2023-10-14T10:35:28.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.583+0000 7fb93b7fe640 1 -- 172.21.15.8:0/3822058670 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c014d40 con 0x7fb9441378e0 2023-10-14T10:35:28.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.583+0000 7fb943fff640 1 -- 172.21.15.8:0/3822058670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb944137600 con 0x7fb9441378e0 2023-10-14T10:35:28.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.583+0000 7fb943fff640 1 -- 172.21.15.8:0/3822058670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb944155ea0 con 0x7fb9441378e0 2023-10-14T10:35:28.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.586+0000 7fb93b7fe640 1 -- 172.21.15.8:0/3822058670 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb92c015410 con 0x7fb9441378e0 2023-10-14T10:35:28.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.587+0000 7fb93b7fe640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb92406ae70 0x7fb92406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.587+0000 7fb93b7fe640 1 -- 172.21.15.8:0/3822058670 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb92c089f20 con 0x7fb9441378e0 2023-10-14T10:35:28.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.587+0000 7fb942ffd640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb92406ae70 0x7fb92406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.587+0000 7fb94c37b740 1 Processor -- start 2023-10-14T10:35:28.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.588+0000 7fb94c37b740 1 -- start start 2023-10-14T10:35:28.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.588+0000 7fb942ffd640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb92406ae70 0x7fb92406d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb934007fd0 tx=0x7fb934009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:28.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.588+0000 7fb94c37b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c1db9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.588+0000 7fb94c37b740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1a0c20 0x55d04c1dac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.588+0000 7fb94c37b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 0x55d04c19f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.589+0000 7fb94c37b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04c0ba7a0 con 0x55d04c1da880 2023-10-14T10:35:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.589+0000 7fb94c37b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04c10c740 con 0x55d04c1dd9f0 2023-10-14T10:35:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.589+0000 7fb94c37b740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d04c109e30 con 0x55d04c1a0c20 2023-10-14T10:35:28.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.589+0000 7fb942ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c1db9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.589+0000 7fb942ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c1db9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54144/0 (socket says 172.21.15.8:54144) 2023-10-14T10:35:28.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.589+0000 7fb942ffd640 1 -- 172.21.15.8:0/3394712291 learned_addr learned my addr 172.21.15.8:0/3394712291 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:28.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.589+0000 7fb942ffd640 1 -- 172.21.15.8:0/3394712291 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1a0c20 msgr2=0x55d04c1dac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:28.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.589+0000 7fb942ffd640 1 --2- 172.21.15.8:0/3394712291 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1a0c20 0x55d04c1dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.589+0000 7fb942ffd640 1 -- 172.21.15.8:0/3394712291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 msgr2=0x55d04c19f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:28.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.589+0000 7fb942ffd640 1 --2- 172.21.15.8:0/3394712291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 0x55d04c19f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.589+0000 7fb942ffd640 1 -- 172.21.15.8:0/3394712291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d04c0c9910 con 0x55d04c1da880 2023-10-14T10:35:28.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.589+0000 7fb942ffd640 1 --2- 172.21.15.8:0/3394712291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c1db9f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb93400f690 tx=0x7fb934012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdaa3d5bf09ea055 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:28.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.590+0000 7fb938ff9640 1 -- 172.21.15.8:0/3394712291 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934014820 con 0x55d04c1da880 2023-10-14T10:35:28.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.590+0000 7fb938ff9640 1 -- 172.21.15.8:0/3394712291 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93400d050 con 0x55d04c1da880 2023-10-14T10:35:28.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.590+0000 7fb938ff9640 1 -- 172.21.15.8:0/3394712291 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934014b80 con 0x55d04c1da880 2023-10-14T10:35:28.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.590+0000 7fb94c37b740 1 -- 172.21.15.8:0/3394712291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 msgr2=0x55d04c1db9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:28.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.590+0000 7fb94c37b740 1 --2- 172.21.15.8:0/3394712291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c1db9f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb93400f690 tx=0x7fb934012000 comp rx=0 tx=0).stop 2023-10-14T10:35:28.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.591+0000 7fb94c37b740 1 -- 172.21.15.8:0/3394712291 shutdown_connections 2023-10-14T10:35:28.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.591+0000 7fb94c37b740 1 --2- 172.21.15.8:0/3394712291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 0x55d04c19f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.591+0000 7fb94c37b740 1 --2- 172.21.15.8:0/3394712291 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1a0c20 0x55d04c1dac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.591+0000 7fb94c37b740 1 --2- 172.21.15.8:0/3394712291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c1db9f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.591+0000 7fb94c37b740 1 -- 172.21.15.8:0/3394712291 >> 172.21.15.8:0/3394712291 conn(0x55d04c19c260 msgr2=0x55d04c1c0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.591+0000 7fb94c37b740 1 -- 172.21.15.8:0/3394712291 shutdown_connections 2023-10-14T10:35:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.591+0000 7fb94c37b740 1 -- 172.21.15.8:0/3394712291 wait complete. 2023-10-14T10:35:28.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.591+0000 7fb94c37b740 1 -- start start 2023-10-14T10:35:28.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.592+0000 7fb94c37b740 1 Processor -- start 2023-10-14T10:35:28.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb94c37b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c1b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb94c37b740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1dd9f0 0x55d04c1d87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb94c37b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1be160 0x55d04c1bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb94c37b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04c105720 con 0x55d04c1da880 2023-10-14T10:35:28.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb94c37b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04c0a3970 con 0x55d04c1be160 2023-10-14T10:35:28.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb94c37b740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d04c0a3610 con 0x55d04c1dd9f0 2023-10-14T10:35:28.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb94c37b740 10 client.0 _ll_register_callbacks cb 0x55d04c0c59d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:35:28.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb942ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c1b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb942ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c1b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54154/0 (socket says 172.21.15.8:54154) 2023-10-14T10:35:28.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb942ffd640 1 -- 172.21.15.8:0/4009056617 learned_addr learned my addr 172.21.15.8:0/4009056617 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:28.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb9437fe640 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1be160 0x55d04c1bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb93bfff640 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1dd9f0 0x55d04c1d87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb942ffd640 1 -- 172.21.15.8:0/4009056617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1dd9f0 msgr2=0x55d04c1d87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:28.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb942ffd640 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1dd9f0 0x55d04c1d87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb942ffd640 1 -- 172.21.15.8:0/4009056617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1be160 msgr2=0x55d04c1bfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb942ffd640 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1be160 0x55d04c1bfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb942ffd640 1 -- 172.21.15.8:0/4009056617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb944151eb0 con 0x55d04c1da880 2023-10-14T10:35:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.593+0000 7fb9437fe640 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1be160 0x55d04c1bfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.594+0000 7fb942ffd640 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c1b2e70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb934023040 tx=0x7fb934001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0b188ee6ca1e15 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:28.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.594+0000 7fb921ffb640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:35:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.594+0000 7fb921ffb640 1 -- 172.21.15.8:0/4009056617 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9340075d0 con 0x55d04c1da880 2023-10-14T10:35:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.594+0000 7fb921ffb640 1 -- 172.21.15.8:0/4009056617 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb93401c040 con 0x55d04c1da880 2023-10-14T10:35:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.594+0000 7fb94c37b740 1 -- 172.21.15.8:0/4009056617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d04c12c160 con 0x55d04c1da880 2023-10-14T10:35:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.594+0000 7fb921ffb640 1 -- 172.21.15.8:0/4009056617 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb934007730 con 0x55d04c1da880 2023-10-14T10:35:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.594+0000 7fb94c37b740 10 client.5394 fetch_fsmap learned FSMap version 17 2023-10-14T10:35:28.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.594+0000 7fb94c37b740 1 -- 172.21.15.8:0/4009056617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d04c103da0 con 0x55d04c1da880 2023-10-14T10:35:28.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.595+0000 7fb921ffb640 1 -- 172.21.15.8:0/4009056617 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d04c12c160 con 0x55d04c1da880 2023-10-14T10:35:28.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.595+0000 7fb921ffb640 1 -- 172.21.15.8:0/4009056617 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fb934012070 con 0x55d04c1da880 2023-10-14T10:35:28.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.595+0000 7fb94c37b740 10 client.5394 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:35:28.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.595+0000 7fb94c37b740 10 client.5394 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:35:28.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.595+0000 7fb94c37b740 20 client.5394 populate_metadata read hostname 'smithi008' 2023-10-14T10:35:28.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.595+0000 7fb94c37b740 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55d04c1eeee0 0x55d04c1ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.595+0000 7fb94c37b740 4 client.5394 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T10:35:28.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.595+0000 7fb94c37b740 1 -- 172.21.15.8:0/4009056617 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d04c0d7cc0 con 0x55d04c1eeee0 2023-10-14T10:35:28.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.595+0000 7fb93bfff640 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55d04c1eeee0 0x55d04c1ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.596+0000 7fb93bfff640 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55d04c1eeee0 0x55d04c1ef2c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0f16da790ea21ca server_cookie=9316db48b6d42086 in_seq=0 out_seq=0 2023-10-14T10:35:28.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.596+0000 7fb921ffb640 10 client.5394 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:28.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.596+0000 7fb921ffb640 1 -- 172.21.15.8:0/4009056617 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d04c0d7cc0 con 0x55d04c1eeee0 2023-10-14T10:35:28.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.596+0000 7fb921ffb640 10 client.5394 handle_command_reply: tid=0 2023-10-14T10:35:28.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.596+0000 7fb94c37b740 1 client.5394 shutdown 2023-10-14T10:35:28.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.597+0000 7fb94c37b740 1 -- 172.21.15.8:0/4009056617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 msgr2=0x55d04c1b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:28.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.597+0000 7fb94c37b740 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c1b2e70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb934023040 tx=0x7fb934001190 comp rx=0 tx=0).stop 2023-10-14T10:35:28.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.597+0000 7fb94c37b740 1 -- 172.21.15.8:0/4009056617 shutdown_connections 2023-10-14T10:35:28.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.597+0000 7fb94c37b740 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55d04c1eeee0 0x55d04c1ef2c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.597+0000 7fb94c37b740 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1be160 0x55d04c1bfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.597+0000 7fb94c37b740 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1dd9f0 0x55d04c1d87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.597+0000 7fb94c37b740 1 --2- 172.21.15.8:0/4009056617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c1b2e70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.597+0000 7fb921ffb640 0 client.5394 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:28.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.597+0000 7fb94c37b740 1 -- 172.21.15.8:0/4009056617 >> 172.21.15.8:0/4009056617 conn(0x55d04c1a0c20 msgr2=0x55d04c1990f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:28.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.597+0000 7fb94c37b740 1 -- 172.21.15.8:0/4009056617 shutdown_connections 2023-10-14T10:35:28.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.597+0000 7fb94c37b740 1 -- 172.21.15.8:0/4009056617 wait complete. 2023-10-14T10:35:28.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.597+0000 7fb94c37b740 20 client.5394 trim_cache size 0 max 16384 2023-10-14T10:35:28.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.614+0000 7fb94c37b740 1 Processor -- start 2023-10-14T10:35:28.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.614+0000 7fb94c37b740 1 -- start start 2023-10-14T10:35:28.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb94c37b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1be160 0x55d04c1d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb94c37b740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1da880 0x55d04c1eb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb94c37b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 0x55d04c1ebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb94c37b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04be69f20 con 0x55d04c1be160 2023-10-14T10:35:28.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb94c37b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04c19c9f0 con 0x55d04c1dd9f0 2023-10-14T10:35:28.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb94c37b740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d04c0d2880 con 0x55d04c1da880 2023-10-14T10:35:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb942ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1be160 0x55d04c1d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb942ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1be160 0x55d04c1d3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54164/0 (socket says 172.21.15.8:54164) 2023-10-14T10:35:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb942ffd640 1 -- 172.21.15.8:0/3739998146 learned_addr learned my addr 172.21.15.8:0/3739998146 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb942ffd640 1 -- 172.21.15.8:0/3739998146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1da880 msgr2=0x55d04c1eb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb942ffd640 1 --2- 172.21.15.8:0/3739998146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1da880 0x55d04c1eb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb942ffd640 1 -- 172.21.15.8:0/3739998146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 msgr2=0x55d04c1ebdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:28.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb942ffd640 1 --2- 172.21.15.8:0/3739998146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 0x55d04c1ebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.615+0000 7fb942ffd640 1 -- 172.21.15.8:0/3739998146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d04c0a2b80 con 0x55d04c1be160 2023-10-14T10:35:28.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.616+0000 7fb942ffd640 1 --2- 172.21.15.8:0/3739998146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1be160 0x55d04c1d3160 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb9340144d0 tx=0x7fb93402b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcecbed1c2176daf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:28.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.616+0000 7fb9397fa640 1 -- 172.21.15.8:0/3739998146 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93400f560 con 0x55d04c1be160 2023-10-14T10:35:28.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.616+0000 7fb9397fa640 1 -- 172.21.15.8:0/3739998146 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9340073d0 con 0x55d04c1be160 2023-10-14T10:35:28.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.616+0000 7fb9397fa640 1 -- 172.21.15.8:0/3739998146 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9340077a0 con 0x55d04c1be160 2023-10-14T10:35:28.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.616+0000 7fb94c37b740 1 -- 172.21.15.8:0/3739998146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1be160 msgr2=0x55d04c1d3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:28.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.616+0000 7fb94c37b740 1 --2- 172.21.15.8:0/3739998146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1be160 0x55d04c1d3160 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb9340144d0 tx=0x7fb93402b000 comp rx=0 tx=0).stop 2023-10-14T10:35:28.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.617+0000 7fb94c37b740 1 -- 172.21.15.8:0/3739998146 shutdown_connections 2023-10-14T10:35:28.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.617+0000 7fb94c37b740 1 --2- 172.21.15.8:0/3739998146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 0x55d04c1ebdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.617+0000 7fb94c37b740 1 --2- 172.21.15.8:0/3739998146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1da880 0x55d04c1eb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.617+0000 7fb94c37b740 1 --2- 172.21.15.8:0/3739998146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1be160 0x55d04c1d3160 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.617+0000 7fb94c37b740 1 -- 172.21.15.8:0/3739998146 >> 172.21.15.8:0/3739998146 conn(0x55d04c1a0c20 msgr2=0x55d04c1dac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:28.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.617+0000 7fb94c37b740 1 -- 172.21.15.8:0/3739998146 shutdown_connections 2023-10-14T10:35:28.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.617+0000 7fb94c37b740 1 -- 172.21.15.8:0/3739998146 wait complete. 2023-10-14T10:35:28.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.617+0000 7fb94c37b740 1 -- start start 2023-10-14T10:35:28.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.617+0000 7fb94c37b740 1 Processor -- start 2023-10-14T10:35:28.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.618+0000 7fb94c37b740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1be160 0x55d04c1fa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.618+0000 7fb94c37b740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c19f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.618+0000 7fb94c37b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 0x55d04c1fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.618+0000 7fb94c37b740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04c1fe710 con 0x55d04c1da880 2023-10-14T10:35:28.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.618+0000 7fb94c37b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04c245730 con 0x55d04c1dd9f0 2023-10-14T10:35:28.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.618+0000 7fb94c37b740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d04c248370 con 0x55d04c1be160 2023-10-14T10:35:28.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb94c37b740 10 client.0 _ll_register_callbacks cb 0x7fb934023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:35:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb93bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c19f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb93bfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c19f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54168/0 (socket says 172.21.15.8:54168) 2023-10-14T10:35:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb93bfff640 1 -- 172.21.15.8:0/107144523 learned_addr learned my addr 172.21.15.8:0/107144523 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb942ffd640 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1be160 0x55d04c1fa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb9437fe640 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 0x55d04c1fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb93bfff640 1 -- 172.21.15.8:0/107144523 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1be160 msgr2=0x55d04c1fa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:28.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb93bfff640 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1be160 0x55d04c1fa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb93bfff640 1 -- 172.21.15.8:0/107144523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 msgr2=0x55d04c1fd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:28.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb93bfff640 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 0x55d04c1fd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb93bfff640 1 -- 172.21.15.8:0/107144523 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d04c103da0 con 0x55d04c1da880 2023-10-14T10:35:28.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb9437fe640 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 0x55d04c1fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:28.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.619+0000 7fb942ffd640 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1be160 0x55d04c1fa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:28.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.620+0000 7fb93bfff640 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c19f930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb92c058bf0 tx=0x7fb92c05ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6961e3578e692b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:28.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.620+0000 7fb921ffb640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:35:28.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.620+0000 7fb921ffb640 1 -- 172.21.15.8:0/107144523 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c055370 con 0x55d04c1da880 2023-10-14T10:35:28.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.620+0000 7fb921ffb640 1 -- 172.21.15.8:0/107144523 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb92c0554d0 con 0x55d04c1da880 2023-10-14T10:35:28.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.620+0000 7fb94c37b740 1 -- 172.21.15.8:0/107144523 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb93400d050 con 0x55d04c1da880 2023-10-14T10:35:28.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.620+0000 7fb921ffb640 1 -- 172.21.15.8:0/107144523 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb92c058150 con 0x55d04c1da880 2023-10-14T10:35:28.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.620+0000 7fb94c37b740 10 client.5400 fetch_fsmap learned FSMap version 17 2023-10-14T10:35:28.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.620+0000 7fb94c37b740 1 -- 172.21.15.8:0/107144523 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d04c0c8170 con 0x55d04c1da880 2023-10-14T10:35:28.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.620+0000 7fb921ffb640 1 -- 172.21.15.8:0/107144523 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93400d050 con 0x55d04c1da880 2023-10-14T10:35:28.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.620+0000 7fb921ffb640 1 -- 172.21.15.8:0/107144523 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fb92c060ad0 con 0x55d04c1da880 2023-10-14T10:35:28.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.621+0000 7fb94c37b740 10 client.5400 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:35:28.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.621+0000 7fb94c37b740 10 client.5400 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:35:28.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.621+0000 7fb94c37b740 20 client.5400 populate_metadata read hostname 'smithi008' 2023-10-14T10:35:28.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.621+0000 7fb94c37b740 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55d04c1fdd00 0x55d04c1be970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:28.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.621+0000 7fb94c37b740 4 client.5400 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T10:35:28.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.621+0000 7fb94c37b740 1 -- 172.21.15.8:0/107144523 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d04c0fe700 con 0x55d04c1fdd00 2023-10-14T10:35:28.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.621+0000 7fb942ffd640 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55d04c1fdd00 0x55d04c1be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:28.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb942ffd640 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55d04c1fdd00 0x55d04c1be970 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70410986baae4fc4 server_cookie=6c8aff9d00fcf1f7 in_seq=0 out_seq=0 2023-10-14T10:35:28.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb921ffb640 10 client.5400 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:28.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb921ffb640 1 -- 172.21.15.8:0/107144523 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x55d04c0fe700 con 0x55d04c1fdd00 2023-10-14T10:35:28.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb921ffb640 10 client.5400 handle_command_reply: tid=0 2023-10-14T10:35:28.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb94c37b740 1 client.5400 shutdown 2023-10-14T10:35:28.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb94c37b740 1 -- 172.21.15.8:0/107144523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 msgr2=0x55d04c19f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:28.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb94c37b740 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c19f930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb92c058bf0 tx=0x7fb92c05ce70 comp rx=0 tx=0).stop 2023-10-14T10:35:28.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb94c37b740 1 -- 172.21.15.8:0/107144523 shutdown_connections 2023-10-14T10:35:28.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb94c37b740 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x55d04c1fdd00 0x55d04c1be970 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb94c37b740 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d04c1dd9f0 0x55d04c1fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb94c37b740 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d04c1da880 0x55d04c19f930 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb94c37b740 1 --2- 172.21.15.8:0/107144523 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55d04c1be160 0x55d04c1fa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb921ffb640 0 client.5400 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:28.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb94c37b740 1 -- 172.21.15.8:0/107144523 >> 172.21.15.8:0/107144523 conn(0x55d04c1a0c20 msgr2=0x55d04c1d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:28.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb94c37b740 1 -- 172.21.15.8:0/107144523 shutdown_connections 2023-10-14T10:35:28.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.622+0000 7fb94c37b740 1 -- 172.21.15.8:0/107144523 wait complete. 2023-10-14T10:35:28.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb94c37b740 20 client.5400 trim_cache size 0 max 16384 2023-10-14T10:35:28.644 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:28.644 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "452b10b4-f8ad-4e99-85d0-4d157f344356", 2023-10-14T10:35:28.644 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-14T10:35:28.644 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5052, 2023-10-14T10:35:28.644 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-14T10:35:28.645 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-14T10:35:28.645 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "testcephfs1", 2023-10-14T10:35:28.645 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 40.145960842999997, 2023-10-14T10:35:28.645 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 17, 2023-10-14T10:35:28.645 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 34, 2023-10-14T10:35:28.646 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 34, 2023-10-14T10:35:28.646 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 49.363509407000002 2023-10-14T10:35:28.646 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:28.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb943fff640 1 -- 172.21.15.8:0/3822058670 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb92406ae70 msgr2=0x7fb92406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:28.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb943fff640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb92406ae70 0x7fb92406d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb934007fd0 tx=0x7fb934009040 comp rx=0 tx=0).stop 2023-10-14T10:35:28.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb943fff640 1 -- 172.21.15.8:0/3822058670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9441378e0 msgr2=0x7fb9441ec890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:28.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb943fff640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9441378e0 0x7fb9441ec890 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00f510 tx=0x7fb92c00f9d0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb943fff640 1 -- 172.21.15.8:0/3822058670 shutdown_connections 2023-10-14T10:35:28.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb943fff640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb92406ae70 0x7fb92406d330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb943fff640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9440c46c0 0x7fb944136820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb943fff640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9441378e0 0x7fb9441ec890 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb943fff640 1 --2- 172.21.15.8:0/3822058670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9300052a0 0x7fb94406db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:28.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb943fff640 1 -- 172.21.15.8:0/3822058670 >> 172.21.15.8:0/3822058670 conn(0x7fb94406a200 msgr2=0x7fb944150720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:28.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb943fff640 1 -- 172.21.15.8:0/3822058670 shutdown_connections 2023-10-14T10:35:28.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:28.623+0000 7fb943fff640 1 -- 172.21.15.8:0/3822058670 wait complete. 2023-10-14T10:35:28.650 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T10:34:47.550249+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5052": { "addr": "172.21.15.8:6837/799022047", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6836", "nonce": 799022047, "type": "v2" }, { "addr": "172.21.15.8:6837", "nonce": 799022047, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5052, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T10:34:50.997788+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5052 } } } ], "standbys": [ { "addr": "172.21.15.8:6835/1474692193", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6834", "nonce": 1474692193, "type": "v2" }, { "addr": "172.21.15.8:6835", "nonce": 1474692193, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4532, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6835/2045070429", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6833", "nonce": 2045070429, "type": "v2" }, { "addr": "172.21.15.92:6835", "nonce": 2045070429, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4538, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6834/337485030", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6832", "nonce": 337485030, "type": "v2" }, { "addr": "172.21.15.92:6834", "nonce": 337485030, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4726, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T10:35:28.651 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': 2, 'name': 'a', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T10:35:28.652 INFO:tasks.cephfs.test_failover:current = [{'gid': 4532, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.8:6835/1474692193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6834', 'nonce': 1474692193}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 1474692193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 4726, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6834/337485030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 337485030}, {'type': 'v1', 'addr': '172.21.15.92:6834', 'nonce': 337485030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 4538, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6835/2045070429', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6833', 'nonce': 2045070429}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2045070429}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T10:35:28.652 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T10:35:28.652 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-14T10:35:33.653 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:35:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.889+0000 7f2dbda9b640 1 Processor -- start 2023-10-14T10:35:33.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.889+0000 7f2dbda9b640 1 -- start start 2023-10-14T10:35:33.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.891+0000 7f2dbda9b640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2db80c1720 0x7f2db8154d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:33.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.891+0000 7f2dbda9b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2db80a84d0 0x7f2db80a8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:33.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.891+0000 7f2dbda9b640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db81552d0 con 0x7f2db814e640 2023-10-14T10:35:33.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.891+0000 7f2dbda9b640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db80c1cc0 con 0x7f2db80c1720 2023-10-14T10:35:33.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.891+0000 7f2dbda9b640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db80a8e40 con 0x7f2db80a84d0 2023-10-14T10:35:33.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.891+0000 7f2daffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2db80c1720 0x7f2db8154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:33.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.891+0000 7f2daffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2db80c1720 0x7f2db8154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54180/0 (socket says 172.21.15.8:54180) 2023-10-14T10:35:33.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.891+0000 7f2daffff640 1 -- 172.21.15.8:0/1825459620 learned_addr learned my addr 172.21.15.8:0/1825459620 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.892+0000 7f2db7fff640 1 --2- 172.21.15.8:0/1825459620 >> v2:172.21.15.92:3300/0 conn(0x7f2db80a84d0 0x7f2db80a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.892+0000 7f2daffff640 1 -- 172.21.15.8:0/1825459620 >> v2:172.21.15.92:3300/0 conn(0x7f2db80a84d0 msgr2=0x7f2db80a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:33.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.892+0000 7f2daffff640 1 --2- 172.21.15.8:0/1825459620 >> v2:172.21.15.92:3300/0 conn(0x7f2db80a84d0 0x7f2db80a8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:33.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.892+0000 7f2daffff640 1 -- 172.21.15.8:0/1825459620 >> v1:172.21.15.8:6789/0 conn(0x7f2db814e640 legacy=0x7f2db80c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:33.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.892+0000 7f2daffff640 1 -- 172.21.15.8:0/1825459620 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db806cce0 con 0x7f2db80c1720 2023-10-14T10:35:33.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.893+0000 7f2daffff640 1 --2- 172.21.15.8:0/1825459620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80c1720 0x7f2db8154d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2db806fd50 tx=0x7f2da002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab398537edcee703 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:33.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.893+0000 7f2db6ffd640 1 -- 172.21.15.8:0/1825459620 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da002cb10 con 0x7f2db80c1720 2023-10-14T10:35:33.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.893+0000 7f2db6ffd640 1 -- 172.21.15.8:0/1825459620 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da002cc70 con 0x7f2db80c1720 2023-10-14T10:35:33.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.893+0000 7f2db6ffd640 1 -- 172.21.15.8:0/1825459620 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00343f0 con 0x7f2db80c1720 2023-10-14T10:35:33.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.894+0000 7f2dbda9b640 1 -- 172.21.15.8:0/1825459620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80c1720 msgr2=0x7f2db8154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:33.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.894+0000 7f2dbda9b640 1 --2- 172.21.15.8:0/1825459620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80c1720 0x7f2db8154d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2db806fd50 tx=0x7f2da002bf70 comp rx=0 tx=0).stop 2023-10-14T10:35:33.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.894+0000 7f2dbda9b640 1 -- 172.21.15.8:0/1825459620 shutdown_connections 2023-10-14T10:35:33.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.894+0000 7f2dbda9b640 1 --2- 172.21.15.8:0/1825459620 >> v2:172.21.15.92:3300/0 conn(0x7f2db80a84d0 0x7f2db80a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:33.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.894+0000 7f2dbda9b640 1 --2- 172.21.15.8:0/1825459620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80c1720 0x7f2db8154d90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:33.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.894+0000 7f2dbda9b640 1 -- 172.21.15.8:0/1825459620 >> 172.21.15.8:0/1825459620 conn(0x7f2db80a74d0 msgr2=0x7f2db80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:33.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.894+0000 7f2dbda9b640 1 -- 172.21.15.8:0/1825459620 shutdown_connections 2023-10-14T10:35:33.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.894+0000 7f2dbda9b640 1 -- 172.21.15.8:0/1825459620 wait complete. 2023-10-14T10:35:33.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.896+0000 7f2dbda9b640 1 Processor -- start 2023-10-14T10:35:33.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.896+0000 7f2dbda9b640 1 -- start start 2023-10-14T10:35:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.897+0000 7f2dbda9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80a84d0 0x7f2db8151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.897+0000 7f2dbda9b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2db80c1720 0x7f2db8151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:33.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.897+0000 7f2dbda9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2db814e640 0x7f2db814cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.897+0000 7f2dbda9b640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db814c6e0 con 0x7f2db80a84d0 2023-10-14T10:35:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.897+0000 7f2dbda9b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8150d10 con 0x7f2db814e640 2023-10-14T10:35:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.897+0000 7f2dbda9b640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db814f8a0 con 0x7f2db80c1720 2023-10-14T10:35:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.897+0000 7f2db77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80a84d0 0x7f2db8151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:33.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.897+0000 7f2db77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80a84d0 0x7f2db8151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54190/0 (socket says 172.21.15.8:54190) 2023-10-14T10:35:33.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.897+0000 7f2db77fe640 1 -- 172.21.15.8:0/26767047 learned_addr learned my addr 172.21.15.8:0/26767047 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:33.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.898+0000 7f2db7fff640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2db814e640 0x7f2db814cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:33.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.898+0000 7f2daffff640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2db80c1720 0x7f2db8151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:33.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.898+0000 7f2db77fe640 1 -- 172.21.15.8:0/26767047 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2db80c1720 msgr2=0x7f2db8151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:33.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.898+0000 7f2db77fe640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2db80c1720 0x7f2db8151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:33.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.898+0000 7f2db77fe640 1 -- 172.21.15.8:0/26767047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2db814e640 msgr2=0x7f2db814cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:33.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.898+0000 7f2db77fe640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2db814e640 0x7f2db814cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:33.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.898+0000 7f2db77fe640 1 -- 172.21.15.8:0/26767047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0009b30 con 0x7f2db80a84d0 2023-10-14T10:35:33.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.898+0000 7f2db77fe640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80a84d0 0x7f2db8151430 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2da800c3c0 tx=0x7f2da800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:33.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.898+0000 7f2db4ff9640 1 -- 172.21.15.8:0/26767047 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da80052d0 con 0x7f2db80a84d0 2023-10-14T10:35:33.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.898+0000 7f2db4ff9640 1 -- 172.21.15.8:0/26767047 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da8005430 con 0x7f2db80a84d0 2023-10-14T10:35:33.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.898+0000 7f2dbda9b640 1 -- 172.21.15.8:0/26767047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db814c090 con 0x7f2db80a84d0 2023-10-14T10:35:33.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.899+0000 7f2db4ff9640 1 -- 172.21.15.8:0/26767047 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8003830 con 0x7f2db80a84d0 2023-10-14T10:35:33.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.899+0000 7f2dbda9b640 1 -- 172.21.15.8:0/26767047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db80c0190 con 0x7f2db80a84d0 2023-10-14T10:35:33.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.900+0000 7f2dbda9b640 1 -- 172.21.15.8:0/26767047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db8073b50 con 0x7f2db80a84d0 2023-10-14T10:35:33.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.901+0000 7f2db4ff9640 1 -- 172.21.15.8:0/26767047 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2da8003990 con 0x7f2db80a84d0 2023-10-14T10:35:33.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.902+0000 7f2db4ff9640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2d9806ae70 0x7f2d9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:33.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.902+0000 7f2db4ff9640 1 -- 172.21.15.8:0/26767047 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f2da8088a70 con 0x7f2db80a84d0 2023-10-14T10:35:33.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.902+0000 7f2daffff640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2d9806ae70 0x7f2d9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:33.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.903+0000 7f2daffff640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2d9806ae70 0x7f2d9806d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2da0035000 tx=0x7f2da0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:33.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:33.907+0000 7f2db4ff9640 1 -- 172.21.15.8:0/26767047 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2da8053b90 con 0x7f2db80a84d0 2023-10-14T10:35:34.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.139+0000 7f2dbda9b640 1 -- 172.21.15.8:0/26767047 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2db80c0730 con 0x7f2db80a84d0 2023-10-14T10:35:34.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.140+0000 7f2db4ff9640 1 -- 172.21.15.8:0/26767047 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f2da8017090 con 0x7f2db80a84d0 2023-10-14T10:35:34.142 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:34.142 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:35:34.143 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:35:34.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.142+0000 7f2dbda9b640 1 -- 172.21.15.8:0/26767047 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2d9806ae70 msgr2=0x7f2d9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.142+0000 7f2dbda9b640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2d9806ae70 0x7f2d9806d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2da0035000 tx=0x7f2da0030000 comp rx=0 tx=0).stop 2023-10-14T10:35:34.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.142+0000 7f2dbda9b640 1 -- 172.21.15.8:0/26767047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80a84d0 msgr2=0x7f2db8151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.142+0000 7f2dbda9b640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80a84d0 0x7f2db8151430 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2da800c3c0 tx=0x7f2da800c880 comp rx=0 tx=0).stop 2023-10-14T10:35:34.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.143+0000 7f2dbda9b640 1 -- 172.21.15.8:0/26767047 shutdown_connections 2023-10-14T10:35:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.143+0000 7f2dbda9b640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2d9806ae70 0x7f2d9806d330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.143+0000 7f2dbda9b640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2db814e640 0x7f2db814cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.143+0000 7f2dbda9b640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2db80c1720 0x7f2db8151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.143+0000 7f2dbda9b640 1 --2- 172.21.15.8:0/26767047 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2db80a84d0 0x7f2db8151430 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.143+0000 7f2dbda9b640 1 -- 172.21.15.8:0/26767047 >> 172.21.15.8:0/26767047 conn(0x7f2db80a74d0 msgr2=0x7f2db80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:34.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.143+0000 7f2dbda9b640 1 -- 172.21.15.8:0/26767047 shutdown_connections 2023-10-14T10:35:34.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.143+0000 7f2dbda9b640 1 -- 172.21.15.8:0/26767047 wait complete. 2023-10-14T10:35:34.568 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T10:34:47.550249+0000', 'modified': '2023-10-14T10:34:50.997788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5052': {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T10:35:34.568 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T10:35:34.569 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T10:35:34.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.804+0000 7f961ffff640 1 Processor -- start 2023-10-14T10:35:34.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.804+0000 7f961ffff640 1 -- start start 2023-10-14T10:35:34.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.806+0000 7f961ffff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f96200c23a0 0x7f962014df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.807+0000 7f961ffff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9620154d90 con 0x7f96200bbf60 2023-10-14T10:35:34.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.807+0000 7f961ffff640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9620155220 con 0x7f96200aa030 2023-10-14T10:35:34.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.807+0000 7f961ffff640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96200bc3f0 con 0x7f96200c23a0 2023-10-14T10:35:34.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.807+0000 7f961e7fc640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f96200bbf60 0x7f9620150cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59974/0 (socket says 172.21.15.8:59974) 2023-10-14T10:35:34.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.807+0000 7f961e7fc640 1 -- 172.21.15.8:0/2470580016 learned_addr learned my addr 172.21.15.8:0/2470580016 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:34.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.807+0000 7f961effd640 1 --2- 172.21.15.8:0/2470580016 >> v2:172.21.15.92:3300/0 conn(0x7f96200c23a0 0x7f962014df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.807+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406641910 0 0) 0x7f9620154d90 con 0x7f96200bbf60 2023-10-14T10:35:34.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.807+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f960c003520 con 0x7f96200bbf60 2023-10-14T10:35:34.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3147244146 0 0) 0x7f960c003520 con 0x7f96200bbf60 2023-10-14T10:35:34.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 >> v2:172.21.15.92:3300/0 conn(0x7f96200c23a0 msgr2=0x7f962014df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:34.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 --2- 172.21.15.8:0/2470580016 >> v2:172.21.15.92:3300/0 conn(0x7f96200c23a0 0x7f962014df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 >> v1:172.21.15.92:6789/0 conn(0x7f96200aa030 legacy=0x7f962015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9620154460 con 0x7f96200bbf60 2023-10-14T10:35:34.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f96080019f0 con 0x7f96200bbf60 2023-10-14T10:35:34.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961effd640 1 --2- 172.21.15.8:0/2470580016 >> v2:172.21.15.92:3300/0 conn(0x7f96200c23a0 0x7f962014df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:35:34.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 >> v1:172.21.15.8:6789/0 conn(0x7f96200bbf60 legacy=0x7f9620150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 --2- 172.21.15.8:0/2470580016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 0x7f960c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 --2- 172.21.15.8:0/2470580016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f960c0047c0 0x7f960c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 --2- 172.21.15.8:0/2470580016 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f960c0052a0 0x7f960c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96200bc3f0 con 0x7f960c003970 2023-10-14T10:35:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c00c170 con 0x7f960c0047c0 2023-10-14T10:35:34.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c00c330 con 0x7f960c0052a0 2023-10-14T10:35:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.808+0000 7f961effd640 1 --2- 172.21.15.8:0/2470580016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 0x7f960c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.809+0000 7f961e7fc640 1 --2- 172.21.15.8:0/2470580016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f960c0047c0 0x7f960c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.809+0000 7f961effd640 1 -- 172.21.15.8:0/2470580016 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f960c0052a0 msgr2=0x7f960c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:34.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.809+0000 7f961effd640 1 --2- 172.21.15.8:0/2470580016 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f960c0052a0 0x7f960c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.809+0000 7f961effd640 1 -- 172.21.15.8:0/2470580016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f960c0047c0 msgr2=0x7f960c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:34.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.809+0000 7f961effd640 1 --2- 172.21.15.8:0/2470580016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f960c0047c0 0x7f960c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.809+0000 7f961effd640 1 -- 172.21.15.8:0/2470580016 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c003520 con 0x7f960c003970 2023-10-14T10:35:34.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.809+0000 7f961e7fc640 1 --2- 172.21.15.8:0/2470580016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f960c0047c0 0x7f960c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.809+0000 7f961f7fe640 1 -- 172.21.15.8:0/2470580016 reap_dead start 2023-10-14T10:35:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.810+0000 7f961effd640 1 --2- 172.21.15.8:0/2470580016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 0x7f960c003d90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9610006fd0 tx=0x7f960c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e105c117013e36 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.810+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610004230 con 0x7f960c003970 2023-10-14T10:35:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.810+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9610004390 con 0x7f960c003970 2023-10-14T10:35:34.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.810+0000 7f961dffb640 1 -- 172.21.15.8:0/2470580016 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610003830 con 0x7f960c003970 2023-10-14T10:35:34.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.811+0000 7f961ffff640 1 -- 172.21.15.8:0/2470580016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 msgr2=0x7f960c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.811+0000 7f961ffff640 1 --2- 172.21.15.8:0/2470580016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 0x7f960c003d90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9610006fd0 tx=0x7f960c0057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.811+0000 7f961ffff640 1 -- 172.21.15.8:0/2470580016 shutdown_connections 2023-10-14T10:35:34.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.811+0000 7f961ffff640 1 --2- 172.21.15.8:0/2470580016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 0x7f960c003d90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.811+0000 7f961ffff640 1 -- 172.21.15.8:0/2470580016 >> 172.21.15.8:0/2470580016 conn(0x7f962006a200 msgr2=0x7f962006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:34.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.811+0000 7f961ffff640 1 -- 172.21.15.8:0/2470580016 shutdown_connections 2023-10-14T10:35:34.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.811+0000 7f961ffff640 1 -- 172.21.15.8:0/2470580016 wait complete. 2023-10-14T10:35:34.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.813+0000 7f961ffff640 1 Processor -- start 2023-10-14T10:35:34.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.813+0000 7f961ffff640 1 -- start start 2023-10-14T10:35:34.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961ffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 0x7f96201408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961ffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f962015e780 0x7f9620140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f962006cff0 0x7f962006d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961ffff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96201607f0 con 0x7f960c003970 2023-10-14T10:35:34.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961ffff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96201601c0 con 0x7f962006cff0 2023-10-14T10:35:34.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961ffff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962014ba20 con 0x7f962015e780 2023-10-14T10:35:34.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 0x7f96201408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 0x7f96201408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54196/0 (socket says 172.21.15.8:54196) 2023-10-14T10:35:34.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961effd640 1 -- 172.21.15.8:0/1045995695 learned_addr learned my addr 172.21.15.8:0/1045995695 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:34.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961e7fc640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f962015e780 0x7f9620140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961f7fe640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f962006cff0 0x7f962006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961effd640 1 -- 172.21.15.8:0/1045995695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f962015e780 msgr2=0x7f9620140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961effd640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f962015e780 0x7f9620140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961effd640 1 -- 172.21.15.8:0/1045995695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f962006cff0 msgr2=0x7f962006d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961effd640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f962006cff0 0x7f962006d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961effd640 1 -- 172.21.15.8:0/1045995695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96201e9b10 con 0x7f960c003970 2023-10-14T10:35:34.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961f7fe640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f962006cff0 0x7f962006d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:34.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.814+0000 7f961e7fc640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f962015e780 0x7f9620140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:34.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.815+0000 7f961effd640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 0x7f96201408c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9610006fd0 tx=0x7f9610004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:34.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.815+0000 7f96177fe640 1 -- 172.21.15.8:0/1045995695 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610043600 con 0x7f960c003970 2023-10-14T10:35:34.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.815+0000 7f96177fe640 1 -- 172.21.15.8:0/1045995695 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9610043760 con 0x7f960c003970 2023-10-14T10:35:34.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.815+0000 7f96177fe640 1 -- 172.21.15.8:0/1045995695 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610043b10 con 0x7f960c003970 2023-10-14T10:35:34.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.815+0000 7f961ffff640 1 -- 172.21.15.8:0/1045995695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96201e9df0 con 0x7f960c003970 2023-10-14T10:35:34.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.815+0000 7f961ffff640 1 -- 172.21.15.8:0/1045995695 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9620141340 con 0x7f960c003970 2023-10-14T10:35:34.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.817+0000 7f96177fe640 1 -- 172.21.15.8:0/1045995695 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f96100383f0 con 0x7f960c003970 2023-10-14T10:35:34.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.818+0000 7f96177fe640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f960006ae70 0x7f960006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.818+0000 7f96177fe640 1 -- 172.21.15.8:0/1045995695 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f96100ab700 con 0x7f960c003970 2023-10-14T10:35:34.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.819+0000 7f961e7fc640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f960006ae70 0x7f960006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.819+0000 7f96283ec740 1 Processor -- start 2023-10-14T10:35:34.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.819+0000 7f96283ec740 1 -- start start 2023-10-14T10:35:34.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.820+0000 7f961e7fc640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f960006ae70 0x7f960006d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9608001b20 tx=0x7f9608009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:34.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.820+0000 7f96283ec740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db53880 0x56109db549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.820+0000 7f96283ec740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db19c20 0x56109db53c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.820+0000 7f96283ec740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 0x56109db189a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.820+0000 7f96283ec740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109da337a0 con 0x56109db569f0 2023-10-14T10:35:34.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.820+0000 7f96283ec740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109da85740 con 0x56109db19c20 2023-10-14T10:35:34.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.820+0000 7f96283ec740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x56109da82e30 con 0x56109db53880 2023-10-14T10:35:34.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.821+0000 7f961f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 0x56109db189a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.821+0000 7f961f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 0x56109db189a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54206/0 (socket says 172.21.15.8:54206) 2023-10-14T10:35:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.821+0000 7f961f7fe640 1 -- 172.21.15.8:0/968380790 learned_addr learned my addr 172.21.15.8:0/968380790 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.821+0000 7f961effd640 1 --2- 172.21.15.8:0/968380790 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db53880 0x56109db549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.821+0000 7f961e7fc640 1 --2- 172.21.15.8:0/968380790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db19c20 0x56109db53c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.821+0000 7f961f7fe640 1 -- 172.21.15.8:0/968380790 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db53880 msgr2=0x56109db549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:34.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.821+0000 7f961f7fe640 1 --2- 172.21.15.8:0/968380790 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db53880 0x56109db549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.821+0000 7f961f7fe640 1 -- 172.21.15.8:0/968380790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db19c20 msgr2=0x56109db53c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:34.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.821+0000 7f961f7fe640 1 --2- 172.21.15.8:0/968380790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db19c20 0x56109db53c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.821+0000 7f961f7fe640 1 -- 172.21.15.8:0/968380790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56109da42910 con 0x56109db569f0 2023-10-14T10:35:34.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.821+0000 7f961e7fc640 1 --2- 172.21.15.8:0/968380790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db19c20 0x56109db53c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:34.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.822+0000 7f961f7fe640 1 --2- 172.21.15.8:0/968380790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 0x56109db189a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f96200a88a0 tx=0x7f9618001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b39f26ae607575 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:34.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.822+0000 7f9614ff9640 1 -- 172.21.15.8:0/968380790 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800b070 con 0x56109db569f0 2023-10-14T10:35:34.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.822+0000 7f9614ff9640 1 -- 172.21.15.8:0/968380790 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96180074e0 con 0x56109db569f0 2023-10-14T10:35:34.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.822+0000 7f9614ff9640 1 -- 172.21.15.8:0/968380790 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96180059e0 con 0x56109db569f0 2023-10-14T10:35:34.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.822+0000 7f96283ec740 1 -- 172.21.15.8:0/968380790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 msgr2=0x56109db189a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.822+0000 7f96283ec740 1 --2- 172.21.15.8:0/968380790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 0x56109db189a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f96200a88a0 tx=0x7f9618001820 comp rx=0 tx=0).stop 2023-10-14T10:35:34.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.823+0000 7f96283ec740 1 -- 172.21.15.8:0/968380790 shutdown_connections 2023-10-14T10:35:34.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.823+0000 7f96283ec740 1 --2- 172.21.15.8:0/968380790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 0x56109db189a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.823+0000 7f96283ec740 1 --2- 172.21.15.8:0/968380790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db19c20 0x56109db53c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.823+0000 7f96283ec740 1 --2- 172.21.15.8:0/968380790 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db53880 0x56109db549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.823+0000 7f96283ec740 1 -- 172.21.15.8:0/968380790 >> 172.21.15.8:0/968380790 conn(0x56109db15260 msgr2=0x56109db39c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:34.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.823+0000 7f96283ec740 1 -- 172.21.15.8:0/968380790 shutdown_connections 2023-10-14T10:35:34.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.823+0000 7f96283ec740 1 -- 172.21.15.8:0/968380790 wait complete. 2023-10-14T10:35:34.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.823+0000 7f96283ec740 1 -- start start 2023-10-14T10:35:34.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.824+0000 7f96283ec740 1 Processor -- start 2023-10-14T10:35:34.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f96283ec740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db53880 0x56109db17910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f96283ec740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db569f0 0x56109db64b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f96283ec740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db51c80 0x56109db2b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f96283ec740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109da7e720 con 0x56109db53880 2023-10-14T10:35:34.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f96283ec740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109da1c970 con 0x56109db569f0 2023-10-14T10:35:34.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f96283ec740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x56109da1c610 con 0x56109db51c80 2023-10-14T10:35:34.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f96283ec740 10 client.0 _ll_register_callbacks cb 0x56109da3e9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:35:34.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f961effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db53880 0x56109db17910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f961effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db53880 0x56109db17910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54210/0 (socket says 172.21.15.8:54210) 2023-10-14T10:35:34.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f961effd640 1 -- 172.21.15.8:0/599958816 learned_addr learned my addr 172.21.15.8:0/599958816 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:34.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f961effd640 1 -- 172.21.15.8:0/599958816 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db51c80 msgr2=0x56109db2b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:34.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f961effd640 1 --2- 172.21.15.8:0/599958816 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db51c80 0x56109db2b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f961e7fc640 1 --2- 172.21.15.8:0/599958816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db569f0 0x56109db64b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f961effd640 1 -- 172.21.15.8:0/599958816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db569f0 msgr2=0x56109db64b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:34.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f961effd640 1 --2- 172.21.15.8:0/599958816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db569f0 0x56109db64b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.825+0000 7f961effd640 1 -- 172.21.15.8:0/599958816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9620155220 con 0x56109db53880 2023-10-14T10:35:34.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.826+0000 7f961effd640 1 --2- 172.21.15.8:0/599958816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db53880 0x56109db17910 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f961002bf50 tx=0x7f9610006e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866f7b676861f7dc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:34.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.826+0000 7f95fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:35:34.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.826+0000 7f95fdffb640 1 -- 172.21.15.8:0/599958816 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610079aa0 con 0x56109db53880 2023-10-14T10:35:34.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.826+0000 7f95fdffb640 1 -- 172.21.15.8:0/599958816 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f961007e500 con 0x56109db53880 2023-10-14T10:35:34.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.826+0000 7f96283ec740 1 -- 172.21.15.8:0/599958816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56109daa5160 con 0x56109db53880 2023-10-14T10:35:34.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.826+0000 7f95fdffb640 1 -- 172.21.15.8:0/599958816 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96100826b0 con 0x56109db53880 2023-10-14T10:35:34.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.826+0000 7f96283ec740 10 client.5421 fetch_fsmap learned FSMap version 17 2023-10-14T10:35:34.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.826+0000 7f96283ec740 1 -- 172.21.15.8:0/599958816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56109da7cda0 con 0x56109db53880 2023-10-14T10:35:34.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.826+0000 7f95fdffb640 1 -- 172.21.15.8:0/599958816 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9610095020 con 0x56109db53880 2023-10-14T10:35:34.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.827+0000 7f95fdffb640 1 -- 172.21.15.8:0/599958816 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f9610082220 con 0x56109db53880 2023-10-14T10:35:34.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.827+0000 7f96283ec740 10 client.5421 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:35:34.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.827+0000 7f96283ec740 10 client.5421 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:35:34.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.827+0000 7f96283ec740 20 client.5421 populate_metadata read hostname 'smithi008' 2023-10-14T10:35:34.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.827+0000 7f96283ec740 1 --2- 172.21.15.8:0/599958816 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x56109db2bdc0 0x56109db4f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.827+0000 7f96283ec740 4 client.5421 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T10:35:34.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.827+0000 7f96283ec740 1 -- 172.21.15.8:0/599958816 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56109da50cc0 con 0x56109db2bdc0 2023-10-14T10:35:34.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.827+0000 7f961e7fc640 1 --2- 172.21.15.8:0/599958816 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x56109db2bdc0 0x56109db4f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.828+0000 7f961e7fc640 1 --2- 172.21.15.8:0/599958816 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x56109db2bdc0 0x56109db4f910 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0267c569cc5c89 server_cookie=829a5933bc4574e5 in_seq=0 out_seq=0 2023-10-14T10:35:34.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.828+0000 7f95fdffb640 10 client.5421 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:34.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.828+0000 7f95fdffb640 1 -- 172.21.15.8:0/599958816 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56109da50cc0 con 0x56109db2bdc0 2023-10-14T10:35:34.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.828+0000 7f95fdffb640 10 client.5421 handle_command_reply: tid=0 2023-10-14T10:35:34.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.828+0000 7f96283ec740 1 client.5421 shutdown 2023-10-14T10:35:34.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.828+0000 7f96283ec740 1 -- 172.21.15.8:0/599958816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db53880 msgr2=0x56109db17910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.828+0000 7f96283ec740 1 --2- 172.21.15.8:0/599958816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db53880 0x56109db17910 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f961002bf50 tx=0x7f9610006e10 comp rx=0 tx=0).stop 2023-10-14T10:35:34.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.829+0000 7f96283ec740 1 -- 172.21.15.8:0/599958816 shutdown_connections 2023-10-14T10:35:34.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.829+0000 7f96283ec740 1 --2- 172.21.15.8:0/599958816 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x56109db2bdc0 0x56109db4f910 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.829+0000 7f96283ec740 1 --2- 172.21.15.8:0/599958816 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db51c80 0x56109db2b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.829+0000 7f96283ec740 1 --2- 172.21.15.8:0/599958816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db569f0 0x56109db64b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.829+0000 7f96283ec740 1 --2- 172.21.15.8:0/599958816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db53880 0x56109db17910 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.829+0000 7f95fdffb640 0 client.5421 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:34.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.829+0000 7f96283ec740 1 -- 172.21.15.8:0/599958816 >> 172.21.15.8:0/599958816 conn(0x56109db19c20 msgr2=0x56109db18770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:34.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.829+0000 7f96283ec740 1 -- 172.21.15.8:0/599958816 shutdown_connections 2023-10-14T10:35:34.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.829+0000 7f96283ec740 1 -- 172.21.15.8:0/599958816 wait complete. 2023-10-14T10:35:34.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.829+0000 7f96283ec740 20 client.5421 trim_cache size 0 max 16384 2023-10-14T10:35:34.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.846+0000 7f96283ec740 1 Processor -- start 2023-10-14T10:35:34.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.846+0000 7f96283ec740 1 -- start start 2023-10-14T10:35:34.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.846+0000 7f96283ec740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db51c80 0x56109db37670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f96283ec740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db53880 0x56109db54f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f96283ec740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 0x56109db18450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f96283ec740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109d7e2f20 con 0x56109db569f0 2023-10-14T10:35:34.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f96283ec740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109db15010 con 0x56109db53880 2023-10-14T10:35:34.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f96283ec740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x56109db521a0 con 0x56109db51c80 2023-10-14T10:35:34.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f961f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 0x56109db18450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f961f7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 0x56109db18450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54214/0 (socket says 172.21.15.8:54214) 2023-10-14T10:35:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f961f7fe640 1 -- 172.21.15.8:0/1384185212 learned_addr learned my addr 172.21.15.8:0/1384185212 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f961f7fe640 1 -- 172.21.15.8:0/1384185212 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db51c80 msgr2=0x56109db37670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f961f7fe640 1 --2- 172.21.15.8:0/1384185212 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db51c80 0x56109db37670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f961f7fe640 1 -- 172.21.15.8:0/1384185212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db53880 msgr2=0x56109db54f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:34.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f961f7fe640 1 --2- 172.21.15.8:0/1384185212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db53880 0x56109db54f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.847+0000 7f961f7fe640 1 -- 172.21.15.8:0/1384185212 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56109da1bb80 con 0x56109db569f0 2023-10-14T10:35:34.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.848+0000 7f961f7fe640 1 --2- 172.21.15.8:0/1384185212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 0x56109db18450 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9618012000 tx=0x7f9618010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb258c184f8edc55 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:34.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.848+0000 7f96157fa640 1 -- 172.21.15.8:0/1384185212 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618022070 con 0x56109db569f0 2023-10-14T10:35:34.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.848+0000 7f96157fa640 1 -- 172.21.15.8:0/1384185212 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9618007650 con 0x56109db569f0 2023-10-14T10:35:34.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.848+0000 7f96157fa640 1 -- 172.21.15.8:0/1384185212 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618004020 con 0x56109db569f0 2023-10-14T10:35:34.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.848+0000 7f96283ec740 1 -- 172.21.15.8:0/1384185212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 msgr2=0x56109db18450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.848+0000 7f96283ec740 1 --2- 172.21.15.8:0/1384185212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 0x56109db18450 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9618012000 tx=0x7f9618010000 comp rx=0 tx=0).stop 2023-10-14T10:35:34.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.848+0000 7f96283ec740 1 -- 172.21.15.8:0/1384185212 shutdown_connections 2023-10-14T10:35:34.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.848+0000 7f96283ec740 1 --2- 172.21.15.8:0/1384185212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db569f0 0x56109db18450 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.848+0000 7f96283ec740 1 --2- 172.21.15.8:0/1384185212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db53880 0x56109db54f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.848+0000 7f96283ec740 1 --2- 172.21.15.8:0/1384185212 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db51c80 0x56109db37670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.848+0000 7f96283ec740 1 -- 172.21.15.8:0/1384185212 >> 172.21.15.8:0/1384185212 conn(0x56109db19c20 msgr2=0x56109db4da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:34.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.849+0000 7f96283ec740 1 -- 172.21.15.8:0/1384185212 shutdown_connections 2023-10-14T10:35:34.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.849+0000 7f96283ec740 1 -- 172.21.15.8:0/1384185212 wait complete. 2023-10-14T10:35:34.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.849+0000 7f96283ec740 1 -- start start 2023-10-14T10:35:34.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.849+0000 7f96283ec740 1 Processor -- start 2023-10-14T10:35:34.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.850+0000 7f96283ec740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db51c80 0x56109db2a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.850+0000 7f96283ec740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db53880 0x56109db74040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.850+0000 7f96283ec740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db569f0 0x56109dbc0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.850+0000 7f96283ec740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109db58940 con 0x56109db51c80 2023-10-14T10:35:34.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.850+0000 7f96283ec740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56109db2b1b0 con 0x56109db569f0 2023-10-14T10:35:34.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.850+0000 7f96283ec740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x56109dbc15a0 con 0x56109db53880 2023-10-14T10:35:34.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.850+0000 7f96283ec740 10 client.0 _ll_register_callbacks cb 0x56109db54e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T10:35:34.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f961effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db51c80 0x56109db2a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f961effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db51c80 0x56109db2a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54228/0 (socket says 172.21.15.8:54228) 2023-10-14T10:35:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f961effd640 1 -- 172.21.15.8:0/2867438401 learned_addr learned my addr 172.21.15.8:0/2867438401 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f961effd640 1 -- 172.21.15.8:0/2867438401 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db53880 msgr2=0x56109db74040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f961effd640 1 --2- 172.21.15.8:0/2867438401 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db53880 0x56109db74040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f961effd640 1 -- 172.21.15.8:0/2867438401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db569f0 msgr2=0x56109dbc0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:34.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f961effd640 1 --2- 172.21.15.8:0/2867438401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db569f0 0x56109dbc0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f961effd640 1 -- 172.21.15.8:0/2867438401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56109da42910 con 0x56109db51c80 2023-10-14T10:35:34.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f961effd640 1 --2- 172.21.15.8:0/2867438401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db51c80 0x56109db2a750 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f961003b040 tx=0x7f96100a9a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a9b34237cba355 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:34.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f95fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T10:35:34.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f95fdffb640 1 -- 172.21.15.8:0/2867438401 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610079ef0 con 0x56109db51c80 2023-10-14T10:35:34.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f95fdffb640 1 -- 172.21.15.8:0/2867438401 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f9610096080 con 0x56109db51c80 2023-10-14T10:35:34.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.851+0000 7f96283ec740 1 -- 172.21.15.8:0/2867438401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96180074e0 con 0x56109db51c80 2023-10-14T10:35:34.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.852+0000 7f95fdffb640 1 -- 172.21.15.8:0/2867438401 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f961007aab0 con 0x56109db51c80 2023-10-14T10:35:34.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.852+0000 7f96283ec740 10 client.5427 fetch_fsmap learned FSMap version 17 2023-10-14T10:35:34.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.852+0000 7f96283ec740 1 -- 172.21.15.8:0/2867438401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56109da41170 con 0x56109db51c80 2023-10-14T10:35:34.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.852+0000 7f95fdffb640 1 -- 172.21.15.8:0/2867438401 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96180074e0 con 0x56109db51c80 2023-10-14T10:35:34.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.852+0000 7f95fdffb640 1 -- 172.21.15.8:0/2867438401 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f96100802b0 con 0x56109db51c80 2023-10-14T10:35:34.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.852+0000 7f96283ec740 10 client.5427 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T10:35:34.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.852+0000 7f96283ec740 10 client.5427 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T10:35:34.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.852+0000 7f96283ec740 20 client.5427 populate_metadata read hostname 'smithi008' 2023-10-14T10:35:34.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.852+0000 7f96283ec740 1 --2- 172.21.15.8:0/2867438401 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x56109db6f570 0x56109db6f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:34.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.852+0000 7f96283ec740 4 client.5427 mds_command: new command op to 5052 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T10:35:34.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.852+0000 7f96283ec740 1 -- 172.21.15.8:0/2867438401 --> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56109da77700 con 0x56109db6f570 2023-10-14T10:35:34.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.852+0000 7f961e7fc640 1 --2- 172.21.15.8:0/2867438401 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x56109db6f570 0x56109db6f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:34.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f961e7fc640 1 --2- 172.21.15.8:0/2867438401 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x56109db6f570 0x56109db6f950 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=299e98f7b01f8c08 server_cookie=31c6bf90177ac5fb in_seq=0 out_seq=0 2023-10-14T10:35:34.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f95fdffb640 10 client.5427 ms_handle_connect on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:34.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f95fdffb640 1 -- 172.21.15.8:0/2867438401 <== mds.0 v2:172.21.15.8:6836/799022047 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x56109da77700 con 0x56109db6f570 2023-10-14T10:35:34.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f95fdffb640 10 client.5427 handle_command_reply: tid=0 2023-10-14T10:35:34.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f96283ec740 1 client.5427 shutdown 2023-10-14T10:35:34.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f96283ec740 1 -- 172.21.15.8:0/2867438401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db51c80 msgr2=0x56109db2a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f96283ec740 1 --2- 172.21.15.8:0/2867438401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db51c80 0x56109db2a750 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f961003b040 tx=0x7f96100a9a40 comp rx=0 tx=0).stop 2023-10-14T10:35:34.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f96283ec740 1 -- 172.21.15.8:0/2867438401 shutdown_connections 2023-10-14T10:35:34.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f96283ec740 1 --2- 172.21.15.8:0/2867438401 >> [v2:172.21.15.8:6836/799022047,v1:172.21.15.8:6837/799022047] conn(0x56109db6f570 0x56109db6f950 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f96283ec740 1 --2- 172.21.15.8:0/2867438401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56109db569f0 0x56109dbc0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f96283ec740 1 --2- 172.21.15.8:0/2867438401 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x56109db53880 0x56109db74040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f96283ec740 1 --2- 172.21.15.8:0/2867438401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56109db51c80 0x56109db2a750 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f95fdffb640 0 client.5427 ms_handle_reset on v2:172.21.15.8:6836/799022047 2023-10-14T10:35:34.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.853+0000 7f96283ec740 1 -- 172.21.15.8:0/2867438401 >> 172.21.15.8:0/2867438401 conn(0x56109db19c20 msgr2=0x56109db17720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:34.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.854+0000 7f96283ec740 1 -- 172.21.15.8:0/2867438401 shutdown_connections 2023-10-14T10:35:34.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.854+0000 7f96283ec740 1 -- 172.21.15.8:0/2867438401 wait complete. 2023-10-14T10:35:34.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.854+0000 7f96283ec740 20 client.5427 trim_cache size 0 max 16384 2023-10-14T10:35:34.879 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:34.879 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "452b10b4-f8ad-4e99-85d0-4d157f344356", 2023-10-14T10:35:34.880 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-14T10:35:34.880 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5052, 2023-10-14T10:35:34.880 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-14T10:35:34.880 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-14T10:35:34.881 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "testcephfs1", 2023-10-14T10:35:34.881 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 46.377194006000003, 2023-10-14T10:35:34.881 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 17, 2023-10-14T10:35:34.881 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 34, 2023-10-14T10:35:34.882 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 34, 2023-10-14T10:35:34.882 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 55.594742543000002 2023-10-14T10:35:34.882 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.854+0000 7f961ffff640 1 -- 172.21.15.8:0/1045995695 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f960006ae70 msgr2=0x7f960006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.854+0000 7f961ffff640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f960006ae70 0x7f960006d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9608001b20 tx=0x7f9608009040 comp rx=0 tx=0).stop 2023-10-14T10:35:34.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.854+0000 7f961ffff640 1 -- 172.21.15.8:0/1045995695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 msgr2=0x7f96201408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:34.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.854+0000 7f961ffff640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 0x7f96201408c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9610006fd0 tx=0x7f9610004730 comp rx=0 tx=0).stop 2023-10-14T10:35:34.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.854+0000 7f961ffff640 1 -- 172.21.15.8:0/1045995695 shutdown_connections 2023-10-14T10:35:34.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.854+0000 7f961ffff640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f960006ae70 0x7f960006d330 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.854+0000 7f961ffff640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f962006cff0 0x7f962006d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.854+0000 7f961ffff640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f962015e780 0x7f9620140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.855+0000 7f961ffff640 1 --2- 172.21.15.8:0/1045995695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f960c003970 0x7f96201408c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:34.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.855+0000 7f961ffff640 1 -- 172.21.15.8:0/1045995695 >> 172.21.15.8:0/1045995695 conn(0x7f962006a200 msgr2=0x7f9620070bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:34.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.855+0000 7f961ffff640 1 -- 172.21.15.8:0/1045995695 shutdown_connections 2023-10-14T10:35:34.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:34.855+0000 7f961ffff640 1 -- 172.21.15.8:0/1045995695 wait complete. 2023-10-14T10:35:34.887 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T10:34:47.550249+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5052": { "addr": "172.21.15.8:6837/799022047", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6836", "nonce": 799022047, "type": "v2" }, { "addr": "172.21.15.8:6837", "nonce": 799022047, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5052, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T10:34:50.997788+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5052 } } } ], "standbys": [ { "addr": "172.21.15.8:6835/1474692193", "addrs": { "addrvec": [ { "addr": "172.21.15.8:6834", "nonce": 1474692193, "type": "v2" }, { "addr": "172.21.15.8:6835", "nonce": 1474692193, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4532, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6835/2045070429", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6833", "nonce": 2045070429, "type": "v2" }, { "addr": "172.21.15.92:6835", "nonce": 2045070429, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4538, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.92:6834/337485030", "addrs": { "addrvec": [ { "addr": "172.21.15.92:6832", "nonce": 337485030, "type": "v2" }, { "addr": "172.21.15.92:6834", "nonce": 337485030, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4726, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T10:35:34.888 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': 2, 'name': 'a', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T10:35:34.889 INFO:tasks.cephfs.test_failover:current = [{'gid': 4532, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.8:6835/1474692193', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6834', 'nonce': 1474692193}, {'type': 'v1', 'addr': '172.21.15.8:6835', 'nonce': 1474692193}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 4726, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6834/337485030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 337485030}, {'type': 'v1', 'addr': '172.21.15.92:6834', 'nonce': 337485030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5052, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.8:6837/799022047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6836', 'nonce': 799022047}, {'type': 'v1', 'addr': '172.21.15.8:6837', 'nonce': 799022047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 4538, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.92:6835/2045070429', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6833', 'nonce': 2045070429}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2045070429}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T10:35:34.890 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T10:35:34.890 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T10:35:34.891 DEBUG:teuthology.orchestra.run.smithi008:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T10:35:35.020 DEBUG:teuthology.orchestra.run.smithi092:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T10:35:35.152 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T10:35:35.153 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:35:35.153 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T10:35:35.216 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-10-14T10:35:35.217 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:35:35.217 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T10:35:35.277 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054298,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-14T10:35:35.278 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:35:35.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.513+0000 7f3fe84d7640 1 Processor -- start 2023-10-14T10:35:35.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.513+0000 7f3fe84d7640 1 -- start start 2023-10-14T10:35:35.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.515+0000 7f3fe84d7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3fe014e640 0x7f3fe0154d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:35.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.515+0000 7f3fe84d7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3fe00c1720 0x7f3fe00c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:35.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.515+0000 7f3fe84d7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe01552d0 con 0x7f3fe00c5ce0 2023-10-14T10:35:35.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.515+0000 7f3fe84d7640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe00c1cc0 con 0x7f3fe014e640 2023-10-14T10:35:35.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.515+0000 7f3fe84d7640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe006cce0 con 0x7f3fe00c1720 2023-10-14T10:35:35.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.515+0000 7f3fe6273640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3fe014e640 0x7f3fe0154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:35.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.515+0000 7f3fe6273640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3fe014e640 0x7f3fe0154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54244/0 (socket says 172.21.15.8:54244) 2023-10-14T10:35:35.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.515+0000 7f3fe6a74640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3fe00c5ce0 0x7f3fe00a84d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59984/0 (socket says 172.21.15.8:59984) 2023-10-14T10:35:35.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.515+0000 7f3fe6273640 1 -- 172.21.15.8:0/2191012633 learned_addr learned my addr 172.21.15.8:0/2191012633 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.516+0000 7f3fe5a72640 1 --2- 172.21.15.8:0/2191012633 >> v2:172.21.15.92:3300/0 conn(0x7f3fe00c1720 0x7f3fe00c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:35.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.516+0000 7f3fe6273640 1 -- 172.21.15.8:0/2191012633 >> v2:172.21.15.92:3300/0 conn(0x7f3fe00c1720 msgr2=0x7f3fe00c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:35.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.516+0000 7f3fe6273640 1 --2- 172.21.15.8:0/2191012633 >> v2:172.21.15.92:3300/0 conn(0x7f3fe00c1720 0x7f3fe00c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:35.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.516+0000 7f3fe6273640 1 -- 172.21.15.8:0/2191012633 >> v1:172.21.15.8:6789/0 conn(0x7f3fe00c5ce0 legacy=0x7f3fe00a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:35.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.516+0000 7f3fe6273640 1 -- 172.21.15.8:0/2191012633 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe006cfc0 con 0x7f3fe014e640 2023-10-14T10:35:35.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.516+0000 7f3fe5a72640 1 --2- 172.21.15.8:0/2191012633 >> v2:172.21.15.92:3300/0 conn(0x7f3fe00c1720 0x7f3fe00c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:35.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.516+0000 7f3fe5271640 1 -- 172.21.15.8:0/2191012633 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234238305 0 0) 0x7f3fe01552d0 con 0x7f3fe00c5ce0 2023-10-14T10:35:35.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.517+0000 7f3fe6273640 1 --2- 172.21.15.8:0/2191012633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe014e640 0x7f3fe0154d90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00c62d0 tx=0x7f3fdc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab650aa63fdf135 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:35.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.517+0000 7f3fe5271640 1 -- 172.21.15.8:0/2191012633 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc030860 con 0x7f3fe014e640 2023-10-14T10:35:35.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.517+0000 7f3fe5271640 1 -- 172.21.15.8:0/2191012633 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0309c0 con 0x7f3fe014e640 2023-10-14T10:35:35.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.517+0000 7f3fe5271640 1 -- 172.21.15.8:0/2191012633 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc030d50 con 0x7f3fe014e640 2023-10-14T10:35:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.518+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2191012633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe014e640 msgr2=0x7f3fe0154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.518+0000 7f3fe84d7640 1 --2- 172.21.15.8:0/2191012633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe014e640 0x7f3fe0154d90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00c62d0 tx=0x7f3fdc02b9a0 comp rx=0 tx=0).stop 2023-10-14T10:35:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.518+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2191012633 shutdown_connections 2023-10-14T10:35:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.518+0000 7f3fe84d7640 1 --2- 172.21.15.8:0/2191012633 >> v2:172.21.15.92:3300/0 conn(0x7f3fe00c1720 0x7f3fe00c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.518+0000 7f3fe84d7640 1 --2- 172.21.15.8:0/2191012633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe014e640 0x7f3fe0154d90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.518+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2191012633 >> 172.21.15.8:0/2191012633 conn(0x7f3fe00a74d0 msgr2=0x7f3fe00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.518+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2191012633 shutdown_connections 2023-10-14T10:35:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.518+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2191012633 wait complete. 2023-10-14T10:35:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.520+0000 7f3fe84d7640 1 Processor -- start 2023-10-14T10:35:35.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.520+0000 7f3fe84d7640 1 -- start start 2023-10-14T10:35:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe84d7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00c1720 0x7f3fe014d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe84d7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe00c5ce0 0x7f3fe0152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe84d7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3fe014e640 0x7f3fe01530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe84d7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe01535e0 con 0x7f3fe00c1720 2023-10-14T10:35:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe84d7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0154e30 con 0x7f3fe00c5ce0 2023-10-14T10:35:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe84d7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe01516e0 con 0x7f3fe014e640 2023-10-14T10:35:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe6273640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00c1720 0x7f3fe014d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe6273640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00c1720 0x7f3fe014d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54250/0 (socket says 172.21.15.8:54250) 2023-10-14T10:35:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe6273640 1 -- 172.21.15.8:0/2485225402 learned_addr learned my addr 172.21.15.8:0/2485225402 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe5a72640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe00c5ce0 0x7f3fe0152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe6273640 1 -- 172.21.15.8:0/2485225402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3fe014e640 msgr2=0x7f3fe01530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe6273640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3fe014e640 0x7f3fe01530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe6273640 1 -- 172.21.15.8:0/2485225402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe00c5ce0 msgr2=0x7f3fe0152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe6273640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe00c5ce0 0x7f3fe0152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe6273640 1 -- 172.21.15.8:0/2485225402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc0094d0 con 0x7f3fe00c1720 2023-10-14T10:35:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.521+0000 7f3fe5a72640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe00c5ce0 0x7f3fe0152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:35.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.522+0000 7f3fe6273640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00c1720 0x7f3fe014d120 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc02b9e0 tx=0x7f3fdc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:35.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.522+0000 7f3fd6ffd640 1 -- 172.21.15.8:0/2485225402 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc030850 con 0x7f3fe00c1720 2023-10-14T10:35:35.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.522+0000 7f3fd6ffd640 1 -- 172.21.15.8:0/2485225402 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc043400 con 0x7f3fe00c1720 2023-10-14T10:35:35.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.522+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2485225402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe01519c0 con 0x7f3fe00c1720 2023-10-14T10:35:35.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.522+0000 7f3fd6ffd640 1 -- 172.21.15.8:0/2485225402 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0437b0 con 0x7f3fe00c1720 2023-10-14T10:35:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.522+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2485225402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe014d660 con 0x7f3fe00c1720 2023-10-14T10:35:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.523+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2485225402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe01489f0 con 0x7f3fe00c1720 2023-10-14T10:35:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.524+0000 7f3fd6ffd640 1 -- 172.21.15.8:0/2485225402 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3fdc043910 con 0x7f3fe00c1720 2023-10-14T10:35:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.525+0000 7f3fd6ffd640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3fc406ae70 0x7f3fc406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.525+0000 7f3fd6ffd640 1 -- 172.21.15.8:0/2485225402 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3fdc03e070 con 0x7f3fe00c1720 2023-10-14T10:35:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.526+0000 7f3fe5a72640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3fc406ae70 0x7f3fc406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:35.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.526+0000 7f3fe5a72640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3fc406ae70 0x7f3fc406d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0006fd0 tx=0x7f3fd0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:35.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.530+0000 7f3fd6ffd640 1 -- 172.21.15.8:0/2485225402 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3fdc077b50 con 0x7f3fe00c1720 2023-10-14T10:35:35.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.764+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2485225402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fe0148570 con 0x7f3fe00c1720 2023-10-14T10:35:35.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.765+0000 7f3fd6ffd640 1 -- 172.21.15.8:0/2485225402 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f3fe0148570 con 0x7f3fe00c1720 2023-10-14T10:35:35.768 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:35.768 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:35:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:35:35.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.768+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2485225402 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3fc406ae70 msgr2=0x7f3fc406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:35.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.768+0000 7f3fe84d7640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3fc406ae70 0x7f3fc406d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0006fd0 tx=0x7f3fd0008040 comp rx=0 tx=0).stop 2023-10-14T10:35:35.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.768+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2485225402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00c1720 msgr2=0x7f3fe014d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:35.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.768+0000 7f3fe84d7640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00c1720 0x7f3fe014d120 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc02b9e0 tx=0x7f3fdc004730 comp rx=0 tx=0).stop 2023-10-14T10:35:35.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.769+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2485225402 shutdown_connections 2023-10-14T10:35:35.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.769+0000 7f3fe84d7640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f3fc406ae70 0x7f3fc406d330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:35.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.769+0000 7f3fe84d7640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3fe014e640 0x7f3fe01530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:35.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.769+0000 7f3fe84d7640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe00c5ce0 0x7f3fe0152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:35.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.769+0000 7f3fe84d7640 1 --2- 172.21.15.8:0/2485225402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00c1720 0x7f3fe014d120 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:35.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.769+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2485225402 >> 172.21.15.8:0/2485225402 conn(0x7f3fe00a74d0 msgr2=0x7f3fe00c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:35.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.769+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2485225402 shutdown_connections 2023-10-14T10:35:35.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:35.769+0000 7f3fe84d7640 1 -- 172.21.15.8:0/2485225402 wait complete. 2023-10-14T10:35:35.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:35:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.010+0000 7f7a0917d640 1 Processor -- start 2023-10-14T10:35:36.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.010+0000 7f7a0917d640 1 -- start start 2023-10-14T10:35:36.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.012+0000 7f7a0917d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a0413b260 0x7f7a040c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.012+0000 7f7a0917d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7a04071ff0 0x7f7a04152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.012+0000 7f7a0917d640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a04152ea0 con 0x7f7a040c1810 2023-10-14T10:35:36.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.012+0000 7f7a0917d640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a04152540 con 0x7f7a0413b260 2023-10-14T10:35:36.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.012+0000 7f7a0917d640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a04151ea0 con 0x7f7a04071ff0 2023-10-14T10:35:36.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.012+0000 7f7a02d9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a0413b260 0x7f7a040c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.012+0000 7f7a02d9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a0413b260 0x7f7a040c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54260/0 (socket says 172.21.15.8:54260) 2023-10-14T10:35:36.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.012+0000 7f7a02d9d640 1 -- 172.21.15.8:0/524969454 learned_addr learned my addr 172.21.15.8:0/524969454 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:36.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.013+0000 7f7a02d9d640 1 -- 172.21.15.8:0/524969454 >> v2:172.21.15.92:3300/0 conn(0x7f7a04071ff0 msgr2=0x7f7a04152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:36.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.013+0000 7f7a02d9d640 1 --2- 172.21.15.8:0/524969454 >> v2:172.21.15.92:3300/0 conn(0x7f7a04071ff0 0x7f7a04152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.013+0000 7f7a02d9d640 1 -- 172.21.15.8:0/524969454 >> v1:172.21.15.92:6789/0 conn(0x7f7a040c1810 legacy=0x7f7a0406d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:36.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.013+0000 7f7a02d9d640 1 -- 172.21.15.8:0/524969454 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a040c5d80 con 0x7f7a0413b260 2023-10-14T10:35:36.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.014+0000 7f7a02d9d640 1 --2- 172.21.15.8:0/524969454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0413b260 0x7f7a040c57a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7a0406ba40 tx=0x7f79f402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9e4eda861ef985 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:36.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.015+0000 7f7a0259c640 1 -- 172.21.15.8:0/524969454 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40317e0 con 0x7f7a0413b260 2023-10-14T10:35:36.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.015+0000 7f7a0259c640 1 -- 172.21.15.8:0/524969454 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f4031940 con 0x7f7a0413b260 2023-10-14T10:35:36.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.015+0000 7f7a0259c640 1 -- 172.21.15.8:0/524969454 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4031cd0 con 0x7f7a0413b260 2023-10-14T10:35:36.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.015+0000 7f7a0917d640 1 -- 172.21.15.8:0/524969454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0413b260 msgr2=0x7f7a040c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.015+0000 7f7a0917d640 1 --2- 172.21.15.8:0/524969454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0413b260 0x7f7a040c57a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7a0406ba40 tx=0x7f79f402b880 comp rx=0 tx=0).stop 2023-10-14T10:35:36.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.015+0000 7f7a0917d640 1 -- 172.21.15.8:0/524969454 shutdown_connections 2023-10-14T10:35:36.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.015+0000 7f7a0917d640 1 --2- 172.21.15.8:0/524969454 >> v2:172.21.15.92:3300/0 conn(0x7f7a04071ff0 0x7f7a04152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.015+0000 7f7a0917d640 1 --2- 172.21.15.8:0/524969454 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0413b260 0x7f7a040c57a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.015+0000 7f7a0917d640 1 -- 172.21.15.8:0/524969454 >> 172.21.15.8:0/524969454 conn(0x7f7a040a74d0 msgr2=0x7f7a040a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:36.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.016+0000 7f7a0917d640 1 -- 172.21.15.8:0/524969454 shutdown_connections 2023-10-14T10:35:36.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.016+0000 7f7a0917d640 1 -- 172.21.15.8:0/524969454 wait complete. 2023-10-14T10:35:36.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.017+0000 7f7a0917d640 1 Processor -- start 2023-10-14T10:35:36.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.017+0000 7f7a0917d640 1 -- start start 2023-10-14T10:35:36.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.018+0000 7f7a0917d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a04071ff0 0x7f7a040ba440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.018+0000 7f7a0917d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a040c1810 0x7f7a041ec9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.018+0000 7f7a0917d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0413b260 0x7f7a04137c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.018+0000 7f7a0917d640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040bd620 con 0x7f7a0413b260 2023-10-14T10:35:36.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.018+0000 7f7a0917d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a041ed6a0 con 0x7f7a040c1810 2023-10-14T10:35:36.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.018+0000 7f7a0917d640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040a8670 con 0x7f7a04071ff0 2023-10-14T10:35:36.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f7a0359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0413b260 0x7f7a04137c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f7a0359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0413b260 0x7f7a04137c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54270/0 (socket says 172.21.15.8:54270) 2023-10-14T10:35:36.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f7a0359e640 1 -- 172.21.15.8:0/258905206 learned_addr learned my addr 172.21.15.8:0/258905206 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:36.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f7a02d9d640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a04071ff0 0x7f7a040ba440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f79fbfff640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a040c1810 0x7f7a041ec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f7a0359e640 1 -- 172.21.15.8:0/258905206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a04071ff0 msgr2=0x7f7a040ba440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f7a0359e640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a04071ff0 0x7f7a040ba440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f7a0359e640 1 -- 172.21.15.8:0/258905206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a040c1810 msgr2=0x7f7a041ec9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f7a0359e640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a040c1810 0x7f7a041ec9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f7a0359e640 1 -- 172.21.15.8:0/258905206 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f40094d0 con 0x7f7a0413b260 2023-10-14T10:35:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f7a02d9d640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a04071ff0 0x7f7a040ba440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f79fbfff640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a040c1810 0x7f7a041ec9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:36.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.019+0000 7f7a0359e640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0413b260 0x7f7a04137c90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00c780 tx=0x7f79fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.020+0000 7f79fb7fe640 1 -- 172.21.15.8:0/258905206 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc003d80 con 0x7f7a0413b260 2023-10-14T10:35:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.020+0000 7f79fb7fe640 1 -- 172.21.15.8:0/258905206 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc00ce90 con 0x7f7a0413b260 2023-10-14T10:35:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.020+0000 7f79fb7fe640 1 -- 172.21.15.8:0/258905206 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0052b0 con 0x7f7a0413b260 2023-10-14T10:35:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.020+0000 7f7a0917d640 1 -- 172.21.15.8:0/258905206 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a040bf040 con 0x7f7a0413b260 2023-10-14T10:35:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.020+0000 7f7a0917d640 1 -- 172.21.15.8:0/258905206 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a040bf2e0 con 0x7f7a0413b260 2023-10-14T10:35:36.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.021+0000 7f7a0917d640 1 -- 172.21.15.8:0/258905206 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a040a8840 con 0x7f7a0413b260 2023-10-14T10:35:36.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.022+0000 7f79fb7fe640 1 -- 172.21.15.8:0/258905206 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f79fc005410 con 0x7f7a0413b260 2023-10-14T10:35:36.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.023+0000 7f79fb7fe640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79e406aea0 0x7f79e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.023+0000 7f79fb7fe640 1 -- 172.21.15.8:0/258905206 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f79fc0889e0 con 0x7f7a0413b260 2023-10-14T10:35:36.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.024+0000 7f7a02d9d640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79e406aea0 0x7f79e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.024+0000 7f7a02d9d640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79e406aea0 0x7f79e406d360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f79f4036000 tx=0x7f79f403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:36.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.027+0000 7f79fb7fe640 1 -- 172.21.15.8:0/258905206 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a040a8840 con 0x7f7a0413b260 2023-10-14T10:35:36.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.230+0000 7f7a0917d640 1 -- 172.21.15.8:0/258905206 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a040a87e0 con 0x7f7a0413b260 2023-10-14T10:35:36.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.232+0000 7f79fb7fe640 1 -- 172.21.15.8:0/258905206 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f79fc053a60 con 0x7f7a0413b260 2023-10-14T10:35:36.235 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:36.235 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":34,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:34:49.066182+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T10:34:45.620441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T10:34:46.556786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:35:36.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.234+0000 7f7a0917d640 1 -- 172.21.15.8:0/258905206 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79e406aea0 msgr2=0x7f79e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.234+0000 7f7a0917d640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79e406aea0 0x7f79e406d360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f79f4036000 tx=0x7f79f403d040 comp rx=0 tx=0).stop 2023-10-14T10:35:36.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.234+0000 7f7a0917d640 1 -- 172.21.15.8:0/258905206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0413b260 msgr2=0x7f7a04137c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.234+0000 7f7a0917d640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0413b260 0x7f7a04137c90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00c780 tx=0x7f79fc00cc40 comp rx=0 tx=0).stop 2023-10-14T10:35:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.235+0000 7f7a0917d640 1 -- 172.21.15.8:0/258905206 shutdown_connections 2023-10-14T10:35:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.235+0000 7f7a0917d640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f79e406aea0 0x7f79e406d360 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.235+0000 7f7a0917d640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a0413b260 0x7f7a04137c90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.235+0000 7f7a0917d640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a040c1810 0x7f7a041ec9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.235+0000 7f7a0917d640 1 --2- 172.21.15.8:0/258905206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a04071ff0 0x7f7a040ba440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.235+0000 7f7a0917d640 1 -- 172.21.15.8:0/258905206 >> 172.21.15.8:0/258905206 conn(0x7f7a040a74d0 msgr2=0x7f7a040c2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:36.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.235+0000 7f7a0917d640 1 -- 172.21.15.8:0/258905206 shutdown_connections 2023-10-14T10:35:36.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.235+0000 7f7a0917d640 1 -- 172.21.15.8:0/258905206 wait complete. 2023-10-14T10:35:36.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T10:33:40.706361+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T10:34:45.620441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T10:34:46.556786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T10:35:36.257 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T10:35:36.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.480+0000 7f38c7810640 1 Processor -- start 2023-10-14T10:35:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.481+0000 7f38c7810640 1 -- start start 2023-10-14T10:35:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.482+0000 7f38c7810640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f38c006d0b0 0x7f38c00bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.482+0000 7f38c7810640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c0152a70 con 0x7f38c0155d00 2023-10-14T10:35:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.482+0000 7f38c7810640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c0152d50 con 0x7f38c0070800 2023-10-14T10:35:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.482+0000 7f38c7810640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c0155500 con 0x7f38c006d0b0 2023-10-14T10:35:36.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.482+0000 7f38c5dad640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f38c0155d00 0x7f38c014b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59988/0 (socket says 172.21.15.8:59988) 2023-10-14T10:35:36.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.482+0000 7f38c5dad640 1 -- 172.21.15.8:0/3826348475 learned_addr learned my addr 172.21.15.8:0/3826348475 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:36.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38c55ac640 1 --2- 172.21.15.8:0/3826348475 >> v2:172.21.15.92:3300/0 conn(0x7f38c006d0b0 0x7f38c00bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055839376 0 0) 0x7f38c0152a70 con 0x7f38c0155d00 2023-10-14T10:35:36.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38ac003520 con 0x7f38c0155d00 2023-10-14T10:35:36.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2736271901 0 0) 0x7f38ac003520 con 0x7f38c0155d00 2023-10-14T10:35:36.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 >> v2:172.21.15.92:3300/0 conn(0x7f38c006d0b0 msgr2=0x7f38c00bfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:36.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38b7fff640 1 --2- 172.21.15.8:0/3826348475 >> v2:172.21.15.92:3300/0 conn(0x7f38c006d0b0 0x7f38c00bfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 >> v1:172.21.15.92:6789/0 conn(0x7f38c0070800 legacy=0x7f38c006d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c01557e0 con 0x7f38c0155d00 2023-10-14T10:35:36.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f38b80019f0 con 0x7f38c0155d00 2023-10-14T10:35:36.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 >> v1:172.21.15.8:6789/0 conn(0x7f38c0155d00 legacy=0x7f38c014b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38b7fff640 1 --2- 172.21.15.8:0/3826348475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38ac0039c0 0x7f38ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38b7fff640 1 --2- 172.21.15.8:0/3826348475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38ac0047c0 0x7f38ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.483+0000 7f38b7fff640 1 --2- 172.21.15.8:0/3826348475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38ac0051d0 0x7f38ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.484+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c0155500 con 0x7f38ac0051d0 2023-10-14T10:35:36.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.484+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac00c120 con 0x7f38ac0047c0 2023-10-14T10:35:36.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.484+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac00c2e0 con 0x7f38ac0039c0 2023-10-14T10:35:36.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.484+0000 7f38c5dad640 1 --2- 172.21.15.8:0/3826348475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38ac0051d0 0x7f38ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.484+0000 7f38c55ac640 1 --2- 172.21.15.8:0/3826348475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38ac0039c0 0x7f38ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.484+0000 7f38c4dab640 1 --2- 172.21.15.8:0/3826348475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38ac0047c0 0x7f38ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.484+0000 7f38c5dad640 1 -- 172.21.15.8:0/3826348475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38ac0039c0 msgr2=0x7f38ac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.484+0000 7f38c5dad640 1 --2- 172.21.15.8:0/3826348475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38ac0039c0 0x7f38ac003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.484+0000 7f38c5dad640 1 -- 172.21.15.8:0/3826348475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38ac0047c0 msgr2=0x7f38ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.484+0000 7f38c5dad640 1 --2- 172.21.15.8:0/3826348475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38ac0047c0 0x7f38ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.484+0000 7f38c5dad640 1 -- 172.21.15.8:0/3826348475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac003520 con 0x7f38ac0051d0 2023-10-14T10:35:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.484+0000 7f38c4dab640 1 --2- 172.21.15.8:0/3826348475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38ac0047c0 0x7f38ac004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.485+0000 7f38c5dad640 1 -- 172.21.15.8:0/3826348475 reap_dead start 2023-10-14T10:35:36.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.485+0000 7f38c5dad640 1 --2- 172.21.15.8:0/3826348475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38ac0051d0 0x7f38ac00b980 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f38b8002230 tx=0x7f38ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14433bce430a4ba1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.485+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8034630 con 0x7f38ac0051d0 2023-10-14T10:35:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.486+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b802f070 con 0x7f38ac0051d0 2023-10-14T10:35:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.486+0000 7f38b7fff640 1 -- 172.21.15.8:0/3826348475 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b80349d0 con 0x7f38ac0051d0 2023-10-14T10:35:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.486+0000 7f38c7810640 1 -- 172.21.15.8:0/3826348475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38ac0051d0 msgr2=0x7f38ac00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.486+0000 7f38c7810640 1 --2- 172.21.15.8:0/3826348475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38ac0051d0 0x7f38ac00b980 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f38b8002230 tx=0x7f38ac0057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.486+0000 7f38c7810640 1 -- 172.21.15.8:0/3826348475 shutdown_connections 2023-10-14T10:35:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.486+0000 7f38c7810640 1 --2- 172.21.15.8:0/3826348475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38ac0051d0 0x7f38ac00b980 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.486+0000 7f38c7810640 1 -- 172.21.15.8:0/3826348475 >> 172.21.15.8:0/3826348475 conn(0x7f38c0069de0 msgr2=0x7f38c006a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.486+0000 7f38c7810640 1 -- 172.21.15.8:0/3826348475 shutdown_connections 2023-10-14T10:35:36.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.486+0000 7f38c7810640 1 -- 172.21.15.8:0/3826348475 wait complete. 2023-10-14T10:35:36.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.488+0000 7f38c7810640 1 Processor -- start 2023-10-14T10:35:36.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.488+0000 7f38c7810640 1 -- start start 2023-10-14T10:35:36.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.489+0000 7f38c7810640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38ac0051d0 0x7f38c00aac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.489+0000 7f38c7810640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38c0142590 0x7f38c01418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.489+0000 7f38c7810640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38c0141e10 0x7f38c0146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.489+0000 7f38c7810640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c00a9e60 con 0x7f38c0141e10 2023-10-14T10:35:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.489+0000 7f38c7810640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c0148df0 con 0x7f38c0142590 2023-10-14T10:35:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.489+0000 7f38c7810640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c0151540 con 0x7f38ac0051d0 2023-10-14T10:35:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.489+0000 7f38c5dad640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38c0141e10 0x7f38c0146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.490+0000 7f38c5dad640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38c0141e10 0x7f38c0146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54296/0 (socket says 172.21.15.8:54296) 2023-10-14T10:35:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.490+0000 7f38c5dad640 1 -- 172.21.15.8:0/3756415138 learned_addr learned my addr 172.21.15.8:0/3756415138 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.490+0000 7f38c4dab640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38c0142590 0x7f38c01418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.490+0000 7f38c55ac640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38ac0051d0 0x7f38c00aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.490+0000 7f38c5dad640 1 -- 172.21.15.8:0/3756415138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38ac0051d0 msgr2=0x7f38c00aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.490+0000 7f38c5dad640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38ac0051d0 0x7f38c00aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.490+0000 7f38c5dad640 1 -- 172.21.15.8:0/3756415138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38c0142590 msgr2=0x7f38c01418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.490+0000 7f38c5dad640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38c0142590 0x7f38c01418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.490+0000 7f38c5dad640 1 -- 172.21.15.8:0/3756415138 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c00a9250 con 0x7f38c0141e10 2023-10-14T10:35:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.490+0000 7f38c55ac640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38ac0051d0 0x7f38c00aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:35:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.491+0000 7f38c5dad640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38c0141e10 0x7f38c0146a40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f38b8002230 tx=0x7f38b8001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.491+0000 7f38b5ffb640 1 -- 172.21.15.8:0/3756415138 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8004d60 con 0x7f38c0141e10 2023-10-14T10:35:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.491+0000 7f38b5ffb640 1 -- 172.21.15.8:0/3756415138 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b8001270 con 0x7f38c0141e10 2023-10-14T10:35:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.491+0000 7f38c7810640 1 -- 172.21.15.8:0/3756415138 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c00a9530 con 0x7f38c0141e10 2023-10-14T10:35:36.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.491+0000 7f38b5ffb640 1 -- 172.21.15.8:0/3756415138 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b803f670 con 0x7f38c0141e10 2023-10-14T10:35:36.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.491+0000 7f38c7810640 1 -- 172.21.15.8:0/3756415138 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c00a9af0 con 0x7f38c0141e10 2023-10-14T10:35:36.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.492+0000 7f38c7810640 1 -- 172.21.15.8:0/3756415138 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c006ad70 con 0x7f38c0141e10 2023-10-14T10:35:36.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.493+0000 7f38b5ffb640 1 -- 172.21.15.8:0/3756415138 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f38b8031030 con 0x7f38c0141e10 2023-10-14T10:35:36.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.494+0000 7f38b5ffb640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f38a406aea0 0x7f38a406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.494+0000 7f38b5ffb640 1 -- 172.21.15.8:0/3756415138 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f38b80aab10 con 0x7f38c0141e10 2023-10-14T10:35:36.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.494+0000 7f38c55ac640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f38a406aea0 0x7f38a406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.495+0000 7f38c55ac640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f38a406aea0 0x7f38a406d360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009ad0 tx=0x7f38bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:36.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.499+0000 7f38b5ffb640 1 -- 172.21.15.8:0/3756415138 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38b8075ce0 con 0x7f38c0141e10 2023-10-14T10:35:36.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.694+0000 7f38c7810640 1 -- 172.21.15.8:0/3756415138 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38c0073b50 con 0x7f38c0141e10 2023-10-14T10:35:36.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.695+0000 7f38b5ffb640 1 -- 172.21.15.8:0/3756415138 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38b8079300 con 0x7f38c0141e10 2023-10-14T10:35:36.697 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T10:35:36.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.697+0000 7f38c7810640 1 -- 172.21.15.8:0/3756415138 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f38a406aea0 msgr2=0x7f38a406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.697+0000 7f38c7810640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f38a406aea0 0x7f38a406d360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009ad0 tx=0x7f38bc008040 comp rx=0 tx=0).stop 2023-10-14T10:35:36.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.697+0000 7f38c7810640 1 -- 172.21.15.8:0/3756415138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38c0141e10 msgr2=0x7f38c0146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.697+0000 7f38c7810640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38c0141e10 0x7f38c0146a40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f38b8002230 tx=0x7f38b8001cb0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.698+0000 7f38c7810640 1 -- 172.21.15.8:0/3756415138 shutdown_connections 2023-10-14T10:35:36.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.698+0000 7f38c7810640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f38a406aea0 0x7f38a406d360 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.698+0000 7f38c7810640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38c0141e10 0x7f38c0146a40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.698+0000 7f38c7810640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38c0142590 0x7f38c01418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.698+0000 7f38c7810640 1 --2- 172.21.15.8:0/3756415138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38ac0051d0 0x7f38c00aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.698+0000 7f38c7810640 1 -- 172.21.15.8:0/3756415138 >> 172.21.15.8:0/3756415138 conn(0x7f38c0069de0 msgr2=0x7f38c006fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:36.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.698+0000 7f38c7810640 1 -- 172.21.15.8:0/3756415138 shutdown_connections 2023-10-14T10:35:36.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.698+0000 7f38c7810640 1 -- 172.21.15.8:0/3756415138 wait complete. 2023-10-14T10:35:36.718 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T10:35:36.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.945+0000 7f7baa2d7640 1 Processor -- start 2023-10-14T10:35:36.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.946+0000 7f7baa2d7640 1 -- start start 2023-10-14T10:35:36.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.947+0000 7f7baa2d7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7ba4155440 0x7f7ba4071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.947+0000 7f7baa2d7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba40c57a0 con 0x7f7ba40bfee0 2023-10-14T10:35:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.947+0000 7f7baa2d7640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba40c59f0 con 0x7f7ba414f3a0 2023-10-14T10:35:36.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.947+0000 7f7baa2d7640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba406cee0 con 0x7f7ba4155440 2023-10-14T10:35:36.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.948+0000 7f7ba8874640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7ba40bfee0 0x7f7ba4152580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56370/0 (socket says 172.21.15.8:56370) 2023-10-14T10:35:36.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.948+0000 7f7ba8874640 1 -- 172.21.15.8:0/2804797237 learned_addr learned my addr 172.21.15.8:0/2804797237 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:36.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.948+0000 7f7ba37fe640 1 --2- 172.21.15.8:0/2804797237 >> v2:172.21.15.92:3300/0 conn(0x7f7ba4155440 0x7f7ba4071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.948+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147669908 0 0) 0x7f7ba40c57a0 con 0x7f7ba40bfee0 2023-10-14T10:35:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.948+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b90003520 con 0x7f7ba40bfee0 2023-10-14T10:35:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152312404 0 0) 0x7f7ba40c59f0 con 0x7f7ba414f3a0 2023-10-14T10:35:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ba40c57a0 con 0x7f7ba414f3a0 2023-10-14T10:35:36.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2242453361 0 0) 0x7f7b90003520 con 0x7f7ba40bfee0 2023-10-14T10:35:36.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 >> v2:172.21.15.92:3300/0 conn(0x7f7ba4155440 msgr2=0x7f7ba4071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:36.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 --2- 172.21.15.8:0/2804797237 >> v2:172.21.15.92:3300/0 conn(0x7f7ba4155440 0x7f7ba4071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 >> v1:172.21.15.92:6789/0 conn(0x7f7ba414f3a0 legacy=0x7f7ba406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba40c5cd0 con 0x7f7ba40bfee0 2023-10-14T10:35:36.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f7b9c001670 con 0x7f7ba40bfee0 2023-10-14T10:35:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 >> v1:172.21.15.8:6789/0 conn(0x7f7ba40bfee0 legacy=0x7f7ba4152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 --2- 172.21.15.8:0/2804797237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b90003b50 0x7f7b90003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 --2- 172.21.15.8:0/2804797237 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b900047c0 0x7f7b90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 --2- 172.21.15.8:0/2804797237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b900051d0 0x7f7b9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba406cee0 con 0x7f7b900051d0 2023-10-14T10:35:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9000c100 con 0x7f7b90003b50 2023-10-14T10:35:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9000c2c0 con 0x7f7b900047c0 2023-10-14T10:35:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba8874640 1 --2- 172.21.15.8:0/2804797237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b900051d0 0x7f7b9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.949+0000 7f7ba3fff640 1 --2- 172.21.15.8:0/2804797237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b90003b50 0x7f7b90003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.950+0000 7f7ba37fe640 1 --2- 172.21.15.8:0/2804797237 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b900047c0 0x7f7b90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.950+0000 7f7ba8874640 1 -- 172.21.15.8:0/2804797237 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b900047c0 msgr2=0x7f7b90004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.950+0000 7f7ba8874640 1 --2- 172.21.15.8:0/2804797237 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b900047c0 0x7f7b90004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.950+0000 7f7ba8874640 1 -- 172.21.15.8:0/2804797237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b90003b50 msgr2=0x7f7b90003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.950+0000 7f7ba8874640 1 --2- 172.21.15.8:0/2804797237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b90003b50 0x7f7b90003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.950+0000 7f7ba8874640 1 -- 172.21.15.8:0/2804797237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b90003520 con 0x7f7b900051d0 2023-10-14T10:35:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.950+0000 7f7ba37fe640 1 --2- 172.21.15.8:0/2804797237 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7b900047c0 0x7f7b90004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.951+0000 7f7ba8874640 1 -- 172.21.15.8:0/2804797237 reap_dead start 2023-10-14T10:35:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.951+0000 7f7ba8874640 1 --2- 172.21.15.8:0/2804797237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b900051d0 0x7f7b9000b980 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ba40c0390 tx=0x7f7b900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1e95ab057022c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.951+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c005ad0 con 0x7f7b900051d0 2023-10-14T10:35:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.951+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c005c30 con 0x7f7b900051d0 2023-10-14T10:35:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.951+0000 7f7ba2ffd640 1 -- 172.21.15.8:0/2804797237 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c007070 con 0x7f7b900051d0 2023-10-14T10:35:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.952+0000 7f7baa2d7640 1 -- 172.21.15.8:0/2804797237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b900051d0 msgr2=0x7f7b9000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.952+0000 7f7baa2d7640 1 --2- 172.21.15.8:0/2804797237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b900051d0 0x7f7b9000b980 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ba40c0390 tx=0x7f7b900057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.952+0000 7f7baa2d7640 1 -- 172.21.15.8:0/2804797237 shutdown_connections 2023-10-14T10:35:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.952+0000 7f7baa2d7640 1 --2- 172.21.15.8:0/2804797237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b900051d0 0x7f7b9000b980 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.952+0000 7f7baa2d7640 1 -- 172.21.15.8:0/2804797237 >> 172.21.15.8:0/2804797237 conn(0x7f7ba40a74d0 msgr2=0x7f7ba40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.952+0000 7f7baa2d7640 1 -- 172.21.15.8:0/2804797237 shutdown_connections 2023-10-14T10:35:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.952+0000 7f7baa2d7640 1 -- 172.21.15.8:0/2804797237 wait complete. 2023-10-14T10:35:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.954+0000 7f7baa2d7640 1 Processor -- start 2023-10-14T10:35:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.954+0000 7f7baa2d7640 1 -- start start 2023-10-14T10:35:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.955+0000 7f7baa2d7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b900051d0 0x7f7ba4150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.955+0000 7f7baa2d7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7ba4151b50 0x7f7ba41e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.955+0000 7f7baa2d7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba4154600 0x7f7ba413fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.955+0000 7f7baa2d7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba4140650 con 0x7f7ba4154600 2023-10-14T10:35:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.955+0000 7f7baa2d7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba4152710 con 0x7f7b900051d0 2023-10-14T10:35:36.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.955+0000 7f7baa2d7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40a8240 con 0x7f7ba4151b50 2023-10-14T10:35:36.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.955+0000 7f7ba8874640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba4154600 0x7f7ba413fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.955+0000 7f7ba8874640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba4154600 0x7f7ba413fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36422/0 (socket says 172.21.15.8:36422) 2023-10-14T10:35:36.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.955+0000 7f7ba8874640 1 -- 172.21.15.8:0/3004481562 learned_addr learned my addr 172.21.15.8:0/3004481562 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:36.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.955+0000 7f7ba3fff640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b900051d0 0x7f7ba4150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.956+0000 7f7ba8874640 1 -- 172.21.15.8:0/3004481562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7ba4151b50 msgr2=0x7f7ba41e8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.956+0000 7f7ba8874640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7ba4151b50 0x7f7ba41e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.956+0000 7f7ba8874640 1 -- 172.21.15.8:0/3004481562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b900051d0 msgr2=0x7f7ba4150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.956+0000 7f7ba8874640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b900051d0 0x7f7ba4150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.956+0000 7f7ba8874640 1 -- 172.21.15.8:0/3004481562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba4140860 con 0x7f7ba4154600 2023-10-14T10:35:36.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.956+0000 7f7ba8874640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba4154600 0x7f7ba413fac0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c02c3b0 tx=0x7f7b9c001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:36.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.956+0000 7f7ba0ff9640 1 -- 172.21.15.8:0/3004481562 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c007270 con 0x7f7ba4154600 2023-10-14T10:35:36.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.956+0000 7f7ba0ff9640 1 -- 172.21.15.8:0/3004481562 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c004e90 con 0x7f7ba4154600 2023-10-14T10:35:36.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.956+0000 7f7ba0ff9640 1 -- 172.21.15.8:0/3004481562 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c007630 con 0x7f7ba4154600 2023-10-14T10:35:36.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.956+0000 7f7baa2d7640 1 -- 172.21.15.8:0/3004481562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba40a8500 con 0x7f7ba4154600 2023-10-14T10:35:36.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.956+0000 7f7baa2d7640 1 -- 172.21.15.8:0/3004481562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba4149670 con 0x7f7ba4154600 2023-10-14T10:35:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.958+0000 7f7baa2d7640 1 -- 172.21.15.8:0/3004481562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba414e600 con 0x7f7ba4154600 2023-10-14T10:35:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.959+0000 7f7ba0ff9640 1 -- 172.21.15.8:0/3004481562 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7b9c032070 con 0x7f7ba4154600 2023-10-14T10:35:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.959+0000 7f7ba0ff9640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7b8406aea0 0x7f7b8406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.960+0000 7f7ba0ff9640 1 -- 172.21.15.8:0/3004481562 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f7b9c03c070 con 0x7f7ba4154600 2023-10-14T10:35:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.960+0000 7f7ba3fff640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7b8406aea0 0x7f7b8406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.961+0000 7f7ba3fff640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7b8406aea0 0x7f7b8406d360 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7b94005110 tx=0x7f7b94007ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:36.964+0000 7f7ba0ff9640 1 -- 172.21.15.8:0/3004481562 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ba414e600 con 0x7f7ba4154600 2023-10-14T10:35:37.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.159+0000 7f7baa2d7640 1 -- 172.21.15.8:0/3004481562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ba414e600 con 0x7f7ba4154600 2023-10-14T10:35:37.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.160+0000 7f7ba0ff9640 1 -- 172.21.15.8:0/3004481562 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v34) v1 ==== 109+0+11 (secure 0 0 0) 0x7f7ba414e600 con 0x7f7ba4154600 2023-10-14T10:35:37.162 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T10:35:37.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.163+0000 7f7baa2d7640 1 -- 172.21.15.8:0/3004481562 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7b8406aea0 msgr2=0x7f7b8406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.163+0000 7f7baa2d7640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7b8406aea0 0x7f7b8406d360 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7b94005110 tx=0x7f7b94007ed0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.163+0000 7f7baa2d7640 1 -- 172.21.15.8:0/3004481562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba4154600 msgr2=0x7f7ba413fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.163+0000 7f7baa2d7640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba4154600 0x7f7ba413fac0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c02c3b0 tx=0x7f7b9c001930 comp rx=0 tx=0).stop 2023-10-14T10:35:37.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.163+0000 7f7baa2d7640 1 -- 172.21.15.8:0/3004481562 shutdown_connections 2023-10-14T10:35:37.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.163+0000 7f7baa2d7640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f7b8406aea0 0x7f7b8406d360 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.163+0000 7f7baa2d7640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba4154600 0x7f7ba413fac0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.163+0000 7f7baa2d7640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7ba4151b50 0x7f7ba41e8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.163+0000 7f7baa2d7640 1 --2- 172.21.15.8:0/3004481562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b900051d0 0x7f7ba4150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.163+0000 7f7baa2d7640 1 -- 172.21.15.8:0/3004481562 >> 172.21.15.8:0/3004481562 conn(0x7f7ba40a74d0 msgr2=0x7f7ba40c17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:37.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.163+0000 7f7baa2d7640 1 -- 172.21.15.8:0/3004481562 shutdown_connections 2023-10-14T10:35:37.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.163+0000 7f7baa2d7640 1 -- 172.21.15.8:0/3004481562 wait complete. 2023-10-14T10:35:37.186 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T10:35:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.404+0000 7f8f9741a640 1 Processor -- start 2023-10-14T10:35:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.404+0000 7f8f9741a640 1 -- start start 2023-10-14T10:35:37.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.406+0000 7f8f9741a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8f900aa690 0x7f8f900bff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.406+0000 7f8f9741a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f901540b0 0x7f8f900c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.406+0000 7f8f9741a640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f900bfc30 con 0x7f8f900c5ce0 2023-10-14T10:35:37.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.406+0000 7f8f9741a640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f900bf370 con 0x7f8f900aa690 2023-10-14T10:35:37.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.406+0000 7f8f9741a640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900bf670 con 0x7f8f901540b0 2023-10-14T10:35:37.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.406+0000 7f8f951b6640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8f900aa690 0x7f8f900bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:37.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.406+0000 7f8f959b7640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f8f900c5ce0 0x7f8f90157cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56374/0 (socket says 172.21.15.8:56374) 2023-10-14T10:35:37.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.406+0000 7f8f959b7640 1 -- 172.21.15.8:0/2932003877 learned_addr learned my addr 172.21.15.8:0/2932003877 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:37.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.407+0000 7f8f949b5640 1 --2- 172.21.15.8:0/2932003877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f901540b0 0x7f8f900c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:37.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.407+0000 7f8f951b6640 1 -- 172.21.15.8:0/2932003877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f901540b0 msgr2=0x7f8f900c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:37.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.407+0000 7f8f951b6640 1 --2- 172.21.15.8:0/2932003877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f901540b0 0x7f8f900c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.407+0000 7f8f951b6640 1 -- 172.21.15.8:0/2932003877 >> v1:172.21.15.8:6789/0 conn(0x7f8f900c5ce0 legacy=0x7f8f90157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.407+0000 7f8f87fff640 1 -- 172.21.15.8:0/2932003877 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572718205 0 0) 0x7f8f900bfc30 con 0x7f8f900c5ce0 2023-10-14T10:35:37.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.407+0000 7f8f951b6640 1 -- 172.21.15.8:0/2932003877 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f900bf950 con 0x7f8f900aa690 2023-10-14T10:35:37.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.408+0000 7f8f951b6640 1 --2- 172.21.15.8:0/2932003877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f900aa690 0x7f8f900bff50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0097a0 tx=0x7f8f8c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848e29e2108914d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:37.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.408+0000 7f8f87fff640 1 -- 172.21.15.8:0/2932003877 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c02f050 con 0x7f8f900aa690 2023-10-14T10:35:37.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.408+0000 7f8f87fff640 1 -- 172.21.15.8:0/2932003877 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c031700 con 0x7f8f900aa690 2023-10-14T10:35:37.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.408+0000 7f8f87fff640 1 -- 172.21.15.8:0/2932003877 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c031a90 con 0x7f8f900aa690 2023-10-14T10:35:37.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.409+0000 7f8f9741a640 1 -- 172.21.15.8:0/2932003877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f900aa690 msgr2=0x7f8f900bff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.409+0000 7f8f9741a640 1 --2- 172.21.15.8:0/2932003877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f900aa690 0x7f8f900bff50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0097a0 tx=0x7f8f8c02b7a0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.409+0000 7f8f9741a640 1 -- 172.21.15.8:0/2932003877 shutdown_connections 2023-10-14T10:35:37.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.409+0000 7f8f9741a640 1 --2- 172.21.15.8:0/2932003877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f901540b0 0x7f8f900c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.409+0000 7f8f9741a640 1 --2- 172.21.15.8:0/2932003877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f900aa690 0x7f8f900bff50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.409+0000 7f8f9741a640 1 -- 172.21.15.8:0/2932003877 >> 172.21.15.8:0/2932003877 conn(0x7f8f900a74d0 msgr2=0x7f8f900a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.409+0000 7f8f9741a640 1 -- 172.21.15.8:0/2932003877 shutdown_connections 2023-10-14T10:35:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.409+0000 7f8f9741a640 1 -- 172.21.15.8:0/2932003877 wait complete. 2023-10-14T10:35:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.411+0000 7f8f9741a640 1 Processor -- start 2023-10-14T10:35:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.411+0000 7f8f9741a640 1 -- start start 2023-10-14T10:35:37.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.412+0000 7f8f9741a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f900aa690 0x7f8f901ea190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.412+0000 7f8f9741a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f900c5ce0 0x7f8f901ecca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.412+0000 7f8f9741a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f9014f320 0x7f8f900c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.412+0000 7f8f9741a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900c5150 con 0x7f8f900aa690 2023-10-14T10:35:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.412+0000 7f8f9741a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f901ed1e0 con 0x7f8f9014f320 2023-10-14T10:35:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.412+0000 7f8f9741a640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900c4b90 con 0x7f8f900c5ce0 2023-10-14T10:35:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.412+0000 7f8f951b6640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f900aa690 0x7f8f901ea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.412+0000 7f8f951b6640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f900aa690 0x7f8f901ea190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36454/0 (socket says 172.21.15.8:36454) 2023-10-14T10:35:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.412+0000 7f8f951b6640 1 -- 172.21.15.8:0/242298422 learned_addr learned my addr 172.21.15.8:0/242298422 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.413+0000 7f8f959b7640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f9014f320 0x7f8f900c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.413+0000 7f8f949b5640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f900c5ce0 0x7f8f901ecca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.413+0000 7f8f951b6640 1 -- 172.21.15.8:0/242298422 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f900c5ce0 msgr2=0x7f8f901ecca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.413+0000 7f8f951b6640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f900c5ce0 0x7f8f901ecca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.413+0000 7f8f951b6640 1 -- 172.21.15.8:0/242298422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f9014f320 msgr2=0x7f8f900c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.413+0000 7f8f951b6640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f9014f320 0x7f8f900c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.413+0000 7f8f951b6640 1 -- 172.21.15.8:0/242298422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c009400 con 0x7f8f900aa690 2023-10-14T10:35:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.413+0000 7f8f951b6640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f900aa690 0x7f8f901ea190 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c036040 tx=0x7f8f8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.413+0000 7f8f85ffb640 1 -- 172.21.15.8:0/242298422 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c0339b0 con 0x7f8f900aa690 2023-10-14T10:35:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.413+0000 7f8f85ffb640 1 -- 172.21.15.8:0/242298422 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c033b30 con 0x7f8f900aa690 2023-10-14T10:35:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.413+0000 7f8f85ffb640 1 -- 172.21.15.8:0/242298422 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c03c400 con 0x7f8f900aa690 2023-10-14T10:35:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.413+0000 7f8f9741a640 1 -- 172.21.15.8:0/242298422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f900c4e70 con 0x7f8f900aa690 2023-10-14T10:35:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.414+0000 7f8f9741a640 1 -- 172.21.15.8:0/242298422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f900c3770 con 0x7f8f900aa690 2023-10-14T10:35:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.415+0000 7f8f9741a640 1 -- 172.21.15.8:0/242298422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f900c3960 con 0x7f8f900aa690 2023-10-14T10:35:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.416+0000 7f8f85ffb640 1 -- 172.21.15.8:0/242298422 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f8c03a040 con 0x7f8f900aa690 2023-10-14T10:35:37.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.417+0000 7f8f85ffb640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8f7406ae70 0x7f8f7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.417+0000 7f8f85ffb640 1 -- 172.21.15.8:0/242298422 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f8f8c0aa9e0 con 0x7f8f900aa690 2023-10-14T10:35:37.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.417+0000 7f8f949b5640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8f7406ae70 0x7f8f7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.418+0000 7f8f949b5640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8f7406ae70 0x7f8f7406d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f80006fd0 tx=0x7f8f80008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.422+0000 7f8f85ffb640 1 -- 172.21.15.8:0/242298422 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f8c075b80 con 0x7f8f900aa690 2023-10-14T10:35:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.617+0000 7f8f9741a640 1 -- 172.21.15.8:0/242298422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7f8f9004e9b0 con 0x7f8f900aa690 2023-10-14T10:35:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.618+0000 7f8f85ffb640 1 -- 172.21.15.8:0/242298422 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v34) v1 ==== 105+0+11 (secure 0 0 0) 0x7f8f8c0380b0 con 0x7f8f900aa690 2023-10-14T10:35:37.621 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T10:35:37.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.621+0000 7f8f9741a640 1 -- 172.21.15.8:0/242298422 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8f7406ae70 msgr2=0x7f8f7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.621+0000 7f8f9741a640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8f7406ae70 0x7f8f7406d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f80006fd0 tx=0x7f8f80008040 comp rx=0 tx=0).stop 2023-10-14T10:35:37.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.621+0000 7f8f9741a640 1 -- 172.21.15.8:0/242298422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f900aa690 msgr2=0x7f8f901ea190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.621+0000 7f8f9741a640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f900aa690 0x7f8f901ea190 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c036040 tx=0x7f8f8c0046c0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.621+0000 7f8f9741a640 1 -- 172.21.15.8:0/242298422 shutdown_connections 2023-10-14T10:35:37.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.621+0000 7f8f9741a640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8f7406ae70 0x7f8f7406d330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.621+0000 7f8f9741a640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f9014f320 0x7f8f900c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.621+0000 7f8f9741a640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f900c5ce0 0x7f8f901ecca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.621+0000 7f8f9741a640 1 --2- 172.21.15.8:0/242298422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f900aa690 0x7f8f901ea190 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.621+0000 7f8f9741a640 1 -- 172.21.15.8:0/242298422 >> 172.21.15.8:0/242298422 conn(0x7f8f900a74d0 msgr2=0x7f8f901512e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:37.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.621+0000 7f8f9741a640 1 -- 172.21.15.8:0/242298422 shutdown_connections 2023-10-14T10:35:37.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.621+0000 7f8f9741a640 1 -- 172.21.15.8:0/242298422 wait complete. 2023-10-14T10:35:37.641 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:35:37.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.862+0000 7f09d6354640 1 Processor -- start 2023-10-14T10:35:37.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.862+0000 7f09d6354640 1 -- start start 2023-10-14T10:35:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.864+0000 7f09d6354640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f09d014abb0 0x7f09d0151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.864+0000 7f09d6354640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d0071650 con 0x7f09d006faf0 2023-10-14T10:35:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.864+0000 7f09d6354640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d00aa6f0 con 0x7f09d00a9610 2023-10-14T10:35:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.864+0000 7f09d6354640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d00a9280 con 0x7f09d014abb0 2023-10-14T10:35:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.864+0000 7f09d5b53640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f09d006faf0 0x7f09d006ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56388/0 (socket says 172.21.15.8:56388) 2023-10-14T10:35:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.864+0000 7f09d5b53640 1 -- 172.21.15.8:0/729987598 learned_addr learned my addr 172.21.15.8:0/729987598 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458571877 0 0) 0x7f09d0071650 con 0x7f09d006faf0 2023-10-14T10:35:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09d5352640 1 --2- 172.21.15.8:0/729987598 >> v2:172.21.15.92:3300/0 conn(0x7f09d014abb0 0x7f09d0151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:37.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09bc003520 con 0x7f09d006faf0 2023-10-14T10:35:37.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3653211566 0 0) 0x7f09bc003520 con 0x7f09d006faf0 2023-10-14T10:35:37.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 >> v2:172.21.15.92:3300/0 conn(0x7f09d014abb0 msgr2=0x7f09d0151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09c7fff640 1 --2- 172.21.15.8:0/729987598 >> v2:172.21.15.92:3300/0 conn(0x7f09d014abb0 0x7f09d0151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 >> v1:172.21.15.92:6789/0 conn(0x7f09d00a9610 legacy=0x7f09d00c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0070670 con 0x7f09d006faf0 2023-10-14T10:35:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f09c80019f0 con 0x7f09d006faf0 2023-10-14T10:35:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 >> v1:172.21.15.8:6789/0 conn(0x7f09d006faf0 legacy=0x7f09d006ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09c7fff640 1 --2- 172.21.15.8:0/729987598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 0x7f09bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09c7fff640 1 --2- 172.21.15.8:0/729987598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09bc0047c0 0x7f09bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.865+0000 7f09c7fff640 1 --2- 172.21.15.8:0/729987598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f09bc0051d0 0x7f09bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.866+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d00a9280 con 0x7f09bc0039c0 2023-10-14T10:35:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.866+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc00c120 con 0x7f09bc0047c0 2023-10-14T10:35:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.866+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc00c2e0 con 0x7f09bc0051d0 2023-10-14T10:35:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.866+0000 7f09d5352640 1 --2- 172.21.15.8:0/729987598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 0x7f09bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.866+0000 7f09d5352640 1 -- 172.21.15.8:0/729987598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f09bc0051d0 msgr2=0x7f09bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.866+0000 7f09d5352640 1 --2- 172.21.15.8:0/729987598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f09bc0051d0 0x7f09bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.866+0000 7f09d5352640 1 -- 172.21.15.8:0/729987598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09bc0047c0 msgr2=0x7f09bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.866+0000 7f09d4b51640 1 --2- 172.21.15.8:0/729987598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09bc0047c0 0x7f09bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.866+0000 7f09d5352640 1 --2- 172.21.15.8:0/729987598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09bc0047c0 0x7f09bc004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.866+0000 7f09d5b53640 1 -- 172.21.15.8:0/729987598 reap_dead start 2023-10-14T10:35:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.866+0000 7f09d5352640 1 -- 172.21.15.8:0/729987598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc003520 con 0x7f09bc0039c0 2023-10-14T10:35:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.867+0000 7f09d5352640 1 --2- 172.21.15.8:0/729987598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 0x7f09bc003de0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00ba30 tx=0x7f09bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b895f73898de2a5c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:37.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.868+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc032660 con 0x7f09bc0039c0 2023-10-14T10:35:37.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.868+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc0327c0 con 0x7f09bc0039c0 2023-10-14T10:35:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.868+0000 7f09c7fff640 1 -- 172.21.15.8:0/729987598 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc032b50 con 0x7f09bc0039c0 2023-10-14T10:35:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.868+0000 7f09d6354640 1 -- 172.21.15.8:0/729987598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 msgr2=0x7f09bc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.868+0000 7f09d6354640 1 --2- 172.21.15.8:0/729987598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 0x7f09bc003de0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00ba30 tx=0x7f09bc0057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.869+0000 7f09d6354640 1 -- 172.21.15.8:0/729987598 shutdown_connections 2023-10-14T10:35:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.869+0000 7f09d6354640 1 --2- 172.21.15.8:0/729987598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 0x7f09bc003de0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.869+0000 7f09d6354640 1 -- 172.21.15.8:0/729987598 >> 172.21.15.8:0/729987598 conn(0x7f09d006a200 msgr2=0x7f09d006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.869+0000 7f09d6354640 1 -- 172.21.15.8:0/729987598 shutdown_connections 2023-10-14T10:35:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.869+0000 7f09d6354640 1 -- 172.21.15.8:0/729987598 wait complete. 2023-10-14T10:35:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.870+0000 7f09d6354640 1 Processor -- start 2023-10-14T10:35:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.871+0000 7f09d6354640 1 -- start start 2023-10-14T10:35:37.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.871+0000 7f09d6354640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 0x7f09d01ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.871+0000 7f09d6354640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0154090 0x7f09d0148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.872+0000 7f09d6354640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f09d0148e60 0x7f09d01eaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.872+0000 7f09d6354640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d014eaa0 con 0x7f09bc0039c0 2023-10-14T10:35:37.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.872+0000 7f09d6354640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d00c28a0 con 0x7f09d0154090 2023-10-14T10:35:37.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.872+0000 7f09d6354640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d014e550 con 0x7f09d0148e60 2023-10-14T10:35:37.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.872+0000 7f09d5352640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 0x7f09d01ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:37.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.872+0000 7f09d5352640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 0x7f09d01ecb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36486/0 (socket says 172.21.15.8:36486) 2023-10-14T10:35:37.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.872+0000 7f09d5352640 1 -- 172.21.15.8:0/1399163903 learned_addr learned my addr 172.21.15.8:0/1399163903 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:37.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.872+0000 7f09d5352640 1 -- 172.21.15.8:0/1399163903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f09d0148e60 msgr2=0x7f09d01eaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.872+0000 7f09d5352640 1 --2- 172.21.15.8:0/1399163903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f09d0148e60 0x7f09d01eaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.872+0000 7f09d5352640 1 -- 172.21.15.8:0/1399163903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0154090 msgr2=0x7f09d0148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:37.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.872+0000 7f09d5352640 1 --2- 172.21.15.8:0/1399163903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0154090 0x7f09d0148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:37.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.872+0000 7f09d5352640 1 -- 172.21.15.8:0/1399163903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d01ed7c0 con 0x7f09bc0039c0 2023-10-14T10:35:37.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.873+0000 7f09d5352640 1 --2- 172.21.15.8:0/1399163903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 0x7f09d01ecb30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00bb20 tx=0x7f09cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:37.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.873+0000 7f09c5ffb640 1 -- 172.21.15.8:0/1399163903 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc03ca80 con 0x7f09bc0039c0 2023-10-14T10:35:37.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.873+0000 7f09c5ffb640 1 -- 172.21.15.8:0/1399163903 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc03cbe0 con 0x7f09bc0039c0 2023-10-14T10:35:37.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.873+0000 7f09c5ffb640 1 -- 172.21.15.8:0/1399163903 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc030430 con 0x7f09bc0039c0 2023-10-14T10:35:37.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.873+0000 7f09d6354640 1 -- 172.21.15.8:0/1399163903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d014e7c0 con 0x7f09bc0039c0 2023-10-14T10:35:37.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.873+0000 7f09d6354640 1 -- 172.21.15.8:0/1399163903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d01ed070 con 0x7f09bc0039c0 2023-10-14T10:35:37.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.874+0000 7f09d6354640 1 -- 172.21.15.8:0/1399163903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d01ed2c0 con 0x7f09bc0039c0 2023-10-14T10:35:37.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.875+0000 7f09c5ffb640 1 -- 172.21.15.8:0/1399163903 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f09cc030590 con 0x7f09bc0039c0 2023-10-14T10:35:37.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.876+0000 7f09c5ffb640 1 --2- 172.21.15.8:0/1399163903 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f09b406ae70 0x7f09b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:37.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.876+0000 7f09c5ffb640 1 -- 172.21.15.8:0/1399163903 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f09cc0ac1d0 con 0x7f09bc0039c0 2023-10-14T10:35:37.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.876+0000 7f09d4b51640 1 --2- 172.21.15.8:0/1399163903 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f09b406ae70 0x7f09b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:37.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.877+0000 7f09d4b51640 1 --2- 172.21.15.8:0/1399163903 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f09b406ae70 0x7f09b406d330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f09c0000c00 tx=0x7f09c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:37.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:37.881+0000 7f09c5ffb640 1 -- 172.21.15.8:0/1399163903 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09cc07ad70 con 0x7f09bc0039c0 2023-10-14T10:35:38.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.115+0000 7f09d6354640 1 -- 172.21.15.8:0/1399163903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09d004e9b0 con 0x7f09bc0039c0 2023-10-14T10:35:38.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.116+0000 7f09c5ffb640 1 -- 172.21.15.8:0/1399163903 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f09cc006c30 con 0x7f09bc0039c0 2023-10-14T10:35:38.118 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:38.119 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:35:38.119 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:35:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.119+0000 7f09d6354640 1 -- 172.21.15.8:0/1399163903 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f09b406ae70 msgr2=0x7f09b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.119+0000 7f09d6354640 1 --2- 172.21.15.8:0/1399163903 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f09b406ae70 0x7f09b406d330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f09c0000c00 tx=0x7f09c0009040 comp rx=0 tx=0).stop 2023-10-14T10:35:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.119+0000 7f09d6354640 1 -- 172.21.15.8:0/1399163903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 msgr2=0x7f09d01ecb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.119+0000 7f09d6354640 1 --2- 172.21.15.8:0/1399163903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 0x7f09d01ecb30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00bb20 tx=0x7f09cc004730 comp rx=0 tx=0).stop 2023-10-14T10:35:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.119+0000 7f09d6354640 1 -- 172.21.15.8:0/1399163903 shutdown_connections 2023-10-14T10:35:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.119+0000 7f09d6354640 1 --2- 172.21.15.8:0/1399163903 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f09b406ae70 0x7f09b406d330 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.119+0000 7f09d6354640 1 --2- 172.21.15.8:0/1399163903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f09d0148e60 0x7f09d01eaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.119+0000 7f09d6354640 1 --2- 172.21.15.8:0/1399163903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09d0154090 0x7f09d0148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.119+0000 7f09d6354640 1 --2- 172.21.15.8:0/1399163903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09bc0039c0 0x7f09d01ecb30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.119+0000 7f09d6354640 1 -- 172.21.15.8:0/1399163903 >> 172.21.15.8:0/1399163903 conn(0x7f09d006a200 msgr2=0x7f09d00bef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.119+0000 7f09d6354640 1 -- 172.21.15.8:0/1399163903 shutdown_connections 2023-10-14T10:35:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.119+0000 7f09d6354640 1 -- 172.21.15.8:0/1399163903 wait complete. 2023-10-14T10:35:38.141 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:35:38.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.365+0000 7f535359e640 1 Processor -- start 2023-10-14T10:35:38.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.365+0000 7f535359e640 1 -- start start 2023-10-14T10:35:38.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.367+0000 7f535359e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5354152670 0x7f53540c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:38.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.367+0000 7f535359e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f535406b6e0 0x7f5354155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:38.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.367+0000 7f535359e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5354151bf0 con 0x7f53540c2650 2023-10-14T10:35:38.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.367+0000 7f535359e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53540bffd0 con 0x7f5354152670 2023-10-14T10:35:38.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.367+0000 7f535359e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53540c02b0 con 0x7f535406b6e0 2023-10-14T10:35:38.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.367+0000 7f535259c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5354152670 0x7f53540c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:38.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.367+0000 7f535259c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5354152670 0x7f53540c2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36498/0 (socket says 172.21.15.8:36498) 2023-10-14T10:35:38.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.367+0000 7f535259c640 1 -- 172.21.15.8:0/3431330437 learned_addr learned my addr 172.21.15.8:0/3431330437 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:38.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.367+0000 7f5352d9d640 1 --2- 172.21.15.8:0/3431330437 >> v2:172.21.15.92:3300/0 conn(0x7f535406b6e0 0x7f5354155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:38.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.368+0000 7f535259c640 1 -- 172.21.15.8:0/3431330437 >> v2:172.21.15.92:3300/0 conn(0x7f535406b6e0 msgr2=0x7f5354155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:38.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.368+0000 7f535259c640 1 --2- 172.21.15.8:0/3431330437 >> v2:172.21.15.92:3300/0 conn(0x7f535406b6e0 0x7f5354155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.368+0000 7f535259c640 1 -- 172.21.15.8:0/3431330437 >> v1:172.21.15.92:6789/0 conn(0x7f53540c2650 legacy=0x7f53541555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:38.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.368+0000 7f535259c640 1 -- 172.21.15.8:0/3431330437 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53540c0590 con 0x7f5354152670 2023-10-14T10:35:38.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.370+0000 7f535259c640 1 --2- 172.21.15.8:0/3431330437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5354152670 0x7f53540c2110 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f53540c2af0 tx=0x7f534402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339721073f971ae3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:38.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.370+0000 7f535159a640 1 -- 172.21.15.8:0/3431330437 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5344031870 con 0x7f5354152670 2023-10-14T10:35:38.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.370+0000 7f535159a640 1 -- 172.21.15.8:0/3431330437 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53440319d0 con 0x7f5354152670 2023-10-14T10:35:38.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.370+0000 7f535159a640 1 -- 172.21.15.8:0/3431330437 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5344031d60 con 0x7f5354152670 2023-10-14T10:35:38.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.371+0000 7f535359e640 1 -- 172.21.15.8:0/3431330437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5354152670 msgr2=0x7f53540c2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:38.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.371+0000 7f535359e640 1 --2- 172.21.15.8:0/3431330437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5354152670 0x7f53540c2110 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f53540c2af0 tx=0x7f534402b910 comp rx=0 tx=0).stop 2023-10-14T10:35:38.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.371+0000 7f535359e640 1 -- 172.21.15.8:0/3431330437 shutdown_connections 2023-10-14T10:35:38.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.371+0000 7f535359e640 1 --2- 172.21.15.8:0/3431330437 >> v2:172.21.15.92:3300/0 conn(0x7f535406b6e0 0x7f5354155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.371+0000 7f535359e640 1 --2- 172.21.15.8:0/3431330437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5354152670 0x7f53540c2110 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.371+0000 7f535359e640 1 -- 172.21.15.8:0/3431330437 >> 172.21.15.8:0/3431330437 conn(0x7f535406a200 msgr2=0x7f535406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:38.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.371+0000 7f535359e640 1 -- 172.21.15.8:0/3431330437 shutdown_connections 2023-10-14T10:35:38.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.371+0000 7f535359e640 1 -- 172.21.15.8:0/3431330437 wait complete. 2023-10-14T10:35:38.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.373+0000 7f535359e640 1 Processor -- start 2023-10-14T10:35:38.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.373+0000 7f535359e640 1 -- start start 2023-10-14T10:35:38.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.374+0000 7f535359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f535406b6e0 0x7f5354154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:38.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.374+0000 7f535359e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53540c2650 0x7f53540c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:38.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.374+0000 7f535359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5354152670 0x7f53541486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:38.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.374+0000 7f535359e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53541550f0 con 0x7f535406b6e0 2023-10-14T10:35:38.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.374+0000 7f535359e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53541e7850 con 0x7f5354152670 2023-10-14T10:35:38.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.374+0000 7f535359e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53541540d0 con 0x7f53540c2650 2023-10-14T10:35:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.375+0000 7f535259c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f535406b6e0 0x7f5354154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.375+0000 7f535259c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f535406b6e0 0x7f5354154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36510/0 (socket says 172.21.15.8:36510) 2023-10-14T10:35:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.375+0000 7f535259c640 1 -- 172.21.15.8:0/252913246 learned_addr learned my addr 172.21.15.8:0/252913246 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.375+0000 7f5351d9b640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53540c2650 0x7f53540c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.375+0000 7f535259c640 1 -- 172.21.15.8:0/252913246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53540c2650 msgr2=0x7f53540c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:38.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.375+0000 7f5352d9d640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5354152670 0x7f53541486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:38.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.375+0000 7f535259c640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53540c2650 0x7f53540c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.375+0000 7f535259c640 1 -- 172.21.15.8:0/252913246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5354152670 msgr2=0x7f53541486d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:38.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.375+0000 7f535259c640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5354152670 0x7f53541486d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.375+0000 7f535259c640 1 -- 172.21.15.8:0/252913246 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53440094d0 con 0x7f535406b6e0 2023-10-14T10:35:38.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.375+0000 7f5351d9b640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53540c2650 0x7f53540c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:38.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.375+0000 7f5352d9d640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5354152670 0x7f53541486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:38.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.376+0000 7f535259c640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f535406b6e0 0x7f5354154bb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f534402b950 tx=0x7f53440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:38.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.376+0000 7f5342ffd640 1 -- 172.21.15.8:0/252913246 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534403ad30 con 0x7f535406b6e0 2023-10-14T10:35:38.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.376+0000 7f5342ffd640 1 -- 172.21.15.8:0/252913246 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53440443f0 con 0x7f535406b6e0 2023-10-14T10:35:38.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.376+0000 7f5342ffd640 1 -- 172.21.15.8:0/252913246 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440447a0 con 0x7f535406b6e0 2023-10-14T10:35:38.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.376+0000 7f535359e640 1 -- 172.21.15.8:0/252913246 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53541543b0 con 0x7f535406b6e0 2023-10-14T10:35:38.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.376+0000 7f535359e640 1 -- 172.21.15.8:0/252913246 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53540c4c40 con 0x7f535406b6e0 2023-10-14T10:35:38.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.377+0000 7f535359e640 1 -- 172.21.15.8:0/252913246 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53541548d0 con 0x7f535406b6e0 2023-10-14T10:35:38.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.378+0000 7f5342ffd640 1 -- 172.21.15.8:0/252913246 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5344044900 con 0x7f535406b6e0 2023-10-14T10:35:38.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.379+0000 7f5342ffd640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f533406aea0 0x7f533406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:38.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.379+0000 7f5342ffd640 1 -- 172.21.15.8:0/252913246 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f534402d040 con 0x7f535406b6e0 2023-10-14T10:35:38.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.380+0000 7f5351d9b640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f533406aea0 0x7f533406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:38.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.380+0000 7f5351d9b640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f533406aea0 0x7f533406d360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f535414a6d0 tx=0x7f5348009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:38.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.384+0000 7f5342ffd640 1 -- 172.21.15.8:0/252913246 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53541548d0 con 0x7f535406b6e0 2023-10-14T10:35:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.585+0000 7f535359e640 1 -- 172.21.15.8:0/252913246 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53541548d0 con 0x7f535406b6e0 2023-10-14T10:35:38.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.588+0000 7f5342ffd640 1 -- 172.21.15.8:0/252913246 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f53541548d0 con 0x7f535406b6e0 2023-10-14T10:35:38.591 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:38.591 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":34,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:34:49.066182+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T10:34:45.620441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T10:34:46.556786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:35:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.591+0000 7f535359e640 1 -- 172.21.15.8:0/252913246 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f533406aea0 msgr2=0x7f533406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.591+0000 7f535359e640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f533406aea0 0x7f533406d360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f535414a6d0 tx=0x7f5348009040 comp rx=0 tx=0).stop 2023-10-14T10:35:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.591+0000 7f535359e640 1 -- 172.21.15.8:0/252913246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f535406b6e0 msgr2=0x7f5354154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.591+0000 7f535359e640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f535406b6e0 0x7f5354154bb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f534402b950 tx=0x7f53440046c0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.591+0000 7f535359e640 1 -- 172.21.15.8:0/252913246 shutdown_connections 2023-10-14T10:35:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.591+0000 7f535359e640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f533406aea0 0x7f533406d360 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.591+0000 7f535359e640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5354152670 0x7f53541486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.591+0000 7f535359e640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f53540c2650 0x7f53540c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.591+0000 7f535359e640 1 --2- 172.21.15.8:0/252913246 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f535406b6e0 0x7f5354154bb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.591+0000 7f535359e640 1 -- 172.21.15.8:0/252913246 >> 172.21.15.8:0/252913246 conn(0x7f535406a200 msgr2=0x7f53540713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.592+0000 7f535359e640 1 -- 172.21.15.8:0/252913246 shutdown_connections 2023-10-14T10:35:38.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.592+0000 7f535359e640 1 -- 172.21.15.8:0/252913246 wait complete. 2023-10-14T10:35:38.614 INFO:tasks.cephfs.filesystem:Destroying file system testcephfs1 and related pools 2023-10-14T10:35:38.615 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:35:38.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.838+0000 7f08bc78a640 1 Processor -- start 2023-10-14T10:35:38.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.838+0000 7f08bc78a640 1 -- start start 2023-10-14T10:35:38.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.839+0000 7f08bc78a640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08b40c4390 0x7f08b406f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:38.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.839+0000 7f08bc78a640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f08b40c6620 0x7f08b40c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:38.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.839+0000 7f08bc78a640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b40c26f0 con 0x7f08b40ad3b0 2023-10-14T10:35:38.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.839+0000 7f08bc78a640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b4155e20 con 0x7f08b40c4390 2023-10-14T10:35:38.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.839+0000 7f08bc78a640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b40acfb0 con 0x7f08b40c6620 2023-10-14T10:35:38.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.840+0000 7f08ba526640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08b40c4390 0x7f08b406f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:38.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.840+0000 7f08ba526640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f08b40c4390 0x7f08b406f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36518/0 (socket says 172.21.15.8:36518) 2023-10-14T10:35:38.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.840+0000 7f08ba526640 1 -- 172.21.15.8:0/3582407491 learned_addr learned my addr 172.21.15.8:0/3582407491 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:38.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.840+0000 7f08bad27640 1 --2- 172.21.15.8:0/3582407491 >> v2:172.21.15.92:3300/0 conn(0x7f08b40c6620 0x7f08b40c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:38.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.840+0000 7f08ba526640 1 -- 172.21.15.8:0/3582407491 >> v2:172.21.15.92:3300/0 conn(0x7f08b40c6620 msgr2=0x7f08b40c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:38.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.840+0000 7f08ba526640 1 --2- 172.21.15.8:0/3582407491 >> v2:172.21.15.92:3300/0 conn(0x7f08b40c6620 0x7f08b40c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.840+0000 7f08ba526640 1 -- 172.21.15.8:0/3582407491 >> v1:172.21.15.8:6789/0 conn(0x7f08b40ad3b0 legacy=0x7f08b414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:38.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.840+0000 7f08ba526640 1 -- 172.21.15.8:0/3582407491 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b406ff00 con 0x7f08b40c4390 2023-10-14T10:35:38.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.840+0000 7f08b9524640 1 -- 172.21.15.8:0/3582407491 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687027195 0 0) 0x7f08a4001110 con 0x7f08b40ad3b0 2023-10-14T10:35:38.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.842+0000 7f08ba526640 1 --2- 172.21.15.8:0/3582407491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08b40c4390 0x7f08b406f9c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f08b4071ac0 tx=0x7f08b002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc58c77e7fc2c82a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:38.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.842+0000 7f08b9524640 1 -- 172.21.15.8:0/3582407491 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b002ca80 con 0x7f08b40c4390 2023-10-14T10:35:38.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.842+0000 7f08b9524640 1 -- 172.21.15.8:0/3582407491 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b002cbe0 con 0x7f08b40c4390 2023-10-14T10:35:38.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.842+0000 7f08b9524640 1 -- 172.21.15.8:0/3582407491 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00343f0 con 0x7f08b40c4390 2023-10-14T10:35:38.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.843+0000 7f08bc78a640 1 -- 172.21.15.8:0/3582407491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08b40c4390 msgr2=0x7f08b406f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:38.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.843+0000 7f08bc78a640 1 --2- 172.21.15.8:0/3582407491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08b40c4390 0x7f08b406f9c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f08b4071ac0 tx=0x7f08b002bee0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.843+0000 7f08bc78a640 1 -- 172.21.15.8:0/3582407491 shutdown_connections 2023-10-14T10:35:38.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.843+0000 7f08bc78a640 1 --2- 172.21.15.8:0/3582407491 >> v2:172.21.15.92:3300/0 conn(0x7f08b40c6620 0x7f08b40c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.843+0000 7f08bc78a640 1 --2- 172.21.15.8:0/3582407491 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08b40c4390 0x7f08b406f9c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.843+0000 7f08bc78a640 1 -- 172.21.15.8:0/3582407491 >> 172.21.15.8:0/3582407491 conn(0x7f08b40a9280 msgr2=0x7f08b40a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:38.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.843+0000 7f08bc78a640 1 -- 172.21.15.8:0/3582407491 shutdown_connections 2023-10-14T10:35:38.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.843+0000 7f08bc78a640 1 -- 172.21.15.8:0/3582407491 wait complete. 2023-10-14T10:35:38.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.845+0000 7f08bc78a640 1 Processor -- start 2023-10-14T10:35:38.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.845+0000 7f08bc78a640 1 -- start start 2023-10-14T10:35:38.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08bc78a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08b40ad3b0 0x7f08b40a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:38.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08bc78a640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08b40c4390 0x7f08b41ec550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:38.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08bc78a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08b40c6620 0x7f08b41eca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:38.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08bc78a640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b40bae70 con 0x7f08b40c4390 2023-10-14T10:35:38.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08bc78a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b40bf9c0 con 0x7f08b40c6620 2023-10-14T10:35:38.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08bc78a640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b40a90b0 con 0x7f08b40ad3b0 2023-10-14T10:35:38.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08b9d25640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08b40c4390 0x7f08b41ec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:38.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08b9d25640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08b40c4390 0x7f08b41ec550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36528/0 (socket says 172.21.15.8:36528) 2023-10-14T10:35:38.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08b9d25640 1 -- 172.21.15.8:0/866921402 learned_addr learned my addr 172.21.15.8:0/866921402 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:38.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08b9d25640 1 -- 172.21.15.8:0/866921402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08b40ad3b0 msgr2=0x7f08b40a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:38.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08b9d25640 1 --2- 172.21.15.8:0/866921402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08b40ad3b0 0x7f08b40a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08b9d25640 1 -- 172.21.15.8:0/866921402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08b40c6620 msgr2=0x7f08b41eca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:38.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08b9d25640 1 --2- 172.21.15.8:0/866921402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08b40c6620 0x7f08b41eca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:38.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.846+0000 7f08b9d25640 1 -- 172.21.15.8:0/866921402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b0009b30 con 0x7f08b40c4390 2023-10-14T10:35:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.847+0000 7f08b9d25640 1 --2- 172.21.15.8:0/866921402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08b40c4390 0x7f08b41ec550 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f08a400c440 tx=0x7f08a400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.847+0000 7f08aaffd640 1 -- 172.21.15.8:0/866921402 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4005480 con 0x7f08b40c4390 2023-10-14T10:35:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.847+0000 7f08aaffd640 1 -- 172.21.15.8:0/866921402 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a40035f0 con 0x7f08b40c4390 2023-10-14T10:35:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.847+0000 7f08bc78a640 1 -- 172.21.15.8:0/866921402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b41ed2e0 con 0x7f08b40c4390 2023-10-14T10:35:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.847+0000 7f08aaffd640 1 -- 172.21.15.8:0/866921402 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40039a0 con 0x7f08b40c4390 2023-10-14T10:35:38.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.847+0000 7f08bc78a640 1 -- 172.21.15.8:0/866921402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b40bfef0 con 0x7f08b40c4390 2023-10-14T10:35:38.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.848+0000 7f08bc78a640 1 -- 172.21.15.8:0/866921402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b4073b50 con 0x7f08b40c4390 2023-10-14T10:35:38.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.850+0000 7f08aaffd640 1 -- 172.21.15.8:0/866921402 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f08a4003b00 con 0x7f08b40c4390 2023-10-14T10:35:38.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.851+0000 7f08aaffd640 1 --2- 172.21.15.8:0/866921402 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f089806ae70 0x7f089806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:38.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.851+0000 7f08aaffd640 1 -- 172.21.15.8:0/866921402 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f08a4088ad0 con 0x7f08b40c4390 2023-10-14T10:35:38.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.851+0000 7f08ba526640 1 --2- 172.21.15.8:0/866921402 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f089806ae70 0x7f089806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:38.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.852+0000 7f08ba526640 1 --2- 172.21.15.8:0/866921402 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f089806ae70 0x7f089806d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f08b0035000 tx=0x7f08b002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:38.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:38.856+0000 7f08aaffd640 1 -- 172.21.15.8:0/866921402 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08a4053a30 con 0x7f08b40c4390 2023-10-14T10:35:39.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.086+0000 7f08bc78a640 1 -- 172.21.15.8:0/866921402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08b40c26f0 con 0x7f08b40c4390 2023-10-14T10:35:39.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.087+0000 7f08aaffd640 1 -- 172.21.15.8:0/866921402 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f08b40c26f0 con 0x7f08b40c4390 2023-10-14T10:35:39.090 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:39.090 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:35:39.090 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:35:39.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.090+0000 7f08bc78a640 1 -- 172.21.15.8:0/866921402 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f089806ae70 msgr2=0x7f089806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:39.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.090+0000 7f08bc78a640 1 --2- 172.21.15.8:0/866921402 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f089806ae70 0x7f089806d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f08b0035000 tx=0x7f08b002e000 comp rx=0 tx=0).stop 2023-10-14T10:35:39.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.090+0000 7f08bc78a640 1 -- 172.21.15.8:0/866921402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08b40c4390 msgr2=0x7f08b41ec550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.090+0000 7f08bc78a640 1 --2- 172.21.15.8:0/866921402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08b40c4390 0x7f08b41ec550 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f08a400c440 tx=0x7f08a400c900 comp rx=0 tx=0).stop 2023-10-14T10:35:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.090+0000 7f08bc78a640 1 -- 172.21.15.8:0/866921402 shutdown_connections 2023-10-14T10:35:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.090+0000 7f08bc78a640 1 --2- 172.21.15.8:0/866921402 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f089806ae70 0x7f089806d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.090+0000 7f08bc78a640 1 --2- 172.21.15.8:0/866921402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08b40c6620 0x7f08b41eca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.090+0000 7f08bc78a640 1 --2- 172.21.15.8:0/866921402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08b40c4390 0x7f08b41ec550 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.090+0000 7f08bc78a640 1 --2- 172.21.15.8:0/866921402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08b40ad3b0 0x7f08b40a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.090+0000 7f08bc78a640 1 -- 172.21.15.8:0/866921402 >> 172.21.15.8:0/866921402 conn(0x7f08b40a9280 msgr2=0x7f08b40c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.091+0000 7f08bc78a640 1 -- 172.21.15.8:0/866921402 shutdown_connections 2023-10-14T10:35:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.091+0000 7f08bc78a640 1 -- 172.21.15.8:0/866921402 wait complete. 2023-10-14T10:35:39.113 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:35:39.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.336+0000 7f22fffff640 1 Processor -- start 2023-10-14T10:35:39.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.336+0000 7f22fffff640 1 -- start start 2023-10-14T10:35:39.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.337+0000 7f22fffff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f23001514c0 0x7f230006b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.337+0000 7f22fffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23000c50f0 0x7f23000c7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.337+0000 7f22fffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2300154840 0x7f23000c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.337+0000 7f22fffff640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230006c3c0 con 0x7f2300154840 2023-10-14T10:35:39.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.337+0000 7f22fffff640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2300153e30 con 0x7f23001514c0 2023-10-14T10:35:39.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.337+0000 7f22fffff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23000c5e50 con 0x7f23000c50f0 2023-10-14T10:35:39.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.338+0000 7f22ff7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2300154840 0x7f23000c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:39.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.338+0000 7f22ff7fe640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2300154840 0x7f23000c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36534/0 (socket says 172.21.15.8:36534) 2023-10-14T10:35:39.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.338+0000 7f22ff7fe640 1 -- 172.21.15.8:0/3901408501 learned_addr learned my addr 172.21.15.8:0/3901408501 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:39.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.338+0000 7f22ff7fe640 1 -- 172.21.15.8:0/3901408501 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23000c50f0 msgr2=0x7f23000c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:39.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.338+0000 7f22ff7fe640 1 --2- 172.21.15.8:0/3901408501 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23000c50f0 0x7f23000c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.338+0000 7f22ff7fe640 1 -- 172.21.15.8:0/3901408501 >> v2:172.21.15.92:3300/0 conn(0x7f23001514c0 msgr2=0x7f230006b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:39.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.338+0000 7f22feffd640 1 --2- 172.21.15.8:0/3901408501 >> v2:172.21.15.92:3300/0 conn(0x7f23001514c0 0x7f230006b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:39.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.338+0000 7f22ff7fe640 1 --2- 172.21.15.8:0/3901408501 >> v2:172.21.15.92:3300/0 conn(0x7f23001514c0 0x7f230006b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.338+0000 7f22ff7fe640 1 -- 172.21.15.8:0/3901408501 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23001543b0 con 0x7f2300154840 2023-10-14T10:35:39.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.338+0000 7f22feffd640 1 --2- 172.21.15.8:0/3901408501 >> v2:172.21.15.92:3300/0 conn(0x7f23001514c0 0x7f230006b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.340+0000 7f22ff7fe640 1 --2- 172.21.15.8:0/3901408501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2300154840 0x7f23000c4550 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f230006d0d0 tx=0x7f22f802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fc921e85ca3ba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.340+0000 7f22fdffb640 1 -- 172.21.15.8:0/3901408501 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f80317c0 con 0x7f2300154840 2023-10-14T10:35:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.340+0000 7f22fdffb640 1 -- 172.21.15.8:0/3901408501 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f8031920 con 0x7f2300154840 2023-10-14T10:35:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.340+0000 7f22fdffb640 1 -- 172.21.15.8:0/3901408501 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8031cb0 con 0x7f2300154840 2023-10-14T10:35:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.341+0000 7f22fffff640 1 -- 172.21.15.8:0/3901408501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2300154840 msgr2=0x7f23000c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:39.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.341+0000 7f22fffff640 1 --2- 172.21.15.8:0/3901408501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2300154840 0x7f23000c4550 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f230006d0d0 tx=0x7f22f802b860 comp rx=0 tx=0).stop 2023-10-14T10:35:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.341+0000 7f22fffff640 1 -- 172.21.15.8:0/3901408501 shutdown_connections 2023-10-14T10:35:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.341+0000 7f22fffff640 1 --2- 172.21.15.8:0/3901408501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2300154840 0x7f23000c4550 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.341+0000 7f22fffff640 1 --2- 172.21.15.8:0/3901408501 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23000c50f0 0x7f23000c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.341+0000 7f22fffff640 1 --2- 172.21.15.8:0/3901408501 >> v2:172.21.15.92:3300/0 conn(0x7f23001514c0 0x7f230006b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.341+0000 7f22fffff640 1 -- 172.21.15.8:0/3901408501 >> 172.21.15.8:0/3901408501 conn(0x7f23000c60b0 msgr2=0x7f23000c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.341+0000 7f22fffff640 1 -- 172.21.15.8:0/3901408501 shutdown_connections 2023-10-14T10:35:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.341+0000 7f22fffff640 1 -- 172.21.15.8:0/3901408501 wait complete. 2023-10-14T10:35:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.342+0000 7f22fffff640 1 Processor -- start 2023-10-14T10:35:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.343+0000 7f22fffff640 1 -- start start 2023-10-14T10:35:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.343+0000 7f22fffff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23000c50f0 0x7f2300145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22fffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23001514c0 0x7f23000bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2300154840 0x7f23000bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22fffff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000ab7d0 con 0x7f23000c50f0 2023-10-14T10:35:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22fffff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000abfc0 con 0x7f2300154840 2023-10-14T10:35:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22fffff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23000a9080 con 0x7f23001514c0 2023-10-14T10:35:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22feffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23000c50f0 0x7f2300145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22feffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23000c50f0 0x7f2300145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36542/0 (socket says 172.21.15.8:36542) 2023-10-14T10:35:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22feffd640 1 -- 172.21.15.8:0/741489060 learned_addr learned my addr 172.21.15.8:0/741489060 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22feffd640 1 -- 172.21.15.8:0/741489060 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23001514c0 msgr2=0x7f23000bf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22fe7fc640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23001514c0 0x7f23000bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22ff7fe640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2300154840 0x7f23000bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22feffd640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23001514c0 0x7f23000bf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22feffd640 1 -- 172.21.15.8:0/741489060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2300154840 msgr2=0x7f23000bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.344+0000 7f22feffd640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2300154840 0x7f23000bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.345+0000 7f22feffd640 1 -- 172.21.15.8:0/741489060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f80094d0 con 0x7f23000c50f0 2023-10-14T10:35:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.345+0000 7f22ff7fe640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2300154840 0x7f23000bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.345+0000 7f22feffd640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23000c50f0 0x7f2300145720 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f22f000cf60 tx=0x7f22f000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.345+0000 7f22f77fe640 1 -- 172.21.15.8:0/741489060 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f000d840 con 0x7f23000c50f0 2023-10-14T10:35:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.345+0000 7f22f77fe640 1 -- 172.21.15.8:0/741489060 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f000d9a0 con 0x7f23000c50f0 2023-10-14T10:35:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.345+0000 7f22f77fe640 1 -- 172.21.15.8:0/741489060 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f000dd30 con 0x7f23000c50f0 2023-10-14T10:35:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.345+0000 7f22fffff640 1 -- 172.21.15.8:0/741489060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23000aba00 con 0x7f23000c50f0 2023-10-14T10:35:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.345+0000 7f22fffff640 1 -- 172.21.15.8:0/741489060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23000a9320 con 0x7f23000c50f0 2023-10-14T10:35:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.347+0000 7f22fffff640 1 -- 172.21.15.8:0/741489060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23000a9510 con 0x7f23000c50f0 2023-10-14T10:35:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.348+0000 7f22f77fe640 1 -- 172.21.15.8:0/741489060 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f22f0015440 con 0x7f23000c50f0 2023-10-14T10:35:39.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.349+0000 7f22f77fe640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f22e006ae70 0x7f22e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.349+0000 7f22f77fe640 1 -- 172.21.15.8:0/741489060 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f22f0089fd0 con 0x7f23000c50f0 2023-10-14T10:35:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.349+0000 7f22fe7fc640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f22e006ae70 0x7f22e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.350+0000 7f22fe7fc640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f22e006ae70 0x7f22e006d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f230014a680 tx=0x7f22e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:39.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.353+0000 7f22f77fe640 1 -- 172.21.15.8:0/741489060 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22f0055100 con 0x7f23000c50f0 2023-10-14T10:35:39.361 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:35:39.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:35:39.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.596+0000 7f22fffff640 1 -- 172.21.15.8:0/741489060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f230004e9b0 con 0x7f23000c50f0 2023-10-14T10:35:39.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.597+0000 7f22f77fe640 1 -- 172.21.15.8:0/741489060 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f22f001a090 con 0x7f23000c50f0 2023-10-14T10:35:39.600 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:39.600 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T10:34:47.550249+0000","modified":"2023-10-14T10:34:50.997788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.8:6837/799022047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":799022047},{"type":"v1","addr":"172.21.15.8:6837","nonce":799022047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T10:35:39.600 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 17 2023-10-14T10:35:39.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.600+0000 7f22fffff640 1 -- 172.21.15.8:0/741489060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f22e006ae70 msgr2=0x7f22e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:39.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.600+0000 7f22fffff640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f22e006ae70 0x7f22e006d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f230014a680 tx=0x7f22e8008040 comp rx=0 tx=0).stop 2023-10-14T10:35:39.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.600+0000 7f22fffff640 1 -- 172.21.15.8:0/741489060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23000c50f0 msgr2=0x7f2300145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:39.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.600+0000 7f22fffff640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23000c50f0 0x7f2300145720 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f22f000cf60 tx=0x7f22f000cf90 comp rx=0 tx=0).stop 2023-10-14T10:35:39.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.600+0000 7f22fffff640 1 -- 172.21.15.8:0/741489060 shutdown_connections 2023-10-14T10:35:39.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.600+0000 7f22fffff640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f22e006ae70 0x7f22e006d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.600+0000 7f22fffff640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2300154840 0x7f23000bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.600+0000 7f22fffff640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23001514c0 0x7f23000bf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.600+0000 7f22fffff640 1 --2- 172.21.15.8:0/741489060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23000c50f0 0x7f2300145720 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.600+0000 7f22fffff640 1 -- 172.21.15.8:0/741489060 >> 172.21.15.8:0/741489060 conn(0x7f23000c60b0 msgr2=0x7f2300152b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:39.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.601+0000 7f22fffff640 1 -- 172.21.15.8:0/741489060 shutdown_connections 2023-10-14T10:35:39.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.601+0000 7f22fffff640 1 -- 172.21.15.8:0/741489060 wait complete. 2023-10-14T10:35:39.622 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:35:39.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.845+0000 7f4d1132e640 1 Processor -- start 2023-10-14T10:35:39.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.846+0000 7f4d1132e640 1 -- start start 2023-10-14T10:35:39.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.847+0000 7f4d1132e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4d0c0c6ed0 0x7f4d0c0c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.847+0000 7f4d1132e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c06fc50 con 0x7f4d0c14f580 2023-10-14T10:35:39.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.847+0000 7f4d1132e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c06f900 con 0x7f4d0c0c1ec0 2023-10-14T10:35:39.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.847+0000 7f4d1132e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c0c6900 con 0x7f4d0c0c6ed0 2023-10-14T10:35:39.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.847+0000 7f4d0bfff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4d0c14f580 0x7f4d0c0c74d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56410/0 (socket says 172.21.15.8:56410) 2023-10-14T10:35:39.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.847+0000 7f4d0bfff640 1 -- 172.21.15.8:0/4135624878 learned_addr learned my addr 172.21.15.8:0/4135624878 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:39.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560990109 0 0) 0x7f4d0c06fc50 con 0x7f4d0c14f580 2023-10-14T10:35:39.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf4003520 con 0x7f4d0c14f580 2023-10-14T10:35:39.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3755272278 0 0) 0x7f4cf4003520 con 0x7f4d0c14f580 2023-10-14T10:35:39.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 >> v2:172.21.15.92:3300/0 conn(0x7f4d0c0c6ed0 msgr2=0x7f4d0c0c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:39.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 --2- 172.21.15.8:0/4135624878 >> v2:172.21.15.92:3300/0 conn(0x7f4d0c0c6ed0 0x7f4d0c0c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 >> v1:172.21.15.92:6789/0 conn(0x7f4d0c0c1ec0 legacy=0x7f4d0c0c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:39.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c152a60 con 0x7f4d0c14f580 2023-10-14T10:35:39.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f4cfc0019f0 con 0x7f4d0c14f580 2023-10-14T10:35:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 >> v1:172.21.15.8:6789/0 conn(0x7f4d0c14f580 legacy=0x7f4d0c0c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 --2- 172.21.15.8:0/4135624878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf40039a0 0x7f4cf4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 --2- 172.21.15.8:0/4135624878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cf40047c0 0x7f4cf4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 --2- 172.21.15.8:0/4135624878 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cf40053b0 0x7f4cf400ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0c6900 con 0x7f4cf40039a0 2023-10-14T10:35:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf400c300 con 0x7f4cf40047c0 2023-10-14T10:35:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.848+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf400c4c0 con 0x7f4cf40053b0 2023-10-14T10:35:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.849+0000 7f4d0bfff640 1 --2- 172.21.15.8:0/4135624878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf40039a0 0x7f4cf4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.849+0000 7f4d0bfff640 1 -- 172.21.15.8:0/4135624878 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cf40053b0 msgr2=0x7f4cf400ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:39.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.849+0000 7f4d0bfff640 1 --2- 172.21.15.8:0/4135624878 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cf40053b0 0x7f4cf400ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.849+0000 7f4d0bfff640 1 -- 172.21.15.8:0/4135624878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cf40047c0 msgr2=0x7f4cf4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:39.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.849+0000 7f4d0b7fe640 1 --2- 172.21.15.8:0/4135624878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cf40047c0 0x7f4cf4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:39.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.849+0000 7f4d0bfff640 1 --2- 172.21.15.8:0/4135624878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cf40047c0 0x7f4cf4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.849+0000 7f4d10b2d640 1 -- 172.21.15.8:0/4135624878 reap_dead start 2023-10-14T10:35:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.849+0000 7f4d0bfff640 1 -- 172.21.15.8:0/4135624878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4003520 con 0x7f4cf40039a0 2023-10-14T10:35:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.849+0000 7f4d0b7fe640 1 --2- 172.21.15.8:0/4135624878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cf40047c0 0x7f4cf4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:39.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.850+0000 7f4d0bfff640 1 --2- 172.21.15.8:0/4135624878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf40039a0 0x7f4cf4003da0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00a840 tx=0x7f4cf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c59a4b2d131f5f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:39.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.851+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc034630 con 0x7f4cf40039a0 2023-10-14T10:35:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.851+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc02f070 con 0x7f4cf40039a0 2023-10-14T10:35:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.851+0000 7f4d0affd640 1 -- 172.21.15.8:0/4135624878 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc034a10 con 0x7f4cf40039a0 2023-10-14T10:35:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.851+0000 7f4d1132e640 1 -- 172.21.15.8:0/4135624878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf40039a0 msgr2=0x7f4cf4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:39.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.851+0000 7f4d1132e640 1 --2- 172.21.15.8:0/4135624878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf40039a0 0x7f4cf4003da0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00a840 tx=0x7f4cf40057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.851+0000 7f4d1132e640 1 -- 172.21.15.8:0/4135624878 shutdown_connections 2023-10-14T10:35:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.851+0000 7f4d1132e640 1 --2- 172.21.15.8:0/4135624878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf40039a0 0x7f4cf4003da0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.851+0000 7f4d1132e640 1 -- 172.21.15.8:0/4135624878 >> 172.21.15.8:0/4135624878 conn(0x7f4d0c065ab0 msgr2=0x7f4d0c065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.851+0000 7f4d1132e640 1 -- 172.21.15.8:0/4135624878 shutdown_connections 2023-10-14T10:35:39.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.852+0000 7f4d1132e640 1 -- 172.21.15.8:0/4135624878 wait complete. 2023-10-14T10:35:39.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.853+0000 7f4d1132e640 1 Processor -- start 2023-10-14T10:35:39.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.853+0000 7f4d1132e640 1 -- start start 2023-10-14T10:35:39.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.854+0000 7f4d1132e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cf40039a0 0x7f4d0c0a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.854+0000 7f4d1132e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c0be610 0x7f4d0c1e9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.854+0000 7f4d1132e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d0c09e1e0 0x7f4d0c0c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.854+0000 7f4d1132e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c09d690 con 0x7f4d0c09e1e0 2023-10-14T10:35:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.854+0000 7f4d1132e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c1e8b50 con 0x7f4d0c0be610 2023-10-14T10:35:39.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.854+0000 7f4d1132e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c09ce80 con 0x7f4cf40039a0 2023-10-14T10:35:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.855+0000 7f4d10b2d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d0c09e1e0 0x7f4d0c0c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.855+0000 7f4d10b2d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d0c09e1e0 0x7f4d0c0c0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36556/0 (socket says 172.21.15.8:36556) 2023-10-14T10:35:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.855+0000 7f4d10b2d640 1 -- 172.21.15.8:0/851614052 learned_addr learned my addr 172.21.15.8:0/851614052 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.855+0000 7f4d0bfff640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cf40039a0 0x7f4d0c0a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:39.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.855+0000 7f4d10b2d640 1 -- 172.21.15.8:0/851614052 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cf40039a0 msgr2=0x7f4d0c0a80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.855+0000 7f4d10b2d640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cf40039a0 0x7f4d0c0a80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.855+0000 7f4d10b2d640 1 -- 172.21.15.8:0/851614052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c0be610 msgr2=0x7f4d0c1e9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.855+0000 7f4d0b7fe640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c0be610 0x7f4d0c1e9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.855+0000 7f4d10b2d640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c0be610 0x7f4d0c1e9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:39.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.855+0000 7f4d10b2d640 1 -- 172.21.15.8:0/851614052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c09d0d0 con 0x7f4d0c09e1e0 2023-10-14T10:35:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.855+0000 7f4d0b7fe640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c0be610 0x7f4d0c1e9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.856+0000 7f4d10b2d640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d0c09e1e0 0x7f4d0c0c0b10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0aa060 tx=0x7f4d0400c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.856+0000 7f4d08ff9640 1 -- 172.21.15.8:0/851614052 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d040072d0 con 0x7f4d0c09e1e0 2023-10-14T10:35:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.856+0000 7f4d08ff9640 1 -- 172.21.15.8:0/851614052 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d04007430 con 0x7f4d0c09e1e0 2023-10-14T10:35:39.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.856+0000 7f4d08ff9640 1 -- 172.21.15.8:0/851614052 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d040057c0 con 0x7f4d0c09e1e0 2023-10-14T10:35:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.856+0000 7f4d1132e640 1 -- 172.21.15.8:0/851614052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c09d3b0 con 0x7f4d0c09e1e0 2023-10-14T10:35:39.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.856+0000 7f4d1132e640 1 -- 172.21.15.8:0/851614052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c06b820 con 0x7f4d0c09e1e0 2023-10-14T10:35:39.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.857+0000 7f4d1132e640 1 -- 172.21.15.8:0/851614052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c1e8fa0 con 0x7f4d0c09e1e0 2023-10-14T10:35:39.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.858+0000 7f4d08ff9640 1 -- 172.21.15.8:0/851614052 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d04005920 con 0x7f4d0c09e1e0 2023-10-14T10:35:39.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.859+0000 7f4d08ff9640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4cf806aea0 0x7f4cf806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:39.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.859+0000 7f4d08ff9640 1 -- 172.21.15.8:0/851614052 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4d04088830 con 0x7f4d0c09e1e0 2023-10-14T10:35:39.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.859+0000 7f4d0bfff640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4cf806aea0 0x7f4cf806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:39.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.860+0000 7f4d0bfff640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4cf806aea0 0x7f4cf806d360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc034000 tx=0x7f4cfc02f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:39.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:39.863+0000 7f4d08ff9640 1 -- 172.21.15.8:0/851614052 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d0c1e8fa0 con 0x7f4d0c09e1e0 2023-10-14T10:35:40.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.059+0000 7f4d1132e640 1 -- 172.21.15.8:0/851614052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d0c1e8fa0 con 0x7f4d0c09e1e0 2023-10-14T10:35:40.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.062+0000 7f4d08ff9640 1 -- 172.21.15.8:0/851614052 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f4d0c1e8fa0 con 0x7f4d0c09e1e0 2023-10-14T10:35:40.064 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:40.065 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":34,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:34:49.066182+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T10:34:45.620441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T10:34:46.556786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:35:40.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.065+0000 7f4d1132e640 1 -- 172.21.15.8:0/851614052 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4cf806aea0 msgr2=0x7f4cf806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.065+0000 7f4d1132e640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4cf806aea0 0x7f4cf806d360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc034000 tx=0x7f4cfc02f000 comp rx=0 tx=0).stop 2023-10-14T10:35:40.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.065+0000 7f4d1132e640 1 -- 172.21.15.8:0/851614052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d0c09e1e0 msgr2=0x7f4d0c0c0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.065+0000 7f4d1132e640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d0c09e1e0 0x7f4d0c0c0b10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0aa060 tx=0x7f4d0400c610 comp rx=0 tx=0).stop 2023-10-14T10:35:40.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.065+0000 7f4d1132e640 1 -- 172.21.15.8:0/851614052 shutdown_connections 2023-10-14T10:35:40.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.065+0000 7f4d1132e640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4cf806aea0 0x7f4cf806d360 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.065+0000 7f4d1132e640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d0c09e1e0 0x7f4d0c0c0b10 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.065+0000 7f4d1132e640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d0c0be610 0x7f4d0c1e9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.065+0000 7f4d1132e640 1 --2- 172.21.15.8:0/851614052 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cf40039a0 0x7f4d0c0a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.065+0000 7f4d1132e640 1 -- 172.21.15.8:0/851614052 >> 172.21.15.8:0/851614052 conn(0x7f4d0c065ab0 msgr2=0x7f4d0c06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:40.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.066+0000 7f4d1132e640 1 -- 172.21.15.8:0/851614052 shutdown_connections 2023-10-14T10:35:40.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.066+0000 7f4d1132e640 1 -- 172.21.15.8:0/851614052 wait complete. 2023-10-14T10:35:40.085 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail testcephfs1 2023-10-14T10:35:40.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.306+0000 7f52ebfff640 1 Processor -- start 2023-10-14T10:35:40.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.306+0000 7f52ebfff640 1 -- start start 2023-10-14T10:35:40.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.308+0000 7f52ebfff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec13af90 0x7f52ec0a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.308+0000 7f52ebfff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec152ac0 con 0x7f52ec0bfc10 2023-10-14T10:35:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.308+0000 7f52ebfff640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec151eb0 con 0x7f52ec06fb10 2023-10-14T10:35:40.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.308+0000 7f52ebfff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec152190 con 0x7f52ec13af90 2023-10-14T10:35:40.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.309+0000 7f52eb7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f52ec0bfc10 0x7f52ec0c00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56424/0 (socket says 172.21.15.8:56424) 2023-10-14T10:35:40.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.309+0000 7f52eb7fe640 1 -- 172.21.15.8:0/2414469650 learned_addr learned my addr 172.21.15.8:0/2414469650 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.309+0000 7f52eaffd640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec13af90 0x7f52ec0a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.309+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242554218 0 0) 0x7f52ec152ac0 con 0x7f52ec0bfc10 2023-10-14T10:35:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.309+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d8003520 con 0x7f52ec0bfc10 2023-10-14T10:35:40.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999969855 0 0) 0x7f52ec151eb0 con 0x7f52ec06fb10 2023-10-14T10:35:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ec152ac0 con 0x7f52ec06fb10 2023-10-14T10:35:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2938622416 0 0) 0x7f52d8003520 con 0x7f52ec0bfc10 2023-10-14T10:35:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec13af90 msgr2=0x7f52ec0a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec13af90 0x7f52ec0a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 >> v1:172.21.15.92:6789/0 conn(0x7f52ec06fb10 legacy=0x7f52ec0c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec152470 con 0x7f52ec0bfc10 2023-10-14T10:35:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f52e40019f0 con 0x7f52ec0bfc10 2023-10-14T10:35:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 >> v1:172.21.15.8:6789/0 conn(0x7f52ec0bfc10 legacy=0x7f52ec0c00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d8003b30 0x7f52d8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec13af90 0x7f52d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52d8004d00 0x7f52d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec152190 con 0x7f52d8004d00 2023-10-14T10:35:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d800bb10 con 0x7f52d8003b30 2023-10-14T10:35:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d800bca0 con 0x7f52ec13af90 2023-10-14T10:35:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.310+0000 7f52eb7fe640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52d8004d00 0x7f52d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.311+0000 7f52eaffd640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d8003b30 0x7f52d8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.311+0000 7f52eb7fe640 1 -- 172.21.15.8:0/2414469650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec13af90 msgr2=0x7f52d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.311+0000 7f52e3fff640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec13af90 0x7f52d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.311+0000 7f52eb7fe640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec13af90 0x7f52d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.311+0000 7f52eb7fe640 1 -- 172.21.15.8:0/2414469650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d8003b30 msgr2=0x7f52d8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:40.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.311+0000 7f52eb7fe640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d8003b30 0x7f52d8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.311+0000 7f52eb7fe640 1 -- 172.21.15.8:0/2414469650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d8003520 con 0x7f52d8004d00 2023-10-14T10:35:40.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.311+0000 7f52e3fff640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec13af90 0x7f52d80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.312+0000 7f52eb7fe640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52d8004d00 0x7f52d8005180 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f52e400a730 tx=0x7f52d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64356ab94d0f3382 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.312+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4034630 con 0x7f52d8004d00 2023-10-14T10:35:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.312+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e402f070 con 0x7f52d8004d00 2023-10-14T10:35:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.312+0000 7f52ea7fc640 1 -- 172.21.15.8:0/2414469650 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e40349f0 con 0x7f52d8004d00 2023-10-14T10:35:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.313+0000 7f52ebfff640 1 -- 172.21.15.8:0/2414469650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52d8004d00 msgr2=0x7f52d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.313+0000 7f52ebfff640 1 --2- 172.21.15.8:0/2414469650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52d8004d00 0x7f52d8005180 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f52e400a730 tx=0x7f52d80057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.313+0000 7f52eb7fe640 1 -- 172.21.15.8:0/2414469650 reap_dead start 2023-10-14T10:35:40.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.313+0000 7f52ebfff640 1 -- 172.21.15.8:0/2414469650 shutdown_connections 2023-10-14T10:35:40.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.313+0000 7f52ebfff640 1 -- 172.21.15.8:0/2414469650 >> 172.21.15.8:0/2414469650 conn(0x7f52ec06a200 msgr2=0x7f52ec06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:40.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.313+0000 7f52ebfff640 1 -- 172.21.15.8:0/2414469650 shutdown_connections 2023-10-14T10:35:40.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.313+0000 7f52ebfff640 1 -- 172.21.15.8:0/2414469650 wait complete. 2023-10-14T10:35:40.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.315+0000 7f52ebfff640 1 Processor -- start 2023-10-14T10:35:40.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.315+0000 7f52ebfff640 1 -- start start 2023-10-14T10:35:40.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.316+0000 7f52ebfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d8004d00 0x7f52ec0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.316+0000 7f52ebfff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52ec0bc590 0x7f52ec1e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.316+0000 7f52ebfff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec06b940 0x7f52ec1e94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.316+0000 7f52ebfff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0bbf20 con 0x7f52ec0bc590 2023-10-14T10:35:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.316+0000 7f52ebfff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec14f420 con 0x7f52d8004d00 2023-10-14T10:35:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.316+0000 7f52ebfff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec1e9cd0 con 0x7f52ec06b940 2023-10-14T10:35:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.316+0000 7f52e3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52ec0bc590 0x7f52ec1e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.316+0000 7f52e3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52ec0bc590 0x7f52ec1e8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36566/0 (socket says 172.21.15.8:36566) 2023-10-14T10:35:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.317+0000 7f52e3fff640 1 -- 172.21.15.8:0/1690683391 learned_addr learned my addr 172.21.15.8:0/1690683391 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.317+0000 7f52eaffd640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d8004d00 0x7f52ec0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.317+0000 7f52eb7fe640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec06b940 0x7f52ec1e94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.317+0000 7f52e3fff640 1 -- 172.21.15.8:0/1690683391 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec06b940 msgr2=0x7f52ec1e94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.317+0000 7f52e3fff640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec06b940 0x7f52ec1e94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.317+0000 7f52e3fff640 1 -- 172.21.15.8:0/1690683391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d8004d00 msgr2=0x7f52ec0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.317+0000 7f52e3fff640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d8004d00 0x7f52ec0c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.317+0000 7f52e3fff640 1 -- 172.21.15.8:0/1690683391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec0bbbb0 con 0x7f52ec0bc590 2023-10-14T10:35:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.317+0000 7f52e3fff640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52ec0bc590 0x7f52ec1e8f70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f52d400d7a0 tx=0x7f52d400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.318+0000 7f52e37fe640 1 -- 172.21.15.8:0/1690683391 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d400bac0 con 0x7f52ec0bc590 2023-10-14T10:35:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.318+0000 7f52e37fe640 1 -- 172.21.15.8:0/1690683391 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d400bc20 con 0x7f52ec0bc590 2023-10-14T10:35:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.318+0000 7f52e37fe640 1 -- 172.21.15.8:0/1690683391 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d400de50 con 0x7f52ec0bc590 2023-10-14T10:35:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.318+0000 7f52ebfff640 1 -- 172.21.15.8:0/1690683391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec1e99f0 con 0x7f52ec0bc590 2023-10-14T10:35:40.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.318+0000 7f52ebfff640 1 -- 172.21.15.8:0/1690683391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec06de10 con 0x7f52ec0bc590 2023-10-14T10:35:40.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.319+0000 7f52ebfff640 1 -- 172.21.15.8:0/1690683391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ec0619f0 con 0x7f52ec0bc590 2023-10-14T10:35:40.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.320+0000 7f52e37fe640 1 -- 172.21.15.8:0/1690683391 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f52d4007020 con 0x7f52ec0bc590 2023-10-14T10:35:40.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.321+0000 7f52e37fe640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f52cc06aea0 0x7f52cc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.321+0000 7f52e37fe640 1 -- 172.21.15.8:0/1690683391 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f52d40894c0 con 0x7f52ec0bc590 2023-10-14T10:35:40.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.321+0000 7f52eaffd640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f52cc06aea0 0x7f52cc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.322+0000 7f52eaffd640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f52cc06aea0 0x7f52cc06d360 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009a10 tx=0x7f52dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.325+0000 7f52e37fe640 1 -- 172.21.15.8:0/1690683391 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52d4054550 con 0x7f52ec0bc590 2023-10-14T10:35:40.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.564+0000 7f52ebfff640 1 -- 172.21.15.8:0/1690683391 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "testcephfs1"} v 0) v1 -- 0x7f52ec0bf8f0 con 0x7f52ec0bc590 2023-10-14T10:35:40.567 INFO:tasks.ceph.mon.a.smithi008.stderr:2023-10-14T10:35:40.565+0000 7fe3273a6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T10:35:40.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.569+0000 7f52e37fe640 1 -- 172.21.15.8:0/1690683391 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "testcephfs1"}]=0 testcephfs1 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f52d4001370 con 0x7f52ec0bc590 2023-10-14T10:35:40.571 INFO:teuthology.orchestra.run.smithi008.stderr:testcephfs1 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T10:35:40.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.572+0000 7f52ebfff640 1 -- 172.21.15.8:0/1690683391 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f52cc06aea0 msgr2=0x7f52cc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.572+0000 7f52ebfff640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f52cc06aea0 0x7f52cc06d360 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009a10 tx=0x7f52dc008040 comp rx=0 tx=0).stop 2023-10-14T10:35:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.572+0000 7f52ebfff640 1 -- 172.21.15.8:0/1690683391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52ec0bc590 msgr2=0x7f52ec1e8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.572+0000 7f52ebfff640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52ec0bc590 0x7f52ec1e8f70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f52d400d7a0 tx=0x7f52d400dc60 comp rx=0 tx=0).stop 2023-10-14T10:35:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.572+0000 7f52ebfff640 1 -- 172.21.15.8:0/1690683391 shutdown_connections 2023-10-14T10:35:40.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.572+0000 7f52ebfff640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f52cc06aea0 0x7f52cc06d360 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.572+0000 7f52ebfff640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52ec06b940 0x7f52ec1e94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.572+0000 7f52ebfff640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52ec0bc590 0x7f52ec1e8f70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.572+0000 7f52ebfff640 1 --2- 172.21.15.8:0/1690683391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52d8004d00 0x7f52ec0c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.572+0000 7f52ebfff640 1 -- 172.21.15.8:0/1690683391 >> 172.21.15.8:0/1690683391 conn(0x7f52ec06a200 msgr2=0x7f52ec0732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:40.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.573+0000 7f52ebfff640 1 -- 172.21.15.8:0/1690683391 shutdown_connections 2023-10-14T10:35:40.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.573+0000 7f52ebfff640 1 -- 172.21.15.8:0/1690683391 wait complete. 2023-10-14T10:35:40.581 INFO:tasks.ceph.mds.c.smithi008.stderr: -1501> 2023-10-14T10:34:51.026+0000 7fb9163bc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T10:35:40.595 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm testcephfs1 --yes-i-really-mean-it 2023-10-14T10:35:40.627 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2023-10-14T10:35:40.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.790+0000 7fdd1cfae640 1 Processor -- start 2023-10-14T10:35:40.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.790+0000 7fdd1cfae640 1 -- start start 2023-10-14T10:35:40.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.792+0000 7fdd1cfae640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdd180bbf60 0x7fdd18150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.792+0000 7fdd1cfae640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd18154d90 con 0x7fdd180c23a0 2023-10-14T10:35:40.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.792+0000 7fdd1cfae640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd18155220 con 0x7fdd1814e680 2023-10-14T10:35:40.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.792+0000 7fdd1cfae640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180bc3f0 con 0x7fdd180bbf60 2023-10-14T10:35:40.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.792+0000 7fdd177fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fdd180c23a0 0x7fdd1814df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56434/0 (socket says 172.21.15.8:56434) 2023-10-14T10:35:40.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.792+0000 7fdd177fe640 1 -- 172.21.15.8:0/1239706907 learned_addr learned my addr 172.21.15.8:0/1239706907 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:40.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.793+0000 7fdd0ffff640 1 --2- 172.21.15.8:0/1239706907 >> v2:172.21.15.8:3300/0 conn(0x7fdd180bbf60 0x7fdd18150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.793+0000 7fdd16ffd640 1 -- 172.21.15.8:0/1239706907 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198798559 0 0) 0x7fdd18154d90 con 0x7fdd180c23a0 2023-10-14T10:35:40.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.793+0000 7fdd16ffd640 1 -- 172.21.15.8:0/1239706907 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd04003520 con 0x7fdd180c23a0 2023-10-14T10:35:40.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.793+0000 7fdd0ffff640 1 -- 172.21.15.8:0/1239706907 >> v1:172.21.15.92:6789/0 conn(0x7fdd1814e680 legacy=0x7fdd18151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.793+0000 7fdd0ffff640 1 -- 172.21.15.8:0/1239706907 >> v1:172.21.15.8:6789/0 conn(0x7fdd180c23a0 legacy=0x7fdd1814df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.793+0000 7fdd0ffff640 1 -- 172.21.15.8:0/1239706907 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18154460 con 0x7fdd180bbf60 2023-10-14T10:35:40.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.795+0000 7fdd0ffff640 1 --2- 172.21.15.8:0/1239706907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd180bbf60 0x7fdd18150cd0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdd000097a0 tx=0x7fdd0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6cf2562b82cef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:40.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.795+0000 7fdd16ffd640 1 -- 172.21.15.8:0/1239706907 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00031830 con 0x7fdd180bbf60 2023-10-14T10:35:40.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.795+0000 7fdd16ffd640 1 -- 172.21.15.8:0/1239706907 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd00031990 con 0x7fdd180bbf60 2023-10-14T10:35:40.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.795+0000 7fdd16ffd640 1 -- 172.21.15.8:0/1239706907 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00031d20 con 0x7fdd180bbf60 2023-10-14T10:35:40.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.795+0000 7fdd1cfae640 1 -- 172.21.15.8:0/1239706907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd180bbf60 msgr2=0x7fdd18150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.795+0000 7fdd1cfae640 1 --2- 172.21.15.8:0/1239706907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd180bbf60 0x7fdd18150cd0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdd000097a0 tx=0x7fdd0002b8d0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.796+0000 7fdd1cfae640 1 -- 172.21.15.8:0/1239706907 shutdown_connections 2023-10-14T10:35:40.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.796+0000 7fdd1cfae640 1 --2- 172.21.15.8:0/1239706907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd180bbf60 0x7fdd18150cd0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.796+0000 7fdd1cfae640 1 -- 172.21.15.8:0/1239706907 >> 172.21.15.8:0/1239706907 conn(0x7fdd1806a200 msgr2=0x7fdd1806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:40.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.796+0000 7fdd1cfae640 1 -- 172.21.15.8:0/1239706907 shutdown_connections 2023-10-14T10:35:40.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.796+0000 7fdd1cfae640 1 -- 172.21.15.8:0/1239706907 wait complete. 2023-10-14T10:35:40.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.797+0000 7fdd1cfae640 1 Processor -- start 2023-10-14T10:35:40.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.797+0000 7fdd1cfae640 1 -- start start 2023-10-14T10:35:40.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.798+0000 7fdd1cfae640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd180c23a0 0x7fdd18073530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.798+0000 7fdd1cfae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd1814e680 0x7fdd181423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.798+0000 7fdd1cfae640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd1811e470 0x7fdd18142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.798+0000 7fdd1cfae640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18142e40 con 0x7fdd1811e470 2023-10-14T10:35:40.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.798+0000 7fdd1cfae640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181e98e0 con 0x7fdd1814e680 2023-10-14T10:35:40.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.798+0000 7fdd1cfae640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18150380 con 0x7fdd180c23a0 2023-10-14T10:35:40.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.799+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd1811e470 0x7fdd18142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.799+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd1811e470 0x7fdd18142900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36610/0 (socket says 172.21.15.8:36610) 2023-10-14T10:35:40.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.799+0000 7fdd17fff640 1 -- 172.21.15.8:0/2867083680 learned_addr learned my addr 172.21.15.8:0/2867083680 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:40.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.799+0000 7fdd0ffff640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd1814e680 0x7fdd181423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.799+0000 7fdd177fe640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd180c23a0 0x7fdd18073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.799+0000 7fdd17fff640 1 -- 172.21.15.8:0/2867083680 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd180c23a0 msgr2=0x7fdd18073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.799+0000 7fdd17fff640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd180c23a0 0x7fdd18073530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.799+0000 7fdd17fff640 1 -- 172.21.15.8:0/2867083680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd1814e680 msgr2=0x7fdd181423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:40.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.799+0000 7fdd17fff640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd1814e680 0x7fdd181423c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:40.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.799+0000 7fdd17fff640 1 -- 172.21.15.8:0/2867083680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00009400 con 0x7fdd1811e470 2023-10-14T10:35:40.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.799+0000 7fdd0ffff640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd1814e680 0x7fdd181423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:40.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.799+0000 7fdd17fff640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd1811e470 0x7fdd18142900 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000c6b0 tx=0x7fdd1000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:40.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.800+0000 7fdd14ff9640 1 -- 172.21.15.8:0/2867083680 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10003b70 con 0x7fdd1811e470 2023-10-14T10:35:40.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.800+0000 7fdd14ff9640 1 -- 172.21.15.8:0/2867083680 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd10003cf0 con 0x7fdd1811e470 2023-10-14T10:35:40.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.800+0000 7fdd14ff9640 1 -- 172.21.15.8:0/2867083680 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10003ea0 con 0x7fdd1811e470 2023-10-14T10:35:40.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.800+0000 7fdd1cfae640 1 -- 172.21.15.8:0/2867083680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd18150660 con 0x7fdd1811e470 2023-10-14T10:35:40.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.800+0000 7fdd1cfae640 1 -- 172.21.15.8:0/2867083680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd181e9bc0 con 0x7fdd1811e470 2023-10-14T10:35:40.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.801+0000 7fdd1cfae640 1 -- 172.21.15.8:0/2867083680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd180619f0 con 0x7fdd1811e470 2023-10-14T10:35:40.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.802+0000 7fdd14ff9640 1 -- 172.21.15.8:0/2867083680 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdd10005310 con 0x7fdd1811e470 2023-10-14T10:35:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.803+0000 7fdd14ff9640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fdcf806ae70 0x7fdcf806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.803+0000 7fdd14ff9640 1 -- 172.21.15.8:0/2867083680 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5815+0+0 (secure 0 0 0) 0x7fdd10089440 con 0x7fdd1811e470 2023-10-14T10:35:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.803+0000 7fdd177fe640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fdcf806ae70 0x7fdcf806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:40.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.804+0000 7fdd177fe640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fdcf806ae70 0x7fdcf806d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdd080011e0 tx=0x7fdd08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:40.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:40.807+0000 7fdd14ff9640 1 -- 172.21.15.8:0/2867083680 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd10054470 con 0x7fdd1811e470 2023-10-14T10:35:41.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.043+0000 7fdd1cfae640 1 -- 172.21.15.8:0/2867083680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "testcephfs1", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdd18150850 con 0x7fdd1811e470 2023-10-14T10:35:41.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.581+0000 7fdd14ff9640 1 -- 172.21.15.8:0/2867083680 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "testcephfs1", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 109+0+0 (secure 0 0 0) 0x7fdd10057a90 con 0x7fdd1811e470 2023-10-14T10:35:41.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.585+0000 7fdd1cfae640 1 -- 172.21.15.8:0/2867083680 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fdcf806ae70 msgr2=0x7fdcf806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:41.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.585+0000 7fdd1cfae640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fdcf806ae70 0x7fdcf806d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdd080011e0 tx=0x7fdd08009040 comp rx=0 tx=0).stop 2023-10-14T10:35:41.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.585+0000 7fdd1cfae640 1 -- 172.21.15.8:0/2867083680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd1811e470 msgr2=0x7fdd18142900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:41.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.585+0000 7fdd1cfae640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd1811e470 0x7fdd18142900 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000c6b0 tx=0x7fdd1000cb70 comp rx=0 tx=0).stop 2023-10-14T10:35:41.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.585+0000 7fdd1cfae640 1 -- 172.21.15.8:0/2867083680 shutdown_connections 2023-10-14T10:35:41.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.585+0000 7fdd1cfae640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fdcf806ae70 0x7fdcf806d330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:41.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.585+0000 7fdd1cfae640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd1811e470 0x7fdd18142900 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:41.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.585+0000 7fdd1cfae640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd1814e680 0x7fdd181423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:41.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.585+0000 7fdd1cfae640 1 --2- 172.21.15.8:0/2867083680 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd180c23a0 0x7fdd18073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:41.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.585+0000 7fdd1cfae640 1 -- 172.21.15.8:0/2867083680 >> 172.21.15.8:0/2867083680 conn(0x7fdd1806a200 msgr2=0x7fdd1814ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:41.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.585+0000 7fdd1cfae640 1 -- 172.21.15.8:0/2867083680 shutdown_connections 2023-10-14T10:35:41.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.585+0000 7fdd1cfae640 1 -- 172.21.15.8:0/2867083680 wait complete. 2023-10-14T10:35:41.609 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm testcephfs1_metadata testcephfs1_metadata --yes-i-really-really-mean-it 2023-10-14T10:35:41.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.881+0000 7f21d2bed640 1 Processor -- start 2023-10-14T10:35:41.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.881+0000 7f21d2bed640 1 -- start start 2023-10-14T10:35:41.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.883+0000 7f21d2bed640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f21cc13afc0 0x7f21cc152560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:41.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.883+0000 7f21d2bed640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f21cc06ff00 0x7f21cc0a83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:41.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.883+0000 7f21d2bed640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21cc13b3a0 con 0x7f21cc0a8930 2023-10-14T10:35:41.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.883+0000 7f21d2bed640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21cc0ab060 con 0x7f21cc06ff00 2023-10-14T10:35:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.883+0000 7f21d2bed640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21cc0aa4e0 con 0x7f21cc13afc0 2023-10-14T10:35:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.883+0000 7f21d13ea640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f21cc06ff00 0x7f21cc0a83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.883+0000 7f21d13ea640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f21cc06ff00 0x7f21cc0a83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36612/0 (socket says 172.21.15.8:36612) 2023-10-14T10:35:41.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.883+0000 7f21d13ea640 1 -- 172.21.15.8:0/3905480716 learned_addr learned my addr 172.21.15.8:0/3905480716 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:41.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.884+0000 7f21d13ea640 1 -- 172.21.15.8:0/3905480716 >> v2:172.21.15.92:3300/0 conn(0x7f21cc13afc0 msgr2=0x7f21cc152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:41.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.884+0000 7f21d1beb640 1 --2- 172.21.15.8:0/3905480716 >> v2:172.21.15.92:3300/0 conn(0x7f21cc13afc0 0x7f21cc152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:41.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.884+0000 7f21d13ea640 1 --2- 172.21.15.8:0/3905480716 >> v2:172.21.15.92:3300/0 conn(0x7f21cc13afc0 0x7f21cc152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:41.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.884+0000 7f21d13ea640 1 -- 172.21.15.8:0/3905480716 >> v1:172.21.15.92:6789/0 conn(0x7f21cc0a8930 legacy=0x7f21cc0711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:41.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.884+0000 7f21d13ea640 1 -- 172.21.15.8:0/3905480716 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc0aa7c0 con 0x7f21cc06ff00 2023-10-14T10:35:41.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.884+0000 7f21d1beb640 1 --2- 172.21.15.8:0/3905480716 >> v2:172.21.15.92:3300/0 conn(0x7f21cc13afc0 0x7f21cc152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:41.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.885+0000 7f21d13ea640 1 --2- 172.21.15.8:0/3905480716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21cc06ff00 0x7f21cc0a83f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f21cc0c6180 tx=0x7f21bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53225ed89e798ff4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:41.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.885+0000 7f21d0be9640 1 -- 172.21.15.8:0/3905480716 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc031870 con 0x7f21cc06ff00 2023-10-14T10:35:41.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.885+0000 7f21d0be9640 1 -- 172.21.15.8:0/3905480716 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc0319d0 con 0x7f21cc06ff00 2023-10-14T10:35:41.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.885+0000 7f21d0be9640 1 -- 172.21.15.8:0/3905480716 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc031d60 con 0x7f21cc06ff00 2023-10-14T10:35:41.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.886+0000 7f21d2bed640 1 -- 172.21.15.8:0/3905480716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21cc06ff00 msgr2=0x7f21cc0a83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:41.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.886+0000 7f21d2bed640 1 --2- 172.21.15.8:0/3905480716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21cc06ff00 0x7f21cc0a83f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f21cc0c6180 tx=0x7f21bc02b910 comp rx=0 tx=0).stop 2023-10-14T10:35:41.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.886+0000 7f21d2bed640 1 -- 172.21.15.8:0/3905480716 shutdown_connections 2023-10-14T10:35:41.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.886+0000 7f21d2bed640 1 --2- 172.21.15.8:0/3905480716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21cc06ff00 0x7f21cc0a83f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:41.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.886+0000 7f21d2bed640 1 --2- 172.21.15.8:0/3905480716 >> v2:172.21.15.92:3300/0 conn(0x7f21cc13afc0 0x7f21cc152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:41.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.886+0000 7f21d2bed640 1 -- 172.21.15.8:0/3905480716 >> 172.21.15.8:0/3905480716 conn(0x7f21cc0c52a0 msgr2=0x7f21cc0c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:41.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.886+0000 7f21d2bed640 1 -- 172.21.15.8:0/3905480716 shutdown_connections 2023-10-14T10:35:41.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.886+0000 7f21d2bed640 1 -- 172.21.15.8:0/3905480716 wait complete. 2023-10-14T10:35:41.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.888+0000 7f21d2bed640 1 Processor -- start 2023-10-14T10:35:41.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.888+0000 7f21d2bed640 1 -- start start 2023-10-14T10:35:41.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.889+0000 7f21d2bed640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21cc06ff00 0x7f21cc154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:41.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.889+0000 7f21d2bed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21cc0a8930 0x7f21cc0bac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:41.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.889+0000 7f21d2bed640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21cc13afc0 0x7f21cc0bd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:41.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.889+0000 7f21d2bed640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0bc380 con 0x7f21cc06ff00 2023-10-14T10:35:41.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.889+0000 7f21d2bed640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0bbb40 con 0x7f21cc0a8930 2023-10-14T10:35:41.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.889+0000 7f21d2bed640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0bbde0 con 0x7f21cc13afc0 2023-10-14T10:35:41.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.889+0000 7f21d1beb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21cc06ff00 0x7f21cc154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:41.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.889+0000 7f21d1beb640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21cc06ff00 0x7f21cc154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36622/0 (socket says 172.21.15.8:36622) 2023-10-14T10:35:41.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.889+0000 7f21d1beb640 1 -- 172.21.15.8:0/3066629241 learned_addr learned my addr 172.21.15.8:0/3066629241 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:41.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.890+0000 7f21d13ea640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21cc0a8930 0x7f21cc0bac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:41.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.890+0000 7f21d23ec640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21cc13afc0 0x7f21cc0bd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:41.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.890+0000 7f21d1beb640 1 -- 172.21.15.8:0/3066629241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21cc13afc0 msgr2=0x7f21cc0bd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:41.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.890+0000 7f21d1beb640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21cc13afc0 0x7f21cc0bd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:41.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.890+0000 7f21d1beb640 1 -- 172.21.15.8:0/3066629241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21cc0a8930 msgr2=0x7f21cc0bac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:41.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.890+0000 7f21d1beb640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21cc0a8930 0x7f21cc0bac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:41.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.890+0000 7f21d1beb640 1 -- 172.21.15.8:0/3066629241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc0094d0 con 0x7f21cc06ff00 2023-10-14T10:35:41.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.890+0000 7f21d1beb640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21cc06ff00 0x7f21cc154f90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c7f0 tx=0x7f21c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:41.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.890+0000 7f21c27fc640 1 -- 172.21.15.8:0/3066629241 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8007a30 con 0x7f21cc06ff00 2023-10-14T10:35:41.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.891+0000 7f21c27fc640 1 -- 172.21.15.8:0/3066629241 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8007b90 con 0x7f21cc06ff00 2023-10-14T10:35:41.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.891+0000 7f21c27fc640 1 -- 172.21.15.8:0/3066629241 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800ce40 con 0x7f21cc06ff00 2023-10-14T10:35:41.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.891+0000 7f21d2bed640 1 -- 172.21.15.8:0/3066629241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21cc0bc0a0 con 0x7f21cc06ff00 2023-10-14T10:35:41.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.891+0000 7f21d2bed640 1 -- 172.21.15.8:0/3066629241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21cc0bd280 con 0x7f21cc06ff00 2023-10-14T10:35:41.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.892+0000 7f21d2bed640 1 -- 172.21.15.8:0/3066629241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21cc0bce00 con 0x7f21cc06ff00 2023-10-14T10:35:41.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.893+0000 7f21c27fc640 1 -- 172.21.15.8:0/3066629241 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f21c80113f0 con 0x7f21cc06ff00 2023-10-14T10:35:41.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.894+0000 7f21c27fc640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f21b006aea0 0x7f21b006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:41.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.894+0000 7f21c27fc640 1 -- 172.21.15.8:0/3066629241 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5815+0+0 (secure 0 0 0) 0x7f21c80897d0 con 0x7f21cc06ff00 2023-10-14T10:35:41.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.894+0000 7f21d13ea640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f21b006aea0 0x7f21b006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:41.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.895+0000 7f21d13ea640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f21b006aea0 0x7f21b006d360 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f21bc036000 tx=0x7f21bc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:41.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:41.898+0000 7f21c27fc640 1 -- 172.21.15.8:0/3066629241 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21cc0bce00 con 0x7f21cc06ff00 2023-10-14T10:35:42.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.090+0000 7f21d2bed640 1 -- 172.21.15.8:0/3066629241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "testcephfs1_metadata", "pool2": "testcephfs1_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f21cc0bce00 con 0x7f21cc06ff00 2023-10-14T10:35:42.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.584+0000 7f21c27fc640 1 -- 172.21.15.8:0/3066629241 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "testcephfs1_metadata", "pool2": "testcephfs1_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'testcephfs1_metadata' removed v36) v1 ==== 196+0+0 (secure 0 0 0) 0x7f21cc0bce00 con 0x7f21cc06ff00 2023-10-14T10:35:42.587 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'testcephfs1_metadata' removed 2023-10-14T10:35:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.587+0000 7f21d2bed640 1 -- 172.21.15.8:0/3066629241 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f21b006aea0 msgr2=0x7f21b006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.587+0000 7f21d2bed640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f21b006aea0 0x7f21b006d360 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f21bc036000 tx=0x7f21bc03c040 comp rx=0 tx=0).stop 2023-10-14T10:35:42.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.588+0000 7f21d2bed640 1 -- 172.21.15.8:0/3066629241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21cc06ff00 msgr2=0x7f21cc154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.588+0000 7f21d2bed640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21cc06ff00 0x7f21cc154f90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c7f0 tx=0x7f21c800cbf0 comp rx=0 tx=0).stop 2023-10-14T10:35:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.588+0000 7f21d2bed640 1 -- 172.21.15.8:0/3066629241 shutdown_connections 2023-10-14T10:35:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.588+0000 7f21d2bed640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f21b006aea0 0x7f21b006d360 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.588+0000 7f21d2bed640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21cc13afc0 0x7f21cc0bd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:42.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.588+0000 7f21d2bed640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21cc0a8930 0x7f21cc0bac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.588+0000 7f21d2bed640 1 --2- 172.21.15.8:0/3066629241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21cc06ff00 0x7f21cc154f90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.588+0000 7f21d2bed640 1 -- 172.21.15.8:0/3066629241 >> 172.21.15.8:0/3066629241 conn(0x7f21cc0c52a0 msgr2=0x7f21cc1399a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.588+0000 7f21d2bed640 1 -- 172.21.15.8:0/3066629241 shutdown_connections 2023-10-14T10:35:42.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.588+0000 7f21d2bed640 1 -- 172.21.15.8:0/3066629241 wait complete. 2023-10-14T10:35:42.616 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm testcephfs1_data testcephfs1_data --yes-i-really-really-mean-it 2023-10-14T10:35:42.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.831+0000 7f75cf54e640 1 Processor -- start 2023-10-14T10:35:42.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.831+0000 7f75cf54e640 1 -- start start 2023-10-14T10:35:42.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.832+0000 7f75cf54e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c813afc0 0x7f75c8152560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:42.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.832+0000 7f75cf54e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f75c80711c0 0x7f75c8071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:42.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.832+0000 7f75cf54e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c813b3a0 con 0x7f75c806ff00 2023-10-14T10:35:42.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.832+0000 7f75cf54e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c80ab060 con 0x7f75c80711c0 2023-10-14T10:35:42.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.832+0000 7f75cf54e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80aa4e0 con 0x7f75c813afc0 2023-10-14T10:35:42.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.833+0000 7f75cdd4b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f75c806ff00 0x7f75c80a83f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56440/0 (socket says 172.21.15.8:56440) 2023-10-14T10:35:42.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.833+0000 7f75cdd4b640 1 -- 172.21.15.8:0/2691188620 learned_addr learned my addr 172.21.15.8:0/2691188620 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:42.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.833+0000 7f75ce54c640 1 --2- 172.21.15.8:0/2691188620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c813afc0 0x7f75c8152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:42.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.833+0000 7f75ced4d640 1 --2- 172.21.15.8:0/2691188620 >> v2:172.21.15.92:3300/0 conn(0x7f75c80711c0 0x7f75c8071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.833+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117021479 0 0) 0x7f75c813b3a0 con 0x7f75c806ff00 2023-10-14T10:35:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.833+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b4003520 con 0x7f75c806ff00 2023-10-14T10:35:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2001014930 0 0) 0x7f75b4003520 con 0x7f75c806ff00 2023-10-14T10:35:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c813afc0 msgr2=0x7f75c8152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 --2- 172.21.15.8:0/2691188620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c813afc0 0x7f75c8152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:42.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 >> v2:172.21.15.92:3300/0 conn(0x7f75c80711c0 msgr2=0x7f75c8071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:42.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 --2- 172.21.15.8:0/2691188620 >> v2:172.21.15.92:3300/0 conn(0x7f75c80711c0 0x7f75c8071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:42.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c80aa7c0 con 0x7f75c806ff00 2023-10-14T10:35:42.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f75b8001670 con 0x7f75c806ff00 2023-10-14T10:35:42.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 >> v1:172.21.15.8:6789/0 conn(0x7f75c806ff00 legacy=0x7f75c80a83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:42.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 --2- 172.21.15.8:0/2691188620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c813afc0 0x7f75b4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:42.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 --2- 172.21.15.8:0/2691188620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b4003f40 0x7f75b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:42.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 --2- 172.21.15.8:0/2691188620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b4004d00 0x7f75b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:42.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80ab060 con 0x7f75b4003f40 2023-10-14T10:35:42.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80aa4e0 con 0x7f75b4004d00 2023-10-14T10:35:42.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b400b980 con 0x7f75c813afc0 2023-10-14T10:35:42.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.834+0000 7f75cdd4b640 1 --2- 172.21.15.8:0/2691188620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b4003f40 0x7f75b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:42.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.835+0000 7f75ce54c640 1 --2- 172.21.15.8:0/2691188620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c813afc0 0x7f75b4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:42.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.835+0000 7f75ced4d640 1 --2- 172.21.15.8:0/2691188620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b4004d00 0x7f75b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:42.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.835+0000 7f75cdd4b640 1 -- 172.21.15.8:0/2691188620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c813afc0 msgr2=0x7f75b4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:42.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.835+0000 7f75cdd4b640 1 --2- 172.21.15.8:0/2691188620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c813afc0 0x7f75b4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:42.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.835+0000 7f75cdd4b640 1 -- 172.21.15.8:0/2691188620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b4004d00 msgr2=0x7f75b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:42.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.835+0000 7f75cdd4b640 1 --2- 172.21.15.8:0/2691188620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b4004d00 0x7f75b4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:42.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.835+0000 7f75cdd4b640 1 -- 172.21.15.8:0/2691188620 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b4003520 con 0x7f75b4003f40 2023-10-14T10:35:42.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.836+0000 7f75cdd4b640 1 --2- 172.21.15.8:0/2691188620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b4003f40 0x7f75b40047c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f75b800c190 tx=0x7f75b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ce6b9102b7ab94 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:42.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.836+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b8005ad0 con 0x7f75b4003f40 2023-10-14T10:35:42.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.836+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b8005c30 con 0x7f75b4003f40 2023-10-14T10:35:42.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.836+0000 7f75cd54a640 1 -- 172.21.15.8:0/2691188620 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b802c810 con 0x7f75b4003f40 2023-10-14T10:35:42.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.837+0000 7f75cf54e640 1 -- 172.21.15.8:0/2691188620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b4003f40 msgr2=0x7f75b40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:42.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.837+0000 7f75cf54e640 1 --2- 172.21.15.8:0/2691188620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b4003f40 0x7f75b40047c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f75b800c190 tx=0x7f75b40057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:42.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.837+0000 7f75ced4d640 1 -- 172.21.15.8:0/2691188620 reap_dead start 2023-10-14T10:35:42.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.837+0000 7f75cf54e640 1 -- 172.21.15.8:0/2691188620 shutdown_connections 2023-10-14T10:35:42.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.837+0000 7f75cf54e640 1 -- 172.21.15.8:0/2691188620 >> 172.21.15.8:0/2691188620 conn(0x7f75c80c52a0 msgr2=0x7f75c80c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:42.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.837+0000 7f75cf54e640 1 -- 172.21.15.8:0/2691188620 shutdown_connections 2023-10-14T10:35:42.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.837+0000 7f75cf54e640 1 -- 172.21.15.8:0/2691188620 wait complete. 2023-10-14T10:35:42.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.839+0000 7f75cf54e640 1 Processor -- start 2023-10-14T10:35:42.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.839+0000 7f75cf54e640 1 -- start start 2023-10-14T10:35:42.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.840+0000 7f75cf54e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b4003f40 0x7f75c812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:42.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.840+0000 7f75cf54e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c8130500 0x7f75c81e4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:42.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.840+0000 7f75cf54e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75c81e8550 0x7f75c81e4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:42.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.840+0000 7f75cf54e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80ba8d0 con 0x7f75b4003f40 2023-10-14T10:35:42.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.840+0000 7f75cf54e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80beea0 con 0x7f75c81e8550 2023-10-14T10:35:42.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.840+0000 7f75cf54e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c812f850 con 0x7f75c8130500 2023-10-14T10:35:42.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.840+0000 7f75ce54c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b4003f40 0x7f75c812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:42.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.840+0000 7f75ce54c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b4003f40 0x7f75c812ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36644/0 (socket says 172.21.15.8:36644) 2023-10-14T10:35:42.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.840+0000 7f75ce54c640 1 -- 172.21.15.8:0/4275743667 learned_addr learned my addr 172.21.15.8:0/4275743667 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:42.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75cdd4b640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c8130500 0x7f75c81e4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:42.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75ced4d640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75c81e8550 0x7f75c81e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:42.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75ce54c640 1 -- 172.21.15.8:0/4275743667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c8130500 msgr2=0x7f75c81e4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:42.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75ce54c640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c8130500 0x7f75c81e4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:42.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75ce54c640 1 -- 172.21.15.8:0/4275743667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75c81e8550 msgr2=0x7f75c81e4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:42.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75ce54c640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75c81e8550 0x7f75c81e4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:42.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75ce54c640 1 -- 172.21.15.8:0/4275743667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c812fb30 con 0x7f75b4003f40 2023-10-14T10:35:42.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75ce54c640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b4003f40 0x7f75c812ffc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f75c4011600 tx=0x7f75c4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:42.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75beffd640 1 -- 172.21.15.8:0/4275743667 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400f920 con 0x7f75b4003f40 2023-10-14T10:35:42.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75beffd640 1 -- 172.21.15.8:0/4275743667 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c400fa80 con 0x7f75b4003f40 2023-10-14T10:35:42.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75beffd640 1 -- 172.21.15.8:0/4275743667 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400fdf0 con 0x7f75b4003f40 2023-10-14T10:35:42.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75cf54e640 1 -- 172.21.15.8:0/4275743667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c81e4ca0 con 0x7f75b4003f40 2023-10-14T10:35:42.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.841+0000 7f75cf54e640 1 -- 172.21.15.8:0/4275743667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c80bf390 con 0x7f75b4003f40 2023-10-14T10:35:42.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.843+0000 7f75cf54e640 1 -- 172.21.15.8:0/4275743667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c804e9b0 con 0x7f75b4003f40 2023-10-14T10:35:42.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.844+0000 7f75beffd640 1 -- 172.21.15.8:0/4275743667 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f75c4015460 con 0x7f75b4003f40 2023-10-14T10:35:42.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.845+0000 7f75beffd640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f75ac06aea0 0x7f75ac06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:42.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.845+0000 7f75beffd640 1 -- 172.21.15.8:0/4275743667 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5367+0+0 (secure 0 0 0) 0x7f75c4089890 con 0x7f75b4003f40 2023-10-14T10:35:42.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.846+0000 7f75cdd4b640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f75ac06aea0 0x7f75ac06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:42.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.846+0000 7f75cdd4b640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f75ac06aea0 0x7f75ac06d360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f75b800c160 tx=0x7f75b8007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:42.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:42.850+0000 7f75beffd640 1 -- 172.21.15.8:0/4275743667 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f75c4054b20 con 0x7f75b4003f40 2023-10-14T10:35:43.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.048+0000 7f75cf54e640 1 -- 172.21.15.8:0/4275743667 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "testcephfs1_data", "pool2": "testcephfs1_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f75c8070ab0 con 0x7f75b4003f40 2023-10-14T10:35:43.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.594+0000 7f75beffd640 1 -- 172.21.15.8:0/4275743667 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "testcephfs1_data", "pool2": "testcephfs1_data", "yes_i_really_really_mean_it": true}]=0 pool 'testcephfs1_data' removed v37) v1 ==== 184+0+0 (secure 0 0 0) 0x7f75c4058140 con 0x7f75b4003f40 2023-10-14T10:35:43.597 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'testcephfs1_data' removed 2023-10-14T10:35:43.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.598+0000 7f75cf54e640 1 -- 172.21.15.8:0/4275743667 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f75ac06aea0 msgr2=0x7f75ac06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:43.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.598+0000 7f75cf54e640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f75ac06aea0 0x7f75ac06d360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f75b800c160 tx=0x7f75b8007000 comp rx=0 tx=0).stop 2023-10-14T10:35:43.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.598+0000 7f75cf54e640 1 -- 172.21.15.8:0/4275743667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b4003f40 msgr2=0x7f75c812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:43.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.598+0000 7f75cf54e640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b4003f40 0x7f75c812ffc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f75c4011600 tx=0x7f75c4011ac0 comp rx=0 tx=0).stop 2023-10-14T10:35:43.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.598+0000 7f75cf54e640 1 -- 172.21.15.8:0/4275743667 shutdown_connections 2023-10-14T10:35:43.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.598+0000 7f75cf54e640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f75ac06aea0 0x7f75ac06d360 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:43.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.598+0000 7f75cf54e640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75c81e8550 0x7f75c81e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:43.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.598+0000 7f75cf54e640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75c8130500 0x7f75c81e4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:43.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.598+0000 7f75cf54e640 1 --2- 172.21.15.8:0/4275743667 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b4003f40 0x7f75c812ffc0 secure :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f75c4011600 tx=0x7f75c4011ac0 comp rx=0 tx=0).stop 2023-10-14T10:35:43.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.598+0000 7f75cf54e640 1 -- 172.21.15.8:0/4275743667 >> 172.21.15.8:0/4275743667 conn(0x7f75c80c52a0 msgr2=0x7f75c80c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:43.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.599+0000 7f75cf54e640 1 -- 172.21.15.8:0/4275743667 shutdown_connections 2023-10-14T10:35:43.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.599+0000 7f75cf54e640 1 -- 172.21.15.8:0/4275743667 wait complete. 2023-10-14T10:35:43.628 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T10:35:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.834+0000 7f1f3b3d7640 1 Processor -- start 2023-10-14T10:35:43.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.834+0000 7f1f3b3d7640 1 -- start start 2023-10-14T10:35:43.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.836+0000 7f1f3b3d7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340bfc10 0x7f1f340c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:43.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.836+0000 7f1f3b3d7640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f34152ac0 con 0x7f1f3413af90 2023-10-14T10:35:43.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.836+0000 7f1f3b3d7640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f34151eb0 con 0x7f1f3406fb10 2023-10-14T10:35:43.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.836+0000 7f1f3b3d7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f34152190 con 0x7f1f340bfc10 2023-10-14T10:35:43.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.836+0000 7f1f3a3d5640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1f3413af90 0x7f1f340a81e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56444/0 (socket says 172.21.15.8:56444) 2023-10-14T10:35:43.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.836+0000 7f1f3a3d5640 1 -- 172.21.15.8:0/298090923 learned_addr learned my addr 172.21.15.8:0/298090923 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:43.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f3abd6640 1 --2- 172.21.15.8:0/298090923 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340bfc10 0x7f1f340c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:43.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281139142 0 0) 0x7f1f34152ac0 con 0x7f1f3413af90 2023-10-14T10:35:43.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f20003520 con 0x7f1f3413af90 2023-10-14T10:35:43.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2423141334 0 0) 0x7f1f20003520 con 0x7f1f3413af90 2023-10-14T10:35:43.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340bfc10 msgr2=0x7f1f340c00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:43.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 --2- 172.21.15.8:0/298090923 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340bfc10 0x7f1f340c00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:43.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 >> v1:172.21.15.92:6789/0 conn(0x7f1f3406fb10 legacy=0x7f1f340c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:43.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f34152470 con 0x7f1f3413af90 2023-10-14T10:35:43.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f1f30001670 con 0x7f1f3413af90 2023-10-14T10:35:43.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 >> v1:172.21.15.8:6789/0 conn(0x7f1f3413af90 legacy=0x7f1f340a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:43.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 --2- 172.21.15.8:0/298090923 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340bfc10 0x7f1f200039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:43.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 --2- 172.21.15.8:0/298090923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f20004020 0x7f1f200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:43.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 --2- 172.21.15.8:0/298090923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f20004d00 0x7f1f20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:43.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f34152190 con 0x7f1f20004d00 2023-10-14T10:35:43.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2000bc60 con 0x7f1f20004020 2023-10-14T10:35:43.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.837+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2000be20 con 0x7f1f340bfc10 2023-10-14T10:35:43.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.838+0000 7f1f3abd6640 1 --2- 172.21.15.8:0/298090923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f20004d00 0x7f1f20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:43.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.838+0000 7f1f3a3d5640 1 --2- 172.21.15.8:0/298090923 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340bfc10 0x7f1f200039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:43.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.838+0000 7f1f39bd4640 1 --2- 172.21.15.8:0/298090923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f20004020 0x7f1f200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:43.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.838+0000 7f1f3abd6640 1 -- 172.21.15.8:0/298090923 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340bfc10 msgr2=0x7f1f200039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:43.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.838+0000 7f1f3abd6640 1 --2- 172.21.15.8:0/298090923 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340bfc10 0x7f1f200039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:43.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.838+0000 7f1f3abd6640 1 -- 172.21.15.8:0/298090923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f20004020 msgr2=0x7f1f200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:43.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.838+0000 7f1f3abd6640 1 --2- 172.21.15.8:0/298090923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f20004020 0x7f1f200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:43.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.838+0000 7f1f3abd6640 1 -- 172.21.15.8:0/298090923 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f20003520 con 0x7f1f20004d00 2023-10-14T10:35:43.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.839+0000 7f1f3abd6640 1 --2- 172.21.15.8:0/298090923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f20004d00 0x7f1f20005180 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c007360 tx=0x7f1f200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e09d7dad887dbc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:43.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.840+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c02ccd0 con 0x7f1f20004d00 2023-10-14T10:35:43.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.840+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c02ce30 con 0x7f1f20004d00 2023-10-14T10:35:43.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.840+0000 7f1f393d3640 1 -- 172.21.15.8:0/298090923 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c034660 con 0x7f1f20004d00 2023-10-14T10:35:43.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.840+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/298090923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f20004d00 msgr2=0x7f1f20005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:43.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.840+0000 7f1f3b3d7640 1 --2- 172.21.15.8:0/298090923 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f20004d00 0x7f1f20005180 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c007360 tx=0x7f1f200057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:43.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.840+0000 7f1f3abd6640 1 -- 172.21.15.8:0/298090923 reap_dead start 2023-10-14T10:35:43.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.840+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/298090923 shutdown_connections 2023-10-14T10:35:43.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.840+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/298090923 >> 172.21.15.8:0/298090923 conn(0x7f1f3406a200 msgr2=0x7f1f3406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:43.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.841+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/298090923 shutdown_connections 2023-10-14T10:35:43.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.841+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/298090923 wait complete. 2023-10-14T10:35:43.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.843+0000 7f1f3b3d7640 1 Processor -- start 2023-10-14T10:35:43.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.843+0000 7f1f3b3d7640 1 -- start start 2023-10-14T10:35:43.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.844+0000 7f1f3b3d7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f20004d00 0x7f1f340c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:43.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.844+0000 7f1f3b3d7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340c2fd0 0x7f1f341f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:43.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.844+0000 7f1f3b3d7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f34070c80 0x7f1f34133770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:43.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.844+0000 7f1f3b3d7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340c4740 con 0x7f1f34070c80 2023-10-14T10:35:43.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.844+0000 7f1f3b3d7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f34133000 con 0x7f1f20004d00 2023-10-14T10:35:43.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.844+0000 7f1f3b3d7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340c3b20 con 0x7f1f340c2fd0 2023-10-14T10:35:43.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.844+0000 7f1f3abd6640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f34070c80 0x7f1f34133770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:43.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.844+0000 7f1f3abd6640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f34070c80 0x7f1f34133770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36670/0 (socket says 172.21.15.8:36670) 2023-10-14T10:35:43.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.844+0000 7f1f3abd6640 1 -- 172.21.15.8:0/822911251 learned_addr learned my addr 172.21.15.8:0/822911251 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:43.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.845+0000 7f1f39bd4640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340c2fd0 0x7f1f341f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:43.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.845+0000 7f1f3a3d5640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f20004d00 0x7f1f340c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:43.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.845+0000 7f1f3abd6640 1 -- 172.21.15.8:0/822911251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340c2fd0 msgr2=0x7f1f341f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:43.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.845+0000 7f1f3abd6640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340c2fd0 0x7f1f341f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:43.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.845+0000 7f1f3abd6640 1 -- 172.21.15.8:0/822911251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f20004d00 msgr2=0x7f1f340c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:43.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.845+0000 7f1f3abd6640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f20004d00 0x7f1f340c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:43.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.845+0000 7f1f3abd6640 1 -- 172.21.15.8:0/822911251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f340c3e00 con 0x7f1f34070c80 2023-10-14T10:35:43.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.845+0000 7f1f3abd6640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f34070c80 0x7f1f34133770 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c007480 tx=0x7f1f2c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:43.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.845+0000 7f1f2affd640 1 -- 172.21.15.8:0/822911251 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c003b90 con 0x7f1f34070c80 2023-10-14T10:35:43.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.845+0000 7f1f2affd640 1 -- 172.21.15.8:0/822911251 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c003cf0 con 0x7f1f34070c80 2023-10-14T10:35:43.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.845+0000 7f1f2affd640 1 -- 172.21.15.8:0/822911251 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c004260 con 0x7f1f34070c80 2023-10-14T10:35:43.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.845+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/822911251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f340c40e0 con 0x7f1f34070c80 2023-10-14T10:35:43.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.846+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/822911251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f34136360 con 0x7f1f34070c80 2023-10-14T10:35:43.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.847+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/822911251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f34133490 con 0x7f1f34070c80 2023-10-14T10:35:43.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.848+0000 7f1f2affd640 1 -- 172.21.15.8:0/822911251 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1f2c03b040 con 0x7f1f34070c80 2023-10-14T10:35:43.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.849+0000 7f1f2affd640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f1f1806aea0 0x7f1f1806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:43.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.849+0000 7f1f2affd640 1 -- 172.21.15.8:0/822911251 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1f2c0ab280 con 0x7f1f34070c80 2023-10-14T10:35:43.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.849+0000 7f1f3a3d5640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f1f1806aea0 0x7f1f1806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:43.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.850+0000 7f1f3a3d5640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f1f1806aea0 0x7f1f1806d360 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1f30001050 tx=0x7f1f30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:43.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:43.854+0000 7f1f2affd640 1 -- 172.21.15.8:0/822911251 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1f34133490 con 0x7f1f34070c80 2023-10-14T10:35:44.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.046+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/822911251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1f34133490 con 0x7f1f34070c80 2023-10-14T10:35:44.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.052+0000 7f1f2affd640 1 -- 172.21.15.8:0/822911251 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1f34133490 con 0x7f1f34070c80 2023-10-14T10:35:44.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.055+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/822911251 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f1f1806aea0 msgr2=0x7f1f1806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:44.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.055+0000 7f1f3b3d7640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f1f1806aea0 0x7f1f1806d360 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1f30001050 tx=0x7f1f30009040 comp rx=0 tx=0).stop 2023-10-14T10:35:44.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.055+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/822911251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f34070c80 msgr2=0x7f1f34133770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:44.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.055+0000 7f1f3b3d7640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f34070c80 0x7f1f34133770 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c007480 tx=0x7f1f2c004ab0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.055+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/822911251 shutdown_connections 2023-10-14T10:35:44.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.055+0000 7f1f3b3d7640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f1f1806aea0 0x7f1f1806d360 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.055+0000 7f1f3b3d7640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1f34070c80 0x7f1f34133770 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.055+0000 7f1f3b3d7640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f340c2fd0 0x7f1f341f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.055+0000 7f1f3b3d7640 1 --2- 172.21.15.8:0/822911251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f20004d00 0x7f1f340c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.055+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/822911251 >> 172.21.15.8:0/822911251 conn(0x7f1f3406a200 msgr2=0x7f1f340c2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:44.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.056+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/822911251 shutdown_connections 2023-10-14T10:35:44.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.056+0000 7f1f3b3d7640 1 -- 172.21.15.8:0/822911251 wait complete. 2023-10-14T10:35:44.075 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.a mds_join_fs 2023-10-14T10:35:44.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.290+0000 7fab3dd3c640 1 Processor -- start 2023-10-14T10:35:44.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.290+0000 7fab3dd3c640 1 -- start start 2023-10-14T10:35:44.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.292+0000 7fab3dd3c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab380bbf60 0x7fab38150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:44.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.292+0000 7fab3dd3c640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fab3814e680 0x7fab38151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:44.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.292+0000 7fab3dd3c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab38154d90 con 0x7fab380c23a0 2023-10-14T10:35:44.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.292+0000 7fab3dd3c640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab380bc3f0 con 0x7fab3814e680 2023-10-14T10:35:44.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.292+0000 7fab3dd3c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab38155220 con 0x7fab380bbf60 2023-10-14T10:35:44.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.292+0000 7fab3cd3a640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fab380c23a0 0x7fab3814df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56448/0 (socket says 172.21.15.8:56448) 2023-10-14T10:35:44.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.292+0000 7fab3cd3a640 1 -- 172.21.15.8:0/751922297 learned_addr learned my addr 172.21.15.8:0/751922297 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:44.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.292+0000 7fab3d53b640 1 --2- 172.21.15.8:0/751922297 >> v2:172.21.15.8:3300/0 conn(0x7fab3814e680 0x7fab38151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:44.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.293+0000 7fab37fff640 1 --2- 172.21.15.8:0/751922297 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab380bbf60 0x7fab38150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:44.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.293+0000 7fab377fe640 1 -- 172.21.15.8:0/751922297 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530784996 0 0) 0x7fab38154d90 con 0x7fab380c23a0 2023-10-14T10:35:44.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.293+0000 7fab377fe640 1 -- 172.21.15.8:0/751922297 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab24003520 con 0x7fab380c23a0 2023-10-14T10:35:44.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.293+0000 7fab3d53b640 1 -- 172.21.15.8:0/751922297 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab380bbf60 msgr2=0x7fab38150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:44.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.293+0000 7fab3d53b640 1 --2- 172.21.15.8:0/751922297 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab380bbf60 0x7fab38150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.293+0000 7fab3d53b640 1 -- 172.21.15.8:0/751922297 >> v1:172.21.15.8:6789/0 conn(0x7fab380c23a0 legacy=0x7fab3814df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:44.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.293+0000 7fab3d53b640 1 -- 172.21.15.8:0/751922297 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab38154460 con 0x7fab3814e680 2023-10-14T10:35:44.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.294+0000 7fab3d53b640 1 --2- 172.21.15.8:0/751922297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab3814e680 0x7fab38151210 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fab300097a0 tx=0x7fab3002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41798ef82187fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:44.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.294+0000 7fab377fe640 1 -- 172.21.15.8:0/751922297 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30031780 con 0x7fab3814e680 2023-10-14T10:35:44.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.294+0000 7fab377fe640 1 -- 172.21.15.8:0/751922297 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab300318e0 con 0x7fab3814e680 2023-10-14T10:35:44.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.294+0000 7fab377fe640 1 -- 172.21.15.8:0/751922297 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30031c70 con 0x7fab3814e680 2023-10-14T10:35:44.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.295+0000 7fab3dd3c640 1 -- 172.21.15.8:0/751922297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab3814e680 msgr2=0x7fab38151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:44.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.295+0000 7fab3dd3c640 1 --2- 172.21.15.8:0/751922297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab3814e680 0x7fab38151210 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fab300097a0 tx=0x7fab3002b820 comp rx=0 tx=0).stop 2023-10-14T10:35:44.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.295+0000 7fab3dd3c640 1 -- 172.21.15.8:0/751922297 shutdown_connections 2023-10-14T10:35:44.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.295+0000 7fab3dd3c640 1 --2- 172.21.15.8:0/751922297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab3814e680 0x7fab38151210 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.295+0000 7fab3dd3c640 1 --2- 172.21.15.8:0/751922297 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab380bbf60 0x7fab38150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.295+0000 7fab3dd3c640 1 -- 172.21.15.8:0/751922297 >> 172.21.15.8:0/751922297 conn(0x7fab3806a200 msgr2=0x7fab3806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:44.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.295+0000 7fab3dd3c640 1 -- 172.21.15.8:0/751922297 shutdown_connections 2023-10-14T10:35:44.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.295+0000 7fab3dd3c640 1 -- 172.21.15.8:0/751922297 wait complete. 2023-10-14T10:35:44.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.297+0000 7fab3dd3c640 1 Processor -- start 2023-10-14T10:35:44.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.297+0000 7fab3dd3c640 1 -- start start 2023-10-14T10:35:44.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.298+0000 7fab3dd3c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab380c23a0 0x7fab3814b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:44.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.298+0000 7fab3dd3c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab3814e680 0x7fab3814d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:44.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.298+0000 7fab3dd3c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab381de140 0x7fab3814a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:44.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.298+0000 7fab3dd3c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab381520c0 con 0x7fab381de140 2023-10-14T10:35:44.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.298+0000 7fab3dd3c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3814eb40 con 0x7fab3814e680 2023-10-14T10:35:44.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.298+0000 7fab3dd3c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3814ae30 con 0x7fab380c23a0 2023-10-14T10:35:44.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.299+0000 7fab3d53b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab381de140 0x7fab3814a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:44.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.299+0000 7fab3d53b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab381de140 0x7fab3814a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36698/0 (socket says 172.21.15.8:36698) 2023-10-14T10:35:44.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.299+0000 7fab3d53b640 1 -- 172.21.15.8:0/3580811478 learned_addr learned my addr 172.21.15.8:0/3580811478 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:44.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.299+0000 7fab3cd3a640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab380c23a0 0x7fab3814b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:44.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.299+0000 7fab37fff640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab3814e680 0x7fab3814d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:44.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.299+0000 7fab3d53b640 1 -- 172.21.15.8:0/3580811478 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab380c23a0 msgr2=0x7fab3814b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:44.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.299+0000 7fab3d53b640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab380c23a0 0x7fab3814b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.299+0000 7fab3d53b640 1 -- 172.21.15.8:0/3580811478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab3814e680 msgr2=0x7fab3814d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:44.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.299+0000 7fab3d53b640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab3814e680 0x7fab3814d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.299+0000 7fab3d53b640 1 -- 172.21.15.8:0/3580811478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab30009400 con 0x7fab381de140 2023-10-14T10:35:44.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.299+0000 7fab37fff640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab3814e680 0x7fab3814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:44.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.299+0000 7fab3d53b640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab381de140 0x7fab3814a130 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fab300098c0 tx=0x7fab300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:44.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.300+0000 7fab357fa640 1 -- 172.21.15.8:0/3580811478 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30032820 con 0x7fab381de140 2023-10-14T10:35:44.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.300+0000 7fab357fa640 1 -- 172.21.15.8:0/3580811478 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab30032980 con 0x7fab381de140 2023-10-14T10:35:44.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.300+0000 7fab357fa640 1 -- 172.21.15.8:0/3580811478 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30032d30 con 0x7fab381de140 2023-10-14T10:35:44.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.300+0000 7fab3dd3c640 1 -- 172.21.15.8:0/3580811478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab381522d0 con 0x7fab381de140 2023-10-14T10:35:44.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.300+0000 7fab3dd3c640 1 -- 172.21.15.8:0/3580811478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3814d790 con 0x7fab381de140 2023-10-14T10:35:44.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.301+0000 7fab3dd3c640 1 -- 172.21.15.8:0/3580811478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3814efd0 con 0x7fab381de140 2023-10-14T10:35:44.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.302+0000 7fab357fa640 1 -- 172.21.15.8:0/3580811478 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fab300453f0 con 0x7fab381de140 2023-10-14T10:35:44.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.303+0000 7fab357fa640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fab1806ae70 0x7fab1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:44.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.303+0000 7fab357fa640 1 -- 172.21.15.8:0/3580811478 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fab300ab400 con 0x7fab381de140 2023-10-14T10:35:44.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.304+0000 7fab3cd3a640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fab1806ae70 0x7fab1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:44.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.304+0000 7fab3cd3a640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fab1806ae70 0x7fab1806d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fab28001560 tx=0x7fab28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:44.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.307+0000 7fab357fa640 1 -- 172.21.15.8:0/3580811478 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab3814efd0 con 0x7fab381de140 2023-10-14T10:35:44.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.504+0000 7fab3dd3c640 1 -- 172.21.15.8:0/3580811478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.a", "name": "mds_join_fs"} v 0) v1 -- 0x7fab3814efd0 con 0x7fab381de140 2023-10-14T10:35:44.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.508+0000 7fab357fa640 1 -- 172.21.15.8:0/3580811478 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.a", "name": "mds_join_fs"}]=0 v14) v1 ==== 96+0+0 (secure 0 0 0) 0x7fab3814efd0 con 0x7fab381de140 2023-10-14T10:35:44.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.511+0000 7fab3dd3c640 1 -- 172.21.15.8:0/3580811478 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fab1806ae70 msgr2=0x7fab1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:44.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.511+0000 7fab3dd3c640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fab1806ae70 0x7fab1806d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fab28001560 tx=0x7fab28009040 comp rx=0 tx=0).stop 2023-10-14T10:35:44.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.511+0000 7fab3dd3c640 1 -- 172.21.15.8:0/3580811478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab381de140 msgr2=0x7fab3814a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:44.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.511+0000 7fab3dd3c640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab381de140 0x7fab3814a130 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fab300098c0 tx=0x7fab300046c0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.511+0000 7fab3dd3c640 1 -- 172.21.15.8:0/3580811478 shutdown_connections 2023-10-14T10:35:44.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.512+0000 7fab3dd3c640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fab1806ae70 0x7fab1806d330 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.512+0000 7fab3dd3c640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab381de140 0x7fab3814a130 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.512+0000 7fab3dd3c640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab3814e680 0x7fab3814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.512+0000 7fab3dd3c640 1 --2- 172.21.15.8:0/3580811478 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab380c23a0 0x7fab3814b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.512+0000 7fab3dd3c640 1 -- 172.21.15.8:0/3580811478 >> 172.21.15.8:0/3580811478 conn(0x7fab3806a200 msgr2=0x7fab3814dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:44.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.512+0000 7fab3dd3c640 1 -- 172.21.15.8:0/3580811478 shutdown_connections 2023-10-14T10:35:44.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.512+0000 7fab3dd3c640 1 -- 172.21.15.8:0/3580811478 wait complete. 2023-10-14T10:35:44.533 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop' 2023-10-14T10:35:44.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.761+0000 7f8cc7fff640 1 Processor -- start 2023-10-14T10:35:44.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.761+0000 7f8cc7fff640 1 -- start start 2023-10-14T10:35:44.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.762+0000 7f8cc7fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8cc81514c0 0x7f8cc806b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:44.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.763+0000 7f8cc7fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8cc80c50f0 0x7f8cc80c7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:44.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.763+0000 7f8cc7fff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc81543b0 con 0x7f8cc8154840 2023-10-14T10:35:44.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.763+0000 7f8cc7fff640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc806c3c0 con 0x7f8cc81514c0 2023-10-14T10:35:44.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.763+0000 7f8cc7fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc8153e30 con 0x7f8cc80c50f0 2023-10-14T10:35:44.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.763+0000 7f8cc6ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8cc81514c0 0x7f8cc806b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:44.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.763+0000 7f8cc77fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f8cc8154840 0x7f8cc80c4550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56454/0 (socket says 172.21.15.8:56454) 2023-10-14T10:35:44.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.763+0000 7f8cc6ffd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8cc81514c0 0x7f8cc806b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36706/0 (socket says 172.21.15.8:36706) 2023-10-14T10:35:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.763+0000 7f8cc77fe640 1 -- 172.21.15.8:0/2954938444 learned_addr learned my addr 172.21.15.8:0/2954938444 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.763+0000 7f8cbffff640 1 --2- 172.21.15.8:0/2954938444 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8cc80c50f0 0x7f8cc80c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.764+0000 7f8cc6ffd640 1 -- 172.21.15.8:0/2954938444 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8cc80c50f0 msgr2=0x7f8cc80c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.764+0000 7f8cc6ffd640 1 --2- 172.21.15.8:0/2954938444 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8cc80c50f0 0x7f8cc80c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.764+0000 7f8cc6ffd640 1 -- 172.21.15.8:0/2954938444 >> v1:172.21.15.8:6789/0 conn(0x7f8cc8154840 legacy=0x7f8cc80c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:44.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.764+0000 7f8cc6ffd640 1 -- 172.21.15.8:0/2954938444 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc81518a0 con 0x7f8cc81514c0 2023-10-14T10:35:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.764+0000 7f8cc67fc640 1 -- 172.21.15.8:0/2954938444 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616432483 0 0) 0x7f8cc81543b0 con 0x7f8cc8154840 2023-10-14T10:35:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.765+0000 7f8cc6ffd640 1 --2- 172.21.15.8:0/2954938444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cc81514c0 0x7f8cc806b5d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80097a0 tx=0x7f8cb802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29754e0302d6d0f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.765+0000 7f8cc67fc640 1 -- 172.21.15.8:0/2954938444 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb802e070 con 0x7f8cc81514c0 2023-10-14T10:35:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.765+0000 7f8cc67fc640 1 -- 172.21.15.8:0/2954938444 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb80315a0 con 0x7f8cc81514c0 2023-10-14T10:35:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.765+0000 7f8cc67fc640 1 -- 172.21.15.8:0/2954938444 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8031930 con 0x7f8cc81514c0 2023-10-14T10:35:44.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.766+0000 7f8cc7fff640 1 -- 172.21.15.8:0/2954938444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cc81514c0 msgr2=0x7f8cc806b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:44.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.766+0000 7f8cc7fff640 1 --2- 172.21.15.8:0/2954938444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cc81514c0 0x7f8cc806b5d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80097a0 tx=0x7f8cb802b840 comp rx=0 tx=0).stop 2023-10-14T10:35:44.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.766+0000 7f8cc7fff640 1 -- 172.21.15.8:0/2954938444 shutdown_connections 2023-10-14T10:35:44.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.766+0000 7f8cc7fff640 1 --2- 172.21.15.8:0/2954938444 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8cc80c50f0 0x7f8cc80c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.766+0000 7f8cc7fff640 1 --2- 172.21.15.8:0/2954938444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cc81514c0 0x7f8cc806b5d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.766+0000 7f8cc7fff640 1 -- 172.21.15.8:0/2954938444 >> 172.21.15.8:0/2954938444 conn(0x7f8cc80c60b0 msgr2=0x7f8cc80c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:44.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.766+0000 7f8cc7fff640 1 -- 172.21.15.8:0/2954938444 shutdown_connections 2023-10-14T10:35:44.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.766+0000 7f8cc7fff640 1 -- 172.21.15.8:0/2954938444 wait complete. 2023-10-14T10:35:44.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.768+0000 7f8cc7fff640 1 Processor -- start 2023-10-14T10:35:44.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.768+0000 7f8cc7fff640 1 -- start start 2023-10-14T10:35:44.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.769+0000 7f8cc7fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8cc80c50f0 0x7f8cc814f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:44.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.769+0000 7f8cc7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cc81514c0 0x7f8cc80a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:44.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.769+0000 7f8cc7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cc8154840 0x7f8cc80a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:44.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.769+0000 7f8cc7fff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc81e90f0 con 0x7f8cc8154840 2023-10-14T10:35:44.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.769+0000 7f8cc7fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc81e9950 con 0x7f8cc81514c0 2023-10-14T10:35:44.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.769+0000 7f8cc7fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc814e560 con 0x7f8cc80c50f0 2023-10-14T10:35:44.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.769+0000 7f8cc77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cc8154840 0x7f8cc80a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:44.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.769+0000 7f8cc77fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cc8154840 0x7f8cc80a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36722/0 (socket says 172.21.15.8:36722) 2023-10-14T10:35:44.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.769+0000 7f8cc77fe640 1 -- 172.21.15.8:0/3674409638 learned_addr learned my addr 172.21.15.8:0/3674409638 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:44.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.770+0000 7f8cbffff640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cc81514c0 0x7f8cc80a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:44.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.770+0000 7f8cc6ffd640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8cc80c50f0 0x7f8cc814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:44.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.770+0000 7f8cc77fe640 1 -- 172.21.15.8:0/3674409638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8cc80c50f0 msgr2=0x7f8cc814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:44.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.770+0000 7f8cc77fe640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8cc80c50f0 0x7f8cc814f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.770+0000 7f8cc77fe640 1 -- 172.21.15.8:0/3674409638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cc81514c0 msgr2=0x7f8cc80a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:44.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.770+0000 7f8cc77fe640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cc81514c0 0x7f8cc80a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:44.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.770+0000 7f8cc77fe640 1 -- 172.21.15.8:0/3674409638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb8009400 con 0x7f8cc8154840 2023-10-14T10:35:44.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.770+0000 7f8cbffff640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cc81514c0 0x7f8cc80a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:35:44.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.770+0000 7f8cc77fe640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cc8154840 0x7f8cc80a9490 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000c7b0 tx=0x7f8cc000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:44.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.771+0000 7f8cbf7fe640 1 -- 172.21.15.8:0/3674409638 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000a640 con 0x7f8cc8154840 2023-10-14T10:35:44.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.771+0000 7f8cbf7fe640 1 -- 172.21.15.8:0/3674409638 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc000a7c0 con 0x7f8cc8154840 2023-10-14T10:35:44.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.771+0000 7f8cbf7fe640 1 -- 172.21.15.8:0/3674409638 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000ab70 con 0x7f8cc8154840 2023-10-14T10:35:44.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.771+0000 7f8cc7fff640 1 -- 172.21.15.8:0/3674409638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc81e9300 con 0x7f8cc8154840 2023-10-14T10:35:44.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.771+0000 7f8cc7fff640 1 -- 172.21.15.8:0/3674409638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc814fec0 con 0x7f8cc8154840 2023-10-14T10:35:44.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.772+0000 7f8cc7fff640 1 -- 172.21.15.8:0/3674409638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc80c9070 con 0x7f8cc8154840 2023-10-14T10:35:44.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.773+0000 7f8cbf7fe640 1 -- 172.21.15.8:0/3674409638 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8cc000acd0 con 0x7f8cc8154840 2023-10-14T10:35:44.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.774+0000 7f8cbf7fe640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8ca806ae70 0x7f8ca806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:44.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.774+0000 7f8cbf7fe640 1 -- 172.21.15.8:0/3674409638 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8cc0088800 con 0x7f8cc8154840 2023-10-14T10:35:44.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.774+0000 7f8cc6ffd640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8ca806ae70 0x7f8ca806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:44.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.775+0000 7f8cc6ffd640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8ca806ae70 0x7f8ca806d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8036000 tx=0x7f8cb803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:44.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:44.778+0000 7f8cbf7fe640 1 -- 172.21.15.8:0/3674409638 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8cc0053b10 con 0x7f8cc8154840 2023-10-14T10:35:45.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.055+0000 7f8cc7fff640 1 -- 172.21.15.8:0/3674409638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop"]} v 0) v1 -- 0x7f8cc804e9b0 con 0x7f8cc8154840 2023-10-14T10:35:45.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.606+0000 7f8cbf7fe640 1 -- 172.21.15.8:0/3674409638 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop"]}]=0 v114) v1 ==== 143+0+0 (secure 0 0 0) 0x7f8cc00180d0 con 0x7f8cc8154840 2023-10-14T10:35:45.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.609+0000 7f8cc7fff640 1 -- 172.21.15.8:0/3674409638 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8ca806ae70 msgr2=0x7f8ca806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:45.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.609+0000 7f8cc7fff640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8ca806ae70 0x7f8ca806d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8036000 tx=0x7f8cb803d040 comp rx=0 tx=0).stop 2023-10-14T10:35:45.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.609+0000 7f8cc7fff640 1 -- 172.21.15.8:0/3674409638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cc8154840 msgr2=0x7f8cc80a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.609+0000 7f8cc7fff640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cc8154840 0x7f8cc80a9490 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000c7b0 tx=0x7f8cc000cc70 comp rx=0 tx=0).stop 2023-10-14T10:35:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.610+0000 7f8cc7fff640 1 -- 172.21.15.8:0/3674409638 shutdown_connections 2023-10-14T10:35:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.610+0000 7f8cc7fff640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8ca806ae70 0x7f8ca806d330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:45.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.610+0000 7f8cc7fff640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cc8154840 0x7f8cc80a9490 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.610+0000 7f8cc7fff640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cc81514c0 0x7f8cc80a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.610+0000 7f8cc7fff640 1 --2- 172.21.15.8:0/3674409638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8cc80c50f0 0x7f8cc814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.610+0000 7f8cc7fff640 1 -- 172.21.15.8:0/3674409638 >> 172.21.15.8:0/3674409638 conn(0x7f8cc80c60b0 msgr2=0x7f8cc8153520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:45.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.610+0000 7f8cc7fff640 1 -- 172.21.15.8:0/3674409638 shutdown_connections 2023-10-14T10:35:45.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:45.610+0000 7f8cc7fff640 1 -- 172.21.15.8:0/3674409638 wait complete. 2023-10-14T10:35:45.634 INFO:tasks.cephfs_test_runner:That unsetting mds_join_fs will not cause failover if no high-affinity standby exists. ... ERROR 2023-10-14T10:35:45.634 INFO:tasks.cephfs_test_runner: 2023-10-14T10:35:45.635 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T10:35:45.635 INFO:tasks.cephfs_test_runner:ERROR: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) 2023-10-14T10:35:45.635 INFO:tasks.cephfs_test_runner:That unsetting mds_join_fs will not cause failover if no high-affinity standby exists. 2023-10-14T10:35:45.636 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T10:35:45.636 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T10:35:45.636 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_failover.py", line 104, in test_join_fs_drop 2023-10-14T10:35:45.637 INFO:tasks.cephfs_test_runner: self._reach_target(target) 2023-10-14T10:35:45.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_failover.py", line 61, in _reach_target 2023-10-14T10:35:45.637 INFO:tasks.cephfs_test_runner: self.wait_until_true(takeover, 30) 2023-10-14T10:35:45.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/ceph_test_case.py", line 345, in wait_until_true 2023-10-14T10:35:45.638 INFO:tasks.cephfs_test_runner: raise TestTimeoutError("Timed out after {0}s and {1} retries".format(elapsed, retry_count)) 2023-10-14T10:35:45.638 INFO:tasks.cephfs_test_runner:tasks.ceph_test_case.TestTimeoutError: Timed out after 30s and 0 retries 2023-10-14T10:35:45.638 INFO:tasks.cephfs_test_runner: 2023-10-14T10:35:45.639 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T10:35:45.639 INFO:tasks.cephfs_test_runner:Ran 1 test in 83.923s 2023-10-14T10:35:45.639 INFO:tasks.cephfs_test_runner: 2023-10-14T10:35:45.640 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-14T10:35:45.640 INFO:tasks.cephfs_test_runner: 2023-10-14T10:35:45.640 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T10:35:45.641 INFO:tasks.cephfs_test_runner:ERROR: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) 2023-10-14T10:35:45.641 INFO:tasks.cephfs_test_runner:That unsetting mds_join_fs will not cause failover if no high-affinity standby exists. 2023-10-14T10:35:45.641 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T10:35:45.642 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T10:35:45.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_failover.py", line 104, in test_join_fs_drop 2023-10-14T10:35:45.642 INFO:tasks.cephfs_test_runner: self._reach_target(target) 2023-10-14T10:35:45.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_failover.py", line 61, in _reach_target 2023-10-14T10:35:45.643 INFO:tasks.cephfs_test_runner: self.wait_until_true(takeover, 30) 2023-10-14T10:35:45.643 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/ceph_test_case.py", line 345, in wait_until_true 2023-10-14T10:35:45.643 INFO:tasks.cephfs_test_runner: raise TestTimeoutError("Timed out after {0}s and {1} retries".format(elapsed, retry_count)) 2023-10-14T10:35:45.643 INFO:tasks.cephfs_test_runner:tasks.ceph_test_case.TestTimeoutError: Timed out after 30s and 0 retries 2023-10-14T10:35:45.644 INFO:tasks.cephfs_test_runner: 2023-10-14T10:35:45.644 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) 2023-10-14T10:35:45.710 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f210bf890761411bb01c60df0d299398 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) 2023-10-14T10:35:45.713 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-14T10:35:45.724 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-14T10:35:45.764 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-14T10:35:45.765 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T10:35:45.765 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T10:35:45.832 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-10-14T10:35:45.833 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-10-14T10:35:45.833 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T10:35:45.894 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054298,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-14T10:35:45.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:35:45.896 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-14T10:35:45.958 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T10:35:45.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:35:45.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T10:35:46.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:35:46.054 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-10-14T10:35:46.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:35:46.179 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-10-14T10:35:46.240 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T10:35:46.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:35:46.242 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T10:35:46.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T10:35:46.342 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-10-14T10:35:46.460 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T10:35:46.470 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T10:35:46.471 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T10:35:46.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.707+0000 7fb1604fc640 1 Processor -- start 2023-10-14T10:35:46.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.707+0000 7fb1604fc640 1 -- start start 2023-10-14T10:35:46.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.709+0000 7fb1604fc640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb15814ac70 0x7fb1581547d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:46.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.709+0000 7fb1604fc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb158154d10 0x7fb1580c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:46.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.709+0000 7fb1604fc640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1580c1050 con 0x7fb1580c5ce0 2023-10-14T10:35:46.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.709+0000 7fb1604fc640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1581540a0 con 0x7fb15814ac70 2023-10-14T10:35:46.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.709+0000 7fb1604fc640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580c0a90 con 0x7fb158154d10 2023-10-14T10:35:46.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.709+0000 7fb15e298640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb15814ac70 0x7fb1581547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:46.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.709+0000 7fb15ea99640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb1580c5ce0 0x7fb1580c1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56470/0 (socket says 172.21.15.8:56470) 2023-10-14T10:35:46.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.709+0000 7fb15ea99640 1 -- 172.21.15.8:0/2985914461 learned_addr learned my addr 172.21.15.8:0/2985914461 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:46.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.709+0000 7fb15da97640 1 --2- 172.21.15.8:0/2985914461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb158154d10 0x7fb1580c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:46.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.710+0000 7fb15e298640 1 -- 172.21.15.8:0/2985914461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb158154d10 msgr2=0x7fb1580c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:46.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.710+0000 7fb15e298640 1 --2- 172.21.15.8:0/2985914461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb158154d10 0x7fb1580c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:46.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.710+0000 7fb15e298640 1 -- 172.21.15.8:0/2985914461 >> v1:172.21.15.8:6789/0 conn(0x7fb1580c5ce0 legacy=0x7fb1580c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:46.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.710+0000 7fb15d296640 1 -- 172.21.15.8:0/2985914461 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129541667 0 0) 0x7fb1580c1050 con 0x7fb1580c5ce0 2023-10-14T10:35:46.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.710+0000 7fb15e298640 1 -- 172.21.15.8:0/2985914461 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580c0d70 con 0x7fb15814ac70 2023-10-14T10:35:46.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.711+0000 7fb15e298640 1 --2- 172.21.15.8:0/2985914461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb15814ac70 0x7fb1581547d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb1540097a0 tx=0x7fb15402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895581f6743b0d2b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:46.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.711+0000 7fb15d296640 1 -- 172.21.15.8:0/2985914461 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15402e070 con 0x7fb15814ac70 2023-10-14T10:35:46.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.711+0000 7fb15d296640 1 -- 172.21.15.8:0/2985914461 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1540315a0 con 0x7fb15814ac70 2023-10-14T10:35:46.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.711+0000 7fb15d296640 1 -- 172.21.15.8:0/2985914461 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154031930 con 0x7fb15814ac70 2023-10-14T10:35:46.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.712+0000 7fb1604fc640 1 -- 172.21.15.8:0/2985914461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb15814ac70 msgr2=0x7fb1581547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:46.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.712+0000 7fb1604fc640 1 --2- 172.21.15.8:0/2985914461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb15814ac70 0x7fb1581547d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb1540097a0 tx=0x7fb15402b840 comp rx=0 tx=0).stop 2023-10-14T10:35:46.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.712+0000 7fb1604fc640 1 -- 172.21.15.8:0/2985914461 shutdown_connections 2023-10-14T10:35:46.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.712+0000 7fb1604fc640 1 --2- 172.21.15.8:0/2985914461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb158154d10 0x7fb1580c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:46.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.712+0000 7fb1604fc640 1 --2- 172.21.15.8:0/2985914461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb15814ac70 0x7fb1581547d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:46.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.712+0000 7fb1604fc640 1 -- 172.21.15.8:0/2985914461 >> 172.21.15.8:0/2985914461 conn(0x7fb1580a74d0 msgr2=0x7fb1580a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:46.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.712+0000 7fb1604fc640 1 -- 172.21.15.8:0/2985914461 shutdown_connections 2023-10-14T10:35:46.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.712+0000 7fb1604fc640 1 -- 172.21.15.8:0/2985914461 wait complete. 2023-10-14T10:35:46.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.713+0000 7fb1604fc640 1 Processor -- start 2023-10-14T10:35:46.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.714+0000 7fb1604fc640 1 -- start start 2023-10-14T10:35:46.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.714+0000 7fb1604fc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1580c5ce0 0x7fb1581ec610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:46.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb1604fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb15814ac70 0x7fb1581ecb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:46.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb1604fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb15814b0e0 0x7fb15814c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:46.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb1604fc640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15814b7b0 con 0x7fb15814b0e0 2023-10-14T10:35:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb1604fc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb158147bd0 con 0x7fb15814ac70 2023-10-14T10:35:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb1604fc640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1581ed090 con 0x7fb1580c5ce0 2023-10-14T10:35:46.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb15ea99640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb15814b0e0 0x7fb15814c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb15ea99640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb15814b0e0 0x7fb15814c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36748/0 (socket says 172.21.15.8:36748) 2023-10-14T10:35:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb15ea99640 1 -- 172.21.15.8:0/35721559 learned_addr learned my addr 172.21.15.8:0/35721559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb15e298640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1580c5ce0 0x7fb1581ec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:46.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb15da97640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb15814ac70 0x7fb1581ecb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb15ea99640 1 -- 172.21.15.8:0/35721559 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1580c5ce0 msgr2=0x7fb1581ec610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb15ea99640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1580c5ce0 0x7fb1581ec610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:46.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb15ea99640 1 -- 172.21.15.8:0/35721559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb15814ac70 msgr2=0x7fb1581ecb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb15ea99640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb15814ac70 0x7fb1581ecb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb15ea99640 1 -- 172.21.15.8:0/35721559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb154009400 con 0x7fb15814b0e0 2023-10-14T10:35:46.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.715+0000 7fb15da97640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb15814ac70 0x7fb1581ecb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.716+0000 7fb15ea99640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb15814b0e0 0x7fb15814c8a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb15000c7a0 tx=0x7fb15000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.716+0000 7fb14effd640 1 -- 172.21.15.8:0/35721559 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15000a640 con 0x7fb15814b0e0 2023-10-14T10:35:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.716+0000 7fb14effd640 1 -- 172.21.15.8:0/35721559 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15000a7a0 con 0x7fb15814b0e0 2023-10-14T10:35:46.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.716+0000 7fb14effd640 1 -- 172.21.15.8:0/35721559 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15000abd0 con 0x7fb15814b0e0 2023-10-14T10:35:46.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.716+0000 7fb1604fc640 1 -- 172.21.15.8:0/35721559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1580c0120 con 0x7fb15814b0e0 2023-10-14T10:35:46.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.716+0000 7fb1604fc640 1 -- 172.21.15.8:0/35721559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1581564b0 con 0x7fb15814b0e0 2023-10-14T10:35:46.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.717+0000 7fb1604fc640 1 -- 172.21.15.8:0/35721559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb158073b50 con 0x7fb15814b0e0 2023-10-14T10:35:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.718+0000 7fb14effd640 1 -- 172.21.15.8:0/35721559 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb15000ad30 con 0x7fb15814b0e0 2023-10-14T10:35:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.719+0000 7fb14effd640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb13c06aea0 0x7fb13c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:46.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.719+0000 7fb14effd640 1 -- 172.21.15.8:0/35721559 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb1500887e0 con 0x7fb15814b0e0 2023-10-14T10:35:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.720+0000 7fb15e298640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb13c06aea0 0x7fb13c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.721+0000 7fb15e298640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb13c06aea0 0x7fb13c06d360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb154036000 tx=0x7fb154008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:46.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.724+0000 7fb14effd640 1 -- 172.21.15.8:0/35721559 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb150053af0 con 0x7fb15814b0e0 2023-10-14T10:35:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.916+0000 7fb1604fc640 1 -- 172.21.15.8:0/35721559 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1581542b0 con 0x7fb13c06aea0 2023-10-14T10:35:46.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.923+0000 7fb14effd640 1 -- 172.21.15.8:0/35721559 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48611 (secure 0 0 0) 0x7fb1540043a0 con 0x7fb13c06aea0 2023-10-14T10:35:46.926 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:46.927 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T10:35:46.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.926+0000 7fb1604fc640 1 -- 172.21.15.8:0/35721559 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb13c06aea0 msgr2=0x7fb13c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:46.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.926+0000 7fb1604fc640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb13c06aea0 0x7fb13c06d360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb154036000 tx=0x7fb154008030 comp rx=0 tx=0).stop 2023-10-14T10:35:46.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.926+0000 7fb1604fc640 1 -- 172.21.15.8:0/35721559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb15814b0e0 msgr2=0x7fb15814c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:46.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.926+0000 7fb1604fc640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb15814b0e0 0x7fb15814c8a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb15000c7a0 tx=0x7fb15000cc60 comp rx=0 tx=0).stop 2023-10-14T10:35:46.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.926+0000 7fb1604fc640 1 -- 172.21.15.8:0/35721559 shutdown_connections 2023-10-14T10:35:46.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.926+0000 7fb1604fc640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fb13c06aea0 0x7fb13c06d360 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:46.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.926+0000 7fb1604fc640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb15814b0e0 0x7fb15814c8a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:46.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.926+0000 7fb1604fc640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb15814ac70 0x7fb1581ecb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:46.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.926+0000 7fb1604fc640 1 --2- 172.21.15.8:0/35721559 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1580c5ce0 0x7fb1581ec610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:46.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.926+0000 7fb1604fc640 1 -- 172.21.15.8:0/35721559 >> 172.21.15.8:0/35721559 conn(0x7fb1580a74d0 msgr2=0x7fb1580a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:46.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.926+0000 7fb1604fc640 1 -- 172.21.15.8:0/35721559 shutdown_connections 2023-10-14T10:35:46.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:46.926+0000 7fb1604fc640 1 -- 172.21.15.8:0/35721559 wait complete. 2023-10-14T10:35:46.949 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-14T10:35:46.675176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":237256,"kb_used_data":4440,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737464,"statfs":{"total":773094113280,"available":772851163136,"internally_reserved":0,"allocated":4546560,"data_stored":2507821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.103576"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T10:35:42.604703+0000","last_change":"2023-10-14T10:33:42.821659+0000","last_active":"2023-10-14T10:35:42.604703+0000","last_peered":"2023-10-14T10:35:42.604703+0000","last_clean":"2023-10-14T10:35:42.604703+0000","last_became_active":"2023-10-14T10:33:42.819441+0000","last_became_peered":"2023-10-14T10:33:42.819441+0000","last_unstale":"2023-10-14T10:35:42.604703+0000","last_undegraded":"2023-10-14T10:35:42.604703+0000","last_fullsized":"2023-10-14T10:35:42.604703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_clean_scrub_stamp":"2023-10-14T10:33:41.468382+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:59.542930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":754163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.1220000000000001}]},{"osd":1,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.179},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.5209999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.3480000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.583}]},{"osd":4,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.244}]},{"osd":5,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.472},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.6379999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.706},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":1.393}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":163795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.82199999999999995}]},{"osd":1,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.417},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.3129999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.395,"5min":3.395,"15min":3.395},"last":1.034},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.88200000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.4650000000000001}]},{"osd":4,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":1.268},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.5389999999999999}]},{"osd":5,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":1.236},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.5}]},{"osd":7,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.169},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.581}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.288},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.589}]},{"osd":1,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":3.1459999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.728},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.1850000000000001}]},{"osd":2,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.117},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.627}]},{"osd":3,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.9910000000000001,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":1.48}]},{"osd":4,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":1.393},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":3.8130000000000002,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.4339999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.536}]},{"osd":7,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":1.347}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":163795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.0600000000000001}]},{"osd":1,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.456},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.3819999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.859},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.585}]},{"osd":3,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.232},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.74}]},{"osd":5,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.516},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.6919999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.651},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.774}]},{"osd":7,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.821},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":2.028}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":413696,"data_stored":163795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91900000000000004,"15min":0.92800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.292,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93200000000000005,"15min":0.91900000000000004},"min":{"1min":0.63700000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4450000000000001,"5min":1.619,"15min":1.619},"last":0.67400000000000004}]},{"osd":1,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94699999999999995,"15min":0.95499999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.069,"15min":1.0669999999999999},"min":{"1min":0.55400000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6519999999999999,"5min":1.679,"15min":1.679},"last":0.75900000000000001}]},{"osd":2,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.2070000000000001,"15min":1.2170000000000001},"min":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6799999999999999,"5min":1.827,"15min":1.827},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.24,"15min":1.242},"min":{"1min":0.63,"5min":0.628,"15min":0.628},"max":{"1min":1.6870000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.99299999999999999}]},{"osd":4,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.258,"15min":1.2549999999999999},"min":{"1min":0.94399999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3859999999999999,"15min":1.3919999999999999},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":1.6699999999999999,"5min":2.347,"15min":2.347},"last":1.137}]},{"osd":5,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4119999999999999,"15min":1.4199999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.9810000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3660000000000001,"15min":1.3740000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.893,"5min":2.048,"15min":2.048},"last":1.1120000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.5149999999999999,"15min":1.5309999999999999},"min":{"1min":0.85899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.851,"5min":2.504,"15min":2.504},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.478,"5min":1.5409999999999999,"15min":1.5509999999999999},"min":{"1min":1.1000000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":1.8240000000000001,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.292}]},{"osd":7,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.4530000000000001,"15min":1.458},"min":{"1min":1.103,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.0409999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.363},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.581,"15min":1.5900000000000001},"min":{"1min":0.92900000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.984,"5min":2.419,"15min":2.419},"last":1.331}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31604,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.92700000000000005,"15min":0.93000000000000005},"min":{"1min":0.42999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.46,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.64400000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6359999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.101}]},{"osd":1,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.98099999999999998,"15min":0.997},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.425,"5min":1.476,"15min":1.476},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.103,"15min":1.105},"min":{"1min":0.61399999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6439999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.2350000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.1379999999999999,"15min":1.1559999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4630000000000001,"5min":1.794,"15min":1.794},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1839999999999999,"15min":1.1830000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.026}]},{"osd":4,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4139999999999999,"15min":1.417},"min":{"1min":0.92500000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.839,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.331},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.373,"15min":1.399},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.625,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.532}]},{"osd":5,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.478,"15min":1.506},"min":{"1min":0.86599999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.71,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.284},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4730000000000001,"15min":1.4770000000000001},"min":{"1min":0.878,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8879999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.506}]},{"osd":6,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.4950000000000001,"15min":1.5329999999999999},"min":{"1min":0.89000000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6910000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5780000000000001,"15min":1.6080000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.885,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.4770000000000001}]},{"osd":7,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.5289999999999999,"15min":1.5529999999999999},"min":{"1min":0.81399999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.9370000000000001,"5min":2.601,"15min":2.601},"last":1.7929999999999999},{"interface":"front","average":{"1min":1.486,"5min":1.641,"15min":1.667},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.9490000000000001,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.589}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":163795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.92500000000000004,"15min":0.94099999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4019999999999999,"5min":1.55,"15min":1.55},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.95799999999999996,"15min":0.94399999999999995},"min":{"1min":0.48399999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.7569999999999999,"5min":2.258,"15min":2.258},"last":1.5569999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93799999999999994,"15min":0.93600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.387,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.998},{"interface":"front","average":{"1min":1.046,"5min":1.1220000000000001,"15min":1.135},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.556,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.4830000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.135,"15min":1.125},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.851,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.8109999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.1040000000000001,"15min":1.093},"min":{"1min":0.52600000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.754,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.726}]},{"osd":4,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.83699999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.254},{"interface":"front","average":{"1min":1.304,"5min":1.345,"15min":1.3520000000000001},"min":{"1min":0.748,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.0680000000000001,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":2.0680000000000001}]},{"osd":5,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4750000000000001,"15min":1.4930000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.9139999999999999,"5min":4.1150000000000002,"15min":4.1150000000000002},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.6259999999999999,"15min":1.6459999999999999},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.004,"5min":4.242,"15min":4.242},"last":1.968}]},{"osd":6,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4670000000000001,"15min":1.4630000000000001},"min":{"1min":0.92400000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0510000000000002,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":2.0299999999999998},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.4870000000000001,"15min":1.504},"min":{"1min":0.89200000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.724,"5min":3.02,"15min":3.02},"last":1.615}]},{"osd":7,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5469999999999999,"15min":1.5629999999999999},"min":{"1min":0.79000000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.9490000000000001,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.8540000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.5289999999999999,"15min":1.5389999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.962,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":1.9079999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":759738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88600000000000001,"15min":0.88300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.94999999999999996,"15min":0.94299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.65500000000000003}]},{"osd":2,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.131,"15min":1.143},"min":{"1min":0.50700000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5229999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.077,"15min":1.091},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.552,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.63900000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2310000000000001,"15min":1.2230000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.6839999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.131,"15min":1.141},"min":{"1min":0.54900000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5660000000000001,"5min":3.673,"15min":3.673},"last":0.79400000000000004}]},{"osd":4,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3149999999999999,"15min":1.319},"min":{"1min":0.78400000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":2.597},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4830000000000001,"15min":1.4890000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":3.1859999999999999}]},{"osd":5,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.431,"15min":1.4390000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.274,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":2.274},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.506,"15min":1.5149999999999999},"min":{"1min":0.83399999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.9219999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.4370000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4910000000000001,"15min":1.4970000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.9450000000000001,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.9450000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.6619999999999999,"15min":1.6899999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1349999999999998,"5min":3.3519999999999999,"15min":3.3519999999999999},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.556,"15min":1.55},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.6459999999999999,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":2.6459999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.55,"15min":1.554},"min":{"1min":0.879,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.2360000000000002,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":2.2360000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T10:35:46.952 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T10:35:47.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.178+0000 7fade0e59640 1 Processor -- start 2023-10-14T10:35:47.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.178+0000 7fade0e59640 1 -- start start 2023-10-14T10:35:47.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.180+0000 7fade0e59640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faddc0a9610 0x7faddc151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:47.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.180+0000 7fade0e59640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7faddc06faf0 0x7faddc06ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:47.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.180+0000 7fade0e59640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc071650 con 0x7faddc14abb0 2023-10-14T10:35:47.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.180+0000 7fade0e59640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc0a9280 con 0x7faddc0a9610 2023-10-14T10:35:47.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.180+0000 7fade0e59640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc0aa6f0 con 0x7faddc06faf0 2023-10-14T10:35:47.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.180+0000 7fadd3fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faddc0a9610 0x7faddc151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:47.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.180+0000 7fadd3fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faddc0a9610 0x7faddc151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44280/0 (socket says 172.21.15.8:44280) 2023-10-14T10:35:47.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.180+0000 7fadd3fff640 1 -- 172.21.15.8:0/4143877354 learned_addr learned my addr 172.21.15.8:0/4143877354 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:47.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.181+0000 7faddbfff640 1 --2- 172.21.15.8:0/4143877354 >> v2:172.21.15.92:3300/0 conn(0x7faddc06faf0 0x7faddc06ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:47.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.181+0000 7fadd3fff640 1 -- 172.21.15.8:0/4143877354 >> v2:172.21.15.92:3300/0 conn(0x7faddc06faf0 msgr2=0x7faddc06ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:47.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.181+0000 7fadd3fff640 1 --2- 172.21.15.8:0/4143877354 >> v2:172.21.15.92:3300/0 conn(0x7faddc06faf0 0x7faddc06ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.181+0000 7fadd3fff640 1 -- 172.21.15.8:0/4143877354 >> v1:172.21.15.92:6789/0 conn(0x7faddc14abb0 legacy=0x7faddc0c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:47.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.181+0000 7fadd3fff640 1 -- 172.21.15.8:0/4143877354 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc0a81e0 con 0x7faddc0a9610 2023-10-14T10:35:47.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.181+0000 7faddbfff640 1 --2- 172.21.15.8:0/4143877354 >> v2:172.21.15.92:3300/0 conn(0x7faddc06faf0 0x7faddc06ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:47.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.183+0000 7fadd3fff640 1 --2- 172.21.15.8:0/4143877354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faddc0a9610 0x7faddc151470 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7faddc1509f0 tx=0x7fadc402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295e7bd4ceae36a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:47.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.184+0000 7faddaffd640 1 -- 172.21.15.8:0/4143877354 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4031870 con 0x7faddc0a9610 2023-10-14T10:35:47.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.184+0000 7faddaffd640 1 -- 172.21.15.8:0/4143877354 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc40319d0 con 0x7faddc0a9610 2023-10-14T10:35:47.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.184+0000 7faddaffd640 1 -- 172.21.15.8:0/4143877354 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4031d60 con 0x7faddc0a9610 2023-10-14T10:35:47.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.184+0000 7fade0e59640 1 -- 172.21.15.8:0/4143877354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faddc0a9610 msgr2=0x7faddc151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:47.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.184+0000 7fade0e59640 1 --2- 172.21.15.8:0/4143877354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faddc0a9610 0x7faddc151470 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7faddc1509f0 tx=0x7fadc402b910 comp rx=0 tx=0).stop 2023-10-14T10:35:47.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.185+0000 7fade0e59640 1 -- 172.21.15.8:0/4143877354 shutdown_connections 2023-10-14T10:35:47.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.185+0000 7fade0e59640 1 --2- 172.21.15.8:0/4143877354 >> v2:172.21.15.92:3300/0 conn(0x7faddc06faf0 0x7faddc06ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.185+0000 7fade0e59640 1 --2- 172.21.15.8:0/4143877354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faddc0a9610 0x7faddc151470 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.185+0000 7fade0e59640 1 -- 172.21.15.8:0/4143877354 >> 172.21.15.8:0/4143877354 conn(0x7faddc06a200 msgr2=0x7faddc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:47.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.185+0000 7fade0e59640 1 -- 172.21.15.8:0/4143877354 shutdown_connections 2023-10-14T10:35:47.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.185+0000 7fade0e59640 1 -- 172.21.15.8:0/4143877354 wait complete. 2023-10-14T10:35:47.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.186+0000 7fade0e59640 1 Processor -- start 2023-10-14T10:35:47.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.187+0000 7fade0e59640 1 -- start start 2023-10-14T10:35:47.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.187+0000 7fade0e59640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faddc06faf0 0x7faddc0c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:47.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.187+0000 7fade0e59640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faddc0a9610 0x7faddc0bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:47.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7fade0e59640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faddc14abb0 0x7faddc149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:47.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7fade0e59640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0c2f80 con 0x7faddc06faf0 2023-10-14T10:35:47.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7fade0e59640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0bf6f0 con 0x7faddc0a9610 2023-10-14T10:35:47.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7fade0e59640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc1e7a70 con 0x7faddc14abb0 2023-10-14T10:35:47.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7faddb7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faddc06faf0 0x7faddc0c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:47.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7faddb7fe640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faddc06faf0 0x7faddc0c07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44286/0 (socket says 172.21.15.8:44286) 2023-10-14T10:35:47.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7faddb7fe640 1 -- 172.21.15.8:0/2243810698 learned_addr learned my addr 172.21.15.8:0/2243810698 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:47.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7faddbfff640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faddc14abb0 0x7faddc149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:47.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7fadd3fff640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faddc0a9610 0x7faddc0bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:47.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7faddb7fe640 1 -- 172.21.15.8:0/2243810698 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faddc14abb0 msgr2=0x7faddc149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:47.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7faddb7fe640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faddc14abb0 0x7faddc149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7faddb7fe640 1 -- 172.21.15.8:0/2243810698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faddc0a9610 msgr2=0x7faddc0bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:47.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7faddb7fe640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faddc0a9610 0x7faddc0bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7faddb7fe640 1 -- 172.21.15.8:0/2243810698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc40094d0 con 0x7faddc06faf0 2023-10-14T10:35:47.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.188+0000 7faddbfff640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faddc14abb0 0x7faddc149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:47.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.189+0000 7faddb7fe640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faddc06faf0 0x7faddc0c07b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00b3f0 tx=0x7fadcc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:47.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.189+0000 7fadd8ff9640 1 -- 172.21.15.8:0/2243810698 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc011830 con 0x7faddc06faf0 2023-10-14T10:35:47.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.189+0000 7fadd8ff9640 1 -- 172.21.15.8:0/2243810698 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc011990 con 0x7faddc06faf0 2023-10-14T10:35:47.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.189+0000 7fadd8ff9640 1 -- 172.21.15.8:0/2243810698 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc011d40 con 0x7faddc06faf0 2023-10-14T10:35:47.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.189+0000 7fade0e59640 1 -- 172.21.15.8:0/2243810698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc1e7d50 con 0x7faddc06faf0 2023-10-14T10:35:47.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.189+0000 7fade0e59640 1 -- 172.21.15.8:0/2243810698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc0bf380 con 0x7faddc06faf0 2023-10-14T10:35:47.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.190+0000 7fade0e59640 1 -- 172.21.15.8:0/2243810698 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc04e9b0 con 0x7faddc06faf0 2023-10-14T10:35:47.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.192+0000 7fadd8ff9640 1 -- 172.21.15.8:0/2243810698 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fadcc01a400 con 0x7faddc06faf0 2023-10-14T10:35:47.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.192+0000 7fadd8ff9640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fadbc06aea0 0x7fadbc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:47.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.193+0000 7fadd8ff9640 1 -- 172.21.15.8:0/2243810698 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fadcc0891a0 con 0x7faddc06faf0 2023-10-14T10:35:47.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.193+0000 7fadd3fff640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fadbc06aea0 0x7fadbc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:47.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.193+0000 7fadd3fff640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fadbc06aea0 0x7fadbc06d360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fadc4036000 tx=0x7fadc403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:47.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.197+0000 7fadd8ff9640 1 -- 172.21.15.8:0/2243810698 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fadcc054540 con 0x7faddc06faf0 2023-10-14T10:35:47.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.388+0000 7fade0e59640 1 -- 172.21.15.8:0/2243810698 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faddc0a87a0 con 0x7fadbc06aea0 2023-10-14T10:35:47.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.394+0000 7fadd8ff9640 1 -- 172.21.15.8:0/2243810698 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48611 (secure 0 0 0) 0x7fadc4031810 con 0x7fadbc06aea0 2023-10-14T10:35:47.396 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:47.397 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T10:35:47.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.396+0000 7fade0e59640 1 -- 172.21.15.8:0/2243810698 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fadbc06aea0 msgr2=0x7fadbc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:47.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.396+0000 7fade0e59640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fadbc06aea0 0x7fadbc06d360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fadc4036000 tx=0x7fadc403c040 comp rx=0 tx=0).stop 2023-10-14T10:35:47.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.396+0000 7fade0e59640 1 -- 172.21.15.8:0/2243810698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faddc06faf0 msgr2=0x7faddc0c07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:47.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.396+0000 7fade0e59640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faddc06faf0 0x7faddc0c07b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00b3f0 tx=0x7fadcc00b8b0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.396+0000 7fade0e59640 1 -- 172.21.15.8:0/2243810698 shutdown_connections 2023-10-14T10:35:47.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.396+0000 7fade0e59640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fadbc06aea0 0x7fadbc06d360 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.396+0000 7fade0e59640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7faddc14abb0 0x7faddc149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.396+0000 7fade0e59640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faddc0a9610 0x7faddc0bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.396+0000 7fade0e59640 1 --2- 172.21.15.8:0/2243810698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faddc06faf0 0x7faddc0c07b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.396+0000 7fade0e59640 1 -- 172.21.15.8:0/2243810698 >> 172.21.15.8:0/2243810698 conn(0x7faddc06a200 msgr2=0x7faddc06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:47.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.397+0000 7fade0e59640 1 -- 172.21.15.8:0/2243810698 shutdown_connections 2023-10-14T10:35:47.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.397+0000 7fade0e59640 1 -- 172.21.15.8:0/2243810698 wait complete. 2023-10-14T10:35:47.419 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-14T10:35:46.675176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":237256,"kb_used_data":4440,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737464,"statfs":{"total":773094113280,"available":772851163136,"internally_reserved":0,"allocated":4546560,"data_stored":2507821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.103576"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T10:35:42.604703+0000","last_change":"2023-10-14T10:33:42.821659+0000","last_active":"2023-10-14T10:35:42.604703+0000","last_peered":"2023-10-14T10:35:42.604703+0000","last_clean":"2023-10-14T10:35:42.604703+0000","last_became_active":"2023-10-14T10:33:42.819441+0000","last_became_peered":"2023-10-14T10:33:42.819441+0000","last_unstale":"2023-10-14T10:35:42.604703+0000","last_undegraded":"2023-10-14T10:35:42.604703+0000","last_fullsized":"2023-10-14T10:35:42.604703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_clean_scrub_stamp":"2023-10-14T10:33:41.468382+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:59.542930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":754163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.1220000000000001}]},{"osd":1,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.179},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.5209999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.3480000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.583}]},{"osd":4,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.244}]},{"osd":5,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.472},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.6379999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.706},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":1.393}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":163795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.82199999999999995}]},{"osd":1,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.417},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.3129999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.395,"5min":3.395,"15min":3.395},"last":1.034},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.88200000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.4650000000000001}]},{"osd":4,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":1.268},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.5389999999999999}]},{"osd":5,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":1.236},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.5}]},{"osd":7,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.169},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.581}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.288},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.589}]},{"osd":1,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":3.1459999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.728},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.1850000000000001}]},{"osd":2,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.117},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.627}]},{"osd":3,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.9910000000000001,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":1.48}]},{"osd":4,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":1.393},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":3.8130000000000002,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.4339999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.536}]},{"osd":7,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":1.347}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":163795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.0600000000000001}]},{"osd":1,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.456},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.3819999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.859},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.585}]},{"osd":3,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.232},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.74}]},{"osd":5,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.516},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.6919999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.651},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.774}]},{"osd":7,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.821},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":2.028}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":413696,"data_stored":163795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91900000000000004,"15min":0.92800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.292,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93200000000000005,"15min":0.91900000000000004},"min":{"1min":0.63700000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4450000000000001,"5min":1.619,"15min":1.619},"last":0.67400000000000004}]},{"osd":1,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94699999999999995,"15min":0.95499999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.069,"15min":1.0669999999999999},"min":{"1min":0.55400000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6519999999999999,"5min":1.679,"15min":1.679},"last":0.75900000000000001}]},{"osd":2,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.2070000000000001,"15min":1.2170000000000001},"min":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6799999999999999,"5min":1.827,"15min":1.827},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.24,"15min":1.242},"min":{"1min":0.63,"5min":0.628,"15min":0.628},"max":{"1min":1.6870000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.99299999999999999}]},{"osd":4,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.258,"15min":1.2549999999999999},"min":{"1min":0.94399999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3859999999999999,"15min":1.3919999999999999},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":1.6699999999999999,"5min":2.347,"15min":2.347},"last":1.137}]},{"osd":5,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4119999999999999,"15min":1.4199999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.9810000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3660000000000001,"15min":1.3740000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.893,"5min":2.048,"15min":2.048},"last":1.1120000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.5149999999999999,"15min":1.5309999999999999},"min":{"1min":0.85899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.851,"5min":2.504,"15min":2.504},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.478,"5min":1.5409999999999999,"15min":1.5509999999999999},"min":{"1min":1.1000000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":1.8240000000000001,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.292}]},{"osd":7,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.4530000000000001,"15min":1.458},"min":{"1min":1.103,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.0409999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.363},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.581,"15min":1.5900000000000001},"min":{"1min":0.92900000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.984,"5min":2.419,"15min":2.419},"last":1.331}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31604,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.92700000000000005,"15min":0.93000000000000005},"min":{"1min":0.42999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.46,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.64400000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6359999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.101}]},{"osd":1,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.98099999999999998,"15min":0.997},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.425,"5min":1.476,"15min":1.476},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.103,"15min":1.105},"min":{"1min":0.61399999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6439999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.2350000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.1379999999999999,"15min":1.1559999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4630000000000001,"5min":1.794,"15min":1.794},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1839999999999999,"15min":1.1830000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.026}]},{"osd":4,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4139999999999999,"15min":1.417},"min":{"1min":0.92500000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.839,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.331},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.373,"15min":1.399},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.625,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.532}]},{"osd":5,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.478,"15min":1.506},"min":{"1min":0.86599999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.71,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.284},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4730000000000001,"15min":1.4770000000000001},"min":{"1min":0.878,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8879999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.506}]},{"osd":6,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.4950000000000001,"15min":1.5329999999999999},"min":{"1min":0.89000000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6910000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5780000000000001,"15min":1.6080000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.885,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.4770000000000001}]},{"osd":7,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.5289999999999999,"15min":1.5529999999999999},"min":{"1min":0.81399999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.9370000000000001,"5min":2.601,"15min":2.601},"last":1.7929999999999999},{"interface":"front","average":{"1min":1.486,"5min":1.641,"15min":1.667},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.9490000000000001,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.589}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":163795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.92500000000000004,"15min":0.94099999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4019999999999999,"5min":1.55,"15min":1.55},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.95799999999999996,"15min":0.94399999999999995},"min":{"1min":0.48399999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.7569999999999999,"5min":2.258,"15min":2.258},"last":1.5569999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93799999999999994,"15min":0.93600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.387,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.998},{"interface":"front","average":{"1min":1.046,"5min":1.1220000000000001,"15min":1.135},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.556,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.4830000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.135,"15min":1.125},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.851,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.8109999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.1040000000000001,"15min":1.093},"min":{"1min":0.52600000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.754,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.726}]},{"osd":4,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.83699999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.254},{"interface":"front","average":{"1min":1.304,"5min":1.345,"15min":1.3520000000000001},"min":{"1min":0.748,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.0680000000000001,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":2.0680000000000001}]},{"osd":5,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4750000000000001,"15min":1.4930000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.9139999999999999,"5min":4.1150000000000002,"15min":4.1150000000000002},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.6259999999999999,"15min":1.6459999999999999},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.004,"5min":4.242,"15min":4.242},"last":1.968}]},{"osd":6,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4670000000000001,"15min":1.4630000000000001},"min":{"1min":0.92400000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0510000000000002,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":2.0299999999999998},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.4870000000000001,"15min":1.504},"min":{"1min":0.89200000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.724,"5min":3.02,"15min":3.02},"last":1.615}]},{"osd":7,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5469999999999999,"15min":1.5629999999999999},"min":{"1min":0.79000000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.9490000000000001,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.8540000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.5289999999999999,"15min":1.5389999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.962,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":1.9079999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":759738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88600000000000001,"15min":0.88300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.94999999999999996,"15min":0.94299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.65500000000000003}]},{"osd":2,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.131,"15min":1.143},"min":{"1min":0.50700000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5229999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.077,"15min":1.091},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.552,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.63900000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2310000000000001,"15min":1.2230000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.6839999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.131,"15min":1.141},"min":{"1min":0.54900000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5660000000000001,"5min":3.673,"15min":3.673},"last":0.79400000000000004}]},{"osd":4,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3149999999999999,"15min":1.319},"min":{"1min":0.78400000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":2.597},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4830000000000001,"15min":1.4890000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":3.1859999999999999}]},{"osd":5,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.431,"15min":1.4390000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.274,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":2.274},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.506,"15min":1.5149999999999999},"min":{"1min":0.83399999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.9219999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.4370000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4910000000000001,"15min":1.4970000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.9450000000000001,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.9450000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.6619999999999999,"15min":1.6899999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1349999999999998,"5min":3.3519999999999999,"15min":3.3519999999999999},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.556,"15min":1.55},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.6459999999999999,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":2.6459999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.55,"15min":1.554},"min":{"1min":0.879,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.2360000000000002,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":2.2360000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T10:35:47.421 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T10:35:47.421 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T10:35:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.640+0000 7f60e7c32640 1 Processor -- start 2023-10-14T10:35:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.640+0000 7f60e7c32640 1 -- start start 2023-10-14T10:35:47.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.641+0000 7f60e7c32640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60e014dd40 0x7f60e00c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:47.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.641+0000 7f60e7c32640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f60e00c1630 0x7f60e00bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:47.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.641+0000 7f60e7c32640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e006d410 con 0x7f60e00a9050 2023-10-14T10:35:47.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.641+0000 7f60e7c32640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e0151360 con 0x7f60e00c1630 2023-10-14T10:35:47.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.642+0000 7f60e7c32640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e006cdc0 con 0x7f60e014dd40 2023-10-14T10:35:47.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.642+0000 7f60e51cd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f60e00c1630 0x7f60e00bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:47.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.642+0000 7f60e51cd640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f60e00c1630 0x7f60e00bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44298/0 (socket says 172.21.15.8:44298) 2023-10-14T10:35:47.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.642+0000 7f60e51cd640 1 -- 172.21.15.8:0/2602159815 learned_addr learned my addr 172.21.15.8:0/2602159815 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:47.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.642+0000 7f60e59ce640 1 --2- 172.21.15.8:0/2602159815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60e014dd40 0x7f60e00c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:47.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.642+0000 7f60e51cd640 1 -- 172.21.15.8:0/2602159815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60e014dd40 msgr2=0x7f60e00c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.642+0000 7f60e51cd640 1 --2- 172.21.15.8:0/2602159815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60e014dd40 0x7f60e00c10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.642+0000 7f60e51cd640 1 -- 172.21.15.8:0/2602159815 >> v1:172.21.15.92:6789/0 conn(0x7f60e00a9050 legacy=0x7f60e00c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.642+0000 7f60e51cd640 1 -- 172.21.15.8:0/2602159815 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e006d0a0 con 0x7f60e00c1630 2023-10-14T10:35:47.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.642+0000 7f60e59ce640 1 --2- 172.21.15.8:0/2602159815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60e014dd40 0x7f60e00c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:47.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.643+0000 7f60e51cd640 1 --2- 172.21.15.8:0/2602159815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60e00c1630 0x7f60e00bfee0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f60d000aa10 tx=0x7f60d002cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da698e1b263e556 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:47.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.644+0000 7f60e49cc640 1 -- 172.21.15.8:0/2602159815 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d002da50 con 0x7f60e00c1630 2023-10-14T10:35:47.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.644+0000 7f60e49cc640 1 -- 172.21.15.8:0/2602159815 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d002dbb0 con 0x7f60e00c1630 2023-10-14T10:35:47.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.644+0000 7f60e49cc640 1 -- 172.21.15.8:0/2602159815 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0035440 con 0x7f60e00c1630 2023-10-14T10:35:47.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.644+0000 7f60e7c32640 1 -- 172.21.15.8:0/2602159815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60e00c1630 msgr2=0x7f60e00bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:47.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.644+0000 7f60e7c32640 1 --2- 172.21.15.8:0/2602159815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60e00c1630 0x7f60e00bfee0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f60d000aa10 tx=0x7f60d002cca0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.645+0000 7f60e7c32640 1 -- 172.21.15.8:0/2602159815 shutdown_connections 2023-10-14T10:35:47.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.645+0000 7f60e7c32640 1 --2- 172.21.15.8:0/2602159815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60e00c1630 0x7f60e00bfee0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.645+0000 7f60e7c32640 1 --2- 172.21.15.8:0/2602159815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60e014dd40 0x7f60e00c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.645+0000 7f60e7c32640 1 -- 172.21.15.8:0/2602159815 >> 172.21.15.8:0/2602159815 conn(0x7f60e00a74d0 msgr2=0x7f60e00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:47.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.645+0000 7f60e7c32640 1 -- 172.21.15.8:0/2602159815 shutdown_connections 2023-10-14T10:35:47.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.645+0000 7f60e7c32640 1 -- 172.21.15.8:0/2602159815 wait complete. 2023-10-14T10:35:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.646+0000 7f60e7c32640 1 Processor -- start 2023-10-14T10:35:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.647+0000 7f60e7c32640 1 -- start start 2023-10-14T10:35:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e7c32640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60e00a9050 0x7f60e01e84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e7c32640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60e014dd40 0x7f60e0070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e7c32640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60e00711a0 0x7f60e00c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e7c32640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e014ecf0 con 0x7f60e014dd40 2023-10-14T10:35:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e7c32640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00707d0 con 0x7f60e00a9050 2023-10-14T10:35:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e7c32640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01e8df0 con 0x7f60e00711a0 2023-10-14T10:35:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e51cd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60e014dd40 0x7f60e0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e51cd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60e014dd40 0x7f60e0070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44308/0 (socket says 172.21.15.8:44308) 2023-10-14T10:35:47.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e51cd640 1 -- 172.21.15.8:0/272313398 learned_addr learned my addr 172.21.15.8:0/272313398 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:47.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e61cf640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60e00711a0 0x7f60e00c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:47.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e51cd640 1 -- 172.21.15.8:0/272313398 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60e00711a0 msgr2=0x7f60e00c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:47.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e51cd640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60e00711a0 0x7f60e00c3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e59ce640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60e00a9050 0x7f60e01e84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:47.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e51cd640 1 -- 172.21.15.8:0/272313398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60e00a9050 msgr2=0x7f60e01e84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:47.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e51cd640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60e00a9050 0x7f60e01e84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e51cd640 1 -- 172.21.15.8:0/272313398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d000a670 con 0x7f60e014dd40 2023-10-14T10:35:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.648+0000 7f60e61cf640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60e00711a0 0x7f60e00c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.649+0000 7f60e51cd640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60e014dd40 0x7f60e0070c60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f60d0000c00 tx=0x7f60d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.649+0000 7f60d67fc640 1 -- 172.21.15.8:0/272313398 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0044070 con 0x7f60e014dd40 2023-10-14T10:35:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.649+0000 7f60d67fc640 1 -- 172.21.15.8:0/272313398 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d003f5f0 con 0x7f60e014dd40 2023-10-14T10:35:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.649+0000 7f60d67fc640 1 -- 172.21.15.8:0/272313398 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d002da50 con 0x7f60e014dd40 2023-10-14T10:35:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.649+0000 7f60e7c32640 1 -- 172.21.15.8:0/272313398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e014f1e0 con 0x7f60e014dd40 2023-10-14T10:35:47.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.649+0000 7f60e7c32640 1 -- 172.21.15.8:0/272313398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e01500c0 con 0x7f60e014dd40 2023-10-14T10:35:47.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.650+0000 7f60e7c32640 1 -- 172.21.15.8:0/272313398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e014c360 con 0x7f60e014dd40 2023-10-14T10:35:47.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.651+0000 7f60d67fc640 1 -- 172.21.15.8:0/272313398 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f60d003f9a0 con 0x7f60e014dd40 2023-10-14T10:35:47.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.652+0000 7f60d67fc640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f60c406ae70 0x7f60c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:47.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.652+0000 7f60d67fc640 1 -- 172.21.15.8:0/272313398 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f60d00ab610 con 0x7f60e014dd40 2023-10-14T10:35:47.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.653+0000 7f60e59ce640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f60c406ae70 0x7f60c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:47.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.653+0000 7f60e59ce640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f60c406ae70 0x7f60c406d330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00b840 tx=0x7f60dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.657+0000 7f60d67fc640 1 -- 172.21.15.8:0/272313398 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60d00769b0 con 0x7f60e014dd40 2023-10-14T10:35:47.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.846+0000 7f60e7c32640 1 -- 172.21.15.8:0/272313398 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60e0151050 con 0x7f60c406ae70 2023-10-14T10:35:47.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.849+0000 7f60d67fc640 1 -- 172.21.15.8:0/272313398 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48611 (secure 0 0 0) 0x7f60dc00c040 con 0x7f60c406ae70 2023-10-14T10:35:47.852 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:47.853 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T10:35:47.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.852+0000 7f60e7c32640 1 -- 172.21.15.8:0/272313398 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f60c406ae70 msgr2=0x7f60c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:47.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.852+0000 7f60e7c32640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f60c406ae70 0x7f60c406d330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00b840 tx=0x7f60dc008040 comp rx=0 tx=0).stop 2023-10-14T10:35:47.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.852+0000 7f60e7c32640 1 -- 172.21.15.8:0/272313398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60e014dd40 msgr2=0x7f60e0070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:47.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.852+0000 7f60e7c32640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60e014dd40 0x7f60e0070c60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f60d0000c00 tx=0x7f60d00046c0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.852+0000 7f60e7c32640 1 -- 172.21.15.8:0/272313398 shutdown_connections 2023-10-14T10:35:47.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.852+0000 7f60e7c32640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f60c406ae70 0x7f60c406d330 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.852+0000 7f60e7c32640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60e00711a0 0x7f60e00c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.852+0000 7f60e7c32640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60e014dd40 0x7f60e0070c60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.852+0000 7f60e7c32640 1 --2- 172.21.15.8:0/272313398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60e00a9050 0x7f60e01e84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:47.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.852+0000 7f60e7c32640 1 -- 172.21.15.8:0/272313398 >> 172.21.15.8:0/272313398 conn(0x7f60e00a74d0 msgr2=0x7f60e00c25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:47.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.853+0000 7f60e7c32640 1 -- 172.21.15.8:0/272313398 shutdown_connections 2023-10-14T10:35:47.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:47.853+0000 7f60e7c32640 1 -- 172.21.15.8:0/272313398 wait complete. 2023-10-14T10:35:47.874 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-14T10:35:46.675176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":237256,"kb_used_data":4440,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737464,"statfs":{"total":773094113280,"available":772851163136,"internally_reserved":0,"allocated":4546560,"data_stored":2507821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.103576"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T10:35:42.604703+0000","last_change":"2023-10-14T10:33:42.821659+0000","last_active":"2023-10-14T10:35:42.604703+0000","last_peered":"2023-10-14T10:35:42.604703+0000","last_clean":"2023-10-14T10:35:42.604703+0000","last_became_active":"2023-10-14T10:33:42.819441+0000","last_became_peered":"2023-10-14T10:33:42.819441+0000","last_unstale":"2023-10-14T10:35:42.604703+0000","last_undegraded":"2023-10-14T10:35:42.604703+0000","last_fullsized":"2023-10-14T10:35:42.604703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_clean_scrub_stamp":"2023-10-14T10:33:41.468382+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:59.542930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":754163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.1220000000000001}]},{"osd":1,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.179},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.5209999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.3480000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.583}]},{"osd":4,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.244}]},{"osd":5,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.472},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.6379999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.706},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":1.393}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":163795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.82199999999999995}]},{"osd":1,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.417},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.3129999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.395,"5min":3.395,"15min":3.395},"last":1.034},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.88200000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.4650000000000001}]},{"osd":4,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":1.268},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.5389999999999999}]},{"osd":5,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":1.236},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.5}]},{"osd":7,"last update":"Sat Oct 14 10:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.169},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.581}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":1.288},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.589}]},{"osd":1,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":3.1459999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.728},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.1850000000000001}]},{"osd":2,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.117},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.627}]},{"osd":3,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.9910000000000001,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":1.48}]},{"osd":4,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":1.393},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":3.8130000000000002,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.4339999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.536}]},{"osd":7,"last update":"Sat Oct 14 10:34:43 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":1.347}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":163795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.0600000000000001}]},{"osd":1,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.456},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.3819999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.859},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.585}]},{"osd":3,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.232},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.74}]},{"osd":5,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.516},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.6919999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.651},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.774}]},{"osd":7,"last update":"Sat Oct 14 10:34:44 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.821},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":2.028}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":413696,"data_stored":163795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91900000000000004,"15min":0.92800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.292,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93200000000000005,"15min":0.91900000000000004},"min":{"1min":0.63700000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4450000000000001,"5min":1.619,"15min":1.619},"last":0.67400000000000004}]},{"osd":1,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94699999999999995,"15min":0.95499999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.069,"15min":1.0669999999999999},"min":{"1min":0.55400000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6519999999999999,"5min":1.679,"15min":1.679},"last":0.75900000000000001}]},{"osd":2,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.2070000000000001,"15min":1.2170000000000001},"min":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6799999999999999,"5min":1.827,"15min":1.827},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.24,"15min":1.242},"min":{"1min":0.63,"5min":0.628,"15min":0.628},"max":{"1min":1.6870000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.99299999999999999}]},{"osd":4,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.258,"15min":1.2549999999999999},"min":{"1min":0.94399999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3859999999999999,"15min":1.3919999999999999},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":1.6699999999999999,"5min":2.347,"15min":2.347},"last":1.137}]},{"osd":5,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4119999999999999,"15min":1.4199999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.9810000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3660000000000001,"15min":1.3740000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.893,"5min":2.048,"15min":2.048},"last":1.1120000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.5149999999999999,"15min":1.5309999999999999},"min":{"1min":0.85899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.851,"5min":2.504,"15min":2.504},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.478,"5min":1.5409999999999999,"15min":1.5509999999999999},"min":{"1min":1.1000000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":1.8240000000000001,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.292}]},{"osd":7,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.4530000000000001,"15min":1.458},"min":{"1min":1.103,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.0409999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.363},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.581,"15min":1.5900000000000001},"min":{"1min":0.92900000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.984,"5min":2.419,"15min":2.419},"last":1.331}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31604,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.92700000000000005,"15min":0.93000000000000005},"min":{"1min":0.42999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.46,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.64400000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6359999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.101}]},{"osd":1,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.98099999999999998,"15min":0.997},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.425,"5min":1.476,"15min":1.476},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.103,"15min":1.105},"min":{"1min":0.61399999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6439999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.2350000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.1379999999999999,"15min":1.1559999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4630000000000001,"5min":1.794,"15min":1.794},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1839999999999999,"15min":1.1830000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.026}]},{"osd":4,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4139999999999999,"15min":1.417},"min":{"1min":0.92500000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.839,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.331},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.373,"15min":1.399},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.625,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.532}]},{"osd":5,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.478,"15min":1.506},"min":{"1min":0.86599999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.71,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.284},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4730000000000001,"15min":1.4770000000000001},"min":{"1min":0.878,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8879999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.506}]},{"osd":6,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.4950000000000001,"15min":1.5329999999999999},"min":{"1min":0.89000000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6910000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5780000000000001,"15min":1.6080000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.885,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.4770000000000001}]},{"osd":7,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.5289999999999999,"15min":1.5529999999999999},"min":{"1min":0.81399999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.9370000000000001,"5min":2.601,"15min":2.601},"last":1.7929999999999999},{"interface":"front","average":{"1min":1.486,"5min":1.641,"15min":1.667},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.9490000000000001,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.589}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":163795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.92500000000000004,"15min":0.94099999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4019999999999999,"5min":1.55,"15min":1.55},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.95799999999999996,"15min":0.94399999999999995},"min":{"1min":0.48399999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.7569999999999999,"5min":2.258,"15min":2.258},"last":1.5569999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93799999999999994,"15min":0.93600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.387,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.998},{"interface":"front","average":{"1min":1.046,"5min":1.1220000000000001,"15min":1.135},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.556,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.4830000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.135,"15min":1.125},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.851,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.8109999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.1040000000000001,"15min":1.093},"min":{"1min":0.52600000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.754,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.726}]},{"osd":4,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.83699999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.254},{"interface":"front","average":{"1min":1.304,"5min":1.345,"15min":1.3520000000000001},"min":{"1min":0.748,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.0680000000000001,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":2.0680000000000001}]},{"osd":5,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4750000000000001,"15min":1.4930000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.9139999999999999,"5min":4.1150000000000002,"15min":4.1150000000000002},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.6259999999999999,"15min":1.6459999999999999},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.004,"5min":4.242,"15min":4.242},"last":1.968}]},{"osd":6,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4670000000000001,"15min":1.4630000000000001},"min":{"1min":0.92400000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0510000000000002,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":2.0299999999999998},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.4870000000000001,"15min":1.504},"min":{"1min":0.89200000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.724,"5min":3.02,"15min":3.02},"last":1.615}]},{"osd":7,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5469999999999999,"15min":1.5629999999999999},"min":{"1min":0.79000000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.9490000000000001,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.8540000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.5289999999999999,"15min":1.5389999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.962,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":1.9079999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":759738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88600000000000001,"15min":0.88300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.94999999999999996,"15min":0.94299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.65500000000000003}]},{"osd":2,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.131,"15min":1.143},"min":{"1min":0.50700000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5229999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.077,"15min":1.091},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.552,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.63900000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2310000000000001,"15min":1.2230000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.6839999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.131,"15min":1.141},"min":{"1min":0.54900000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5660000000000001,"5min":3.673,"15min":3.673},"last":0.79400000000000004}]},{"osd":4,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3149999999999999,"15min":1.319},"min":{"1min":0.78400000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":2.597},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4830000000000001,"15min":1.4890000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":3.1859999999999999}]},{"osd":5,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.431,"15min":1.4390000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.274,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":2.274},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.506,"15min":1.5149999999999999},"min":{"1min":0.83399999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.9219999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.4370000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4910000000000001,"15min":1.4970000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.9450000000000001,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.9450000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.6619999999999999,"15min":1.6899999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1349999999999998,"5min":3.3519999999999999,"15min":3.3519999999999999},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.556,"15min":1.55},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.6459999999999999,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":2.6459999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.55,"15min":1.554},"min":{"1min":0.879,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.2360000000000002,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":2.2360000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T10:35:47.876 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T10:35:48.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.102+0000 7f0ee4c02640 1 Processor -- start 2023-10-14T10:35:48.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.102+0000 7f0ee4c02640 1 -- start start 2023-10-14T10:35:48.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.103+0000 7f0ee4c02640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee00c57a0 0x7f0ee0152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.103+0000 7f0ee4c02640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee0152ea0 con 0x7f0ee0071ff0 2023-10-14T10:35:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.103+0000 7f0ee4c02640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee0151ea0 con 0x7f0ee013b260 2023-10-14T10:35:48.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.103+0000 7f0ee4c02640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0152540 con 0x7f0ee00c57a0 2023-10-14T10:35:48.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.104+0000 7f0eddd9b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0ee0071ff0 0x7f0ee006d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43540/0 (socket says 172.21.15.8:43540) 2023-10-14T10:35:48.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.104+0000 7f0eddd9b640 1 -- 172.21.15.8:0/1997582940 learned_addr learned my addr 172.21.15.8:0/1997582940 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:48.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.104+0000 7f0eded9d640 1 --2- 172.21.15.8:0/1997582940 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee00c57a0 0x7f0ee0152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.104+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330861157 0 0) 0x7f0ec8001490 con 0x7f0ee0071ff0 2023-10-14T10:35:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.104+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ecc003520 con 0x7f0ee0071ff0 2023-10-14T10:35:48.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 81228417 0 0) 0x7f0ecc003520 con 0x7f0ee0071ff0 2023-10-14T10:35:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee00c57a0 msgr2=0x7f0ee0152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 --2- 172.21.15.8:0/1997582940 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee00c57a0 0x7f0ee0152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 >> v1:172.21.15.92:6789/0 conn(0x7f0ee013b260 legacy=0x7f0ee00c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:48.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00c5d80 con 0x7f0ee0071ff0 2023-10-14T10:35:48.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f0ec8001b80 con 0x7f0ee0071ff0 2023-10-14T10:35:48.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 >> v1:172.21.15.8:6789/0 conn(0x7f0ee0071ff0 legacy=0x7f0ee006d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:48.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 --2- 172.21.15.8:0/1997582940 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee00c57a0 0x7f0ecc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:48.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 --2- 172.21.15.8:0/1997582940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc003f20 0x7f0ecc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:48.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 --2- 172.21.15.8:0/1997582940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ecc004d00 0x7f0ecc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:48.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0152540 con 0x7f0ecc003f20 2023-10-14T10:35:48.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc00bb10 con 0x7f0ecc004d00 2023-10-14T10:35:48.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc00bcd0 con 0x7f0ee00c57a0 2023-10-14T10:35:48.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0eddd9b640 1 --2- 172.21.15.8:0/1997582940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc003f20 0x7f0ecc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:48.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.105+0000 7f0ede59c640 1 --2- 172.21.15.8:0/1997582940 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee00c57a0 0x7f0ecc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:48.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.106+0000 7f0eded9d640 1 --2- 172.21.15.8:0/1997582940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ecc004d00 0x7f0ecc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:48.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.106+0000 7f0eddd9b640 1 -- 172.21.15.8:0/1997582940 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee00c57a0 msgr2=0x7f0ecc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:48.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.106+0000 7f0eddd9b640 1 --2- 172.21.15.8:0/1997582940 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee00c57a0 0x7f0ecc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:48.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.106+0000 7f0eddd9b640 1 -- 172.21.15.8:0/1997582940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ecc004d00 msgr2=0x7f0ecc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:48.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.106+0000 7f0eddd9b640 1 --2- 172.21.15.8:0/1997582940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ecc004d00 0x7f0ecc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:48.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.106+0000 7f0eddd9b640 1 -- 172.21.15.8:0/1997582940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc003520 con 0x7f0ecc003f20 2023-10-14T10:35:48.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.107+0000 7f0eddd9b640 1 --2- 172.21.15.8:0/1997582940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc003f20 0x7f0ecc0047c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800a830 tx=0x7f0ecc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58138c0f767e1bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:48.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.108+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8034630 con 0x7f0ecc003f20 2023-10-14T10:35:48.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.108+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec802f070 con 0x7f0ecc003f20 2023-10-14T10:35:48.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.108+0000 7f0edd59a640 1 -- 172.21.15.8:0/1997582940 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec80349f0 con 0x7f0ecc003f20 2023-10-14T10:35:48.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.108+0000 7f0ee4c02640 1 -- 172.21.15.8:0/1997582940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc003f20 msgr2=0x7f0ecc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:48.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.108+0000 7f0ee4c02640 1 --2- 172.21.15.8:0/1997582940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc003f20 0x7f0ecc0047c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800a830 tx=0x7f0ecc0057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:48.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.108+0000 7f0eded9d640 1 -- 172.21.15.8:0/1997582940 reap_dead start 2023-10-14T10:35:48.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.108+0000 7f0ee4c02640 1 -- 172.21.15.8:0/1997582940 shutdown_connections 2023-10-14T10:35:48.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.108+0000 7f0ee4c02640 1 -- 172.21.15.8:0/1997582940 >> 172.21.15.8:0/1997582940 conn(0x7f0ee00a74d0 msgr2=0x7f0ee00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:48.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.108+0000 7f0ee4c02640 1 -- 172.21.15.8:0/1997582940 shutdown_connections 2023-10-14T10:35:48.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.108+0000 7f0ee4c02640 1 -- 172.21.15.8:0/1997582940 wait complete. 2023-10-14T10:35:48.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.110+0000 7f0ee4c02640 1 Processor -- start 2023-10-14T10:35:48.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.110+0000 7f0ee4c02640 1 -- start start 2023-10-14T10:35:48.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.111+0000 7f0ee4c02640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc003f20 0x7f0ee0154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:48.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.111+0000 7f0ee4c02640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ee014c520 0x7f0ee014cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:48.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.111+0000 7f0ee4c02640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee0135ec0 0x7f0ee0136370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:48.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.111+0000 7f0ee4c02640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0154ab0 con 0x7f0ecc003f20 2023-10-14T10:35:48.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.111+0000 7f0ee4c02640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0156140 con 0x7f0ee014c520 2023-10-14T10:35:48.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.111+0000 7f0ee4c02640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0155b80 con 0x7f0ee0135ec0 2023-10-14T10:35:48.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.112+0000 7f0ede59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc003f20 0x7f0ee0154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:48.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.112+0000 7f0ede59c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc003f20 0x7f0ee0154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44320/0 (socket says 172.21.15.8:44320) 2023-10-14T10:35:48.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.112+0000 7f0ede59c640 1 -- 172.21.15.8:0/931897321 learned_addr learned my addr 172.21.15.8:0/931897321 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:48.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.112+0000 7f0eded9d640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee0135ec0 0x7f0ee0136370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:48.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.112+0000 7f0eddd9b640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ee014c520 0x7f0ee014cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:48.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.112+0000 7f0ede59c640 1 -- 172.21.15.8:0/931897321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee0135ec0 msgr2=0x7f0ee0136370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:48.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.112+0000 7f0ede59c640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee0135ec0 0x7f0ee0136370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:48.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.112+0000 7f0ede59c640 1 -- 172.21.15.8:0/931897321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ee014c520 msgr2=0x7f0ee014cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:48.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.112+0000 7f0ede59c640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ee014c520 0x7f0ee014cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:48.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.112+0000 7f0ede59c640 1 -- 172.21.15.8:0/931897321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0155e60 con 0x7f0ecc003f20 2023-10-14T10:35:48.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.112+0000 7f0eded9d640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee0135ec0 0x7f0ee0136370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:48.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.112+0000 7f0ede59c640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc003f20 0x7f0ee0154570 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000e490 tx=0x7f0ed000e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:48.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.113+0000 7f0ed6ffd640 1 -- 172.21.15.8:0/931897321 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00052e0 con 0x7f0ecc003f20 2023-10-14T10:35:48.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.113+0000 7f0ed6ffd640 1 -- 172.21.15.8:0/931897321 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed0005440 con 0x7f0ecc003f20 2023-10-14T10:35:48.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.113+0000 7f0ed6ffd640 1 -- 172.21.15.8:0/931897321 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0003830 con 0x7f0ecc003f20 2023-10-14T10:35:48.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.113+0000 7f0ee4c02640 1 -- 172.21.15.8:0/931897321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee0153d70 con 0x7f0ecc003f20 2023-10-14T10:35:48.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.113+0000 7f0ee4c02640 1 -- 172.21.15.8:0/931897321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee014d4f0 con 0x7f0ecc003f20 2023-10-14T10:35:48.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.114+0000 7f0ee4c02640 1 -- 172.21.15.8:0/931897321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee0073b50 con 0x7f0ecc003f20 2023-10-14T10:35:48.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.115+0000 7f0ed6ffd640 1 -- 172.21.15.8:0/931897321 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0ed0003990 con 0x7f0ecc003f20 2023-10-14T10:35:48.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.116+0000 7f0ed6ffd640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0ec006aea0 0x7f0ec006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:48.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.116+0000 7f0ed6ffd640 1 -- 172.21.15.8:0/931897321 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0ed00890a0 con 0x7f0ecc003f20 2023-10-14T10:35:48.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.116+0000 7f0eddd9b640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0ec006aea0 0x7f0ec006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:48.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.117+0000 7f0eddd9b640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0ec006aea0 0x7f0ec006d360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800a830 tx=0x7f0ec802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:48.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.121+0000 7f0ed6ffd640 1 -- 172.21.15.8:0/931897321 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ed0054500 con 0x7f0ecc003f20 2023-10-14T10:35:48.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.316+0000 7f0ee4c02640 1 -- 172.21.15.8:0/931897321 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ee006d450 con 0x7f0ecc003f20 2023-10-14T10:35:48.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.318+0000 7f0ed6ffd640 1 -- 172.21.15.8:0/931897321 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f0ed0057b20 con 0x7f0ecc003f20 2023-10-14T10:35:48.321 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:48.321 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":37,"fsid":"452b10b4-f8ad-4e99-85d0-4d157f344356","created":"2023-10-14T10:33:27.479428+0000","modified":"2023-10-14T10:35:43.585812+0000","last_up_change":"2023-10-14T10:33:39.460010+0000","last_in_change":"2023-10-14T10:33:30.899760+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T10:33:40.706361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7dd633d9-7a74-4616-ad34-6c2f9da358ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6809","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6811","nonce":2227649583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6815","nonce":2227649583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6826","nonce":2227649583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2227649583},{"type":"v1","addr":"172.21.15.8:6820","nonce":2227649583}]},"public_addr":"172.21.15.8:6811/2227649583","cluster_addr":"172.21.15.8:6815/2227649583","heartbeat_back_addr":"172.21.15.8:6826/2227649583","heartbeat_front_addr":"172.21.15.8:6820/2227649583","state":["exists","up"]},{"osd":1,"uuid":"2d91f3ae-0e58-4009-8491-1574ba15fbab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6801","nonce":1766897298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6803","nonce":1766897298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6807","nonce":1766897298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1766897298},{"type":"v1","addr":"172.21.15.8:6805","nonce":1766897298}]},"public_addr":"172.21.15.8:6801/1766897298","cluster_addr":"172.21.15.8:6803/1766897298","heartbeat_back_addr":"172.21.15.8:6807/1766897298","heartbeat_front_addr":"172.21.15.8:6805/1766897298","state":["exists","up"]},{"osd":2,"uuid":"c7c6a1ec-a582-4bf3-80af-a2e8a9208882","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6810","nonce":430494339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6814","nonce":430494339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6827","nonce":430494339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":430494339},{"type":"v1","addr":"172.21.15.8:6821","nonce":430494339}]},"public_addr":"172.21.15.8:6810/430494339","cluster_addr":"172.21.15.8:6814/430494339","heartbeat_back_addr":"172.21.15.8:6827/430494339","heartbeat_front_addr":"172.21.15.8:6821/430494339","state":["exists","up"]},{"osd":3,"uuid":"d1e58121-1911-4043-a181-bd757b9e23c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6819","nonce":3324744175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6825","nonce":3324744175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6831","nonce":3324744175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3324744175},{"type":"v1","addr":"172.21.15.8:6829","nonce":3324744175}]},"public_addr":"172.21.15.8:6819/3324744175","cluster_addr":"172.21.15.8:6825/3324744175","heartbeat_back_addr":"172.21.15.8:6831/3324744175","heartbeat_front_addr":"172.21.15.8:6829/3324744175","state":["exists","up"]},{"osd":4,"uuid":"ae9e8f88-3012-4c8b-9e4f-8efbb98a84a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6801","nonce":90605776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6803","nonce":90605776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6807","nonce":90605776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":90605776},{"type":"v1","addr":"172.21.15.92:6805","nonce":90605776}]},"public_addr":"172.21.15.92:6801/90605776","cluster_addr":"172.21.15.92:6803/90605776","heartbeat_back_addr":"172.21.15.92:6807/90605776","heartbeat_front_addr":"172.21.15.92:6805/90605776","state":["exists","up"]},{"osd":5,"uuid":"b960328f-c14f-4f72-9c67-851a03aa12c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6811","nonce":995873713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6816","nonce":995873713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6823","nonce":995873713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":995873713},{"type":"v1","addr":"172.21.15.92:6821","nonce":995873713}]},"public_addr":"172.21.15.92:6811/995873713","cluster_addr":"172.21.15.92:6816/995873713","heartbeat_back_addr":"172.21.15.92:6823/995873713","heartbeat_front_addr":"172.21.15.92:6821/995873713","state":["exists","up"]},{"osd":6,"uuid":"3c3cff14-004c-4aa1-b9ce-240f0d1f78ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6810","nonce":1491462275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6814","nonce":1491462275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6819","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6820","nonce":1491462275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6815","nonce":1491462275},{"type":"v1","addr":"172.21.15.92:6817","nonce":1491462275}]},"public_addr":"172.21.15.92:6810/1491462275","cluster_addr":"172.21.15.92:6814/1491462275","heartbeat_back_addr":"172.21.15.92:6820/1491462275","heartbeat_front_addr":"172.21.15.92:6817/1491462275","state":["exists","up"]},{"osd":7,"uuid":"e7fd4171-2934-4a23-a5bb-2eea9f135d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6825","nonce":3211925769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6827","nonce":3211925769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6831","nonce":3211925769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3211925769},{"type":"v1","addr":"172.21.15.92:6829","nonce":3211925769}]},"public_addr":"172.21.15.92:6825/3211925769","cluster_addr":"172.21.15.92:6827/3211925769","heartbeat_back_addr":"172.21.15.92:6831/3211925769","heartbeat_front_addr":"172.21.15.92:6829/3211925769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.296076+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.523838+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.517465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.348734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.461820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.204613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.303302+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T10:33:36.321854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6837/799022047":"2023-10-15T10:35:40.565795+0000","172.21.15.8:6836/799022047":"2023-10-15T10:35:40.565795+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T10:35:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.321+0000 7f0ee4c02640 1 -- 172.21.15.8:0/931897321 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0ec006aea0 msgr2=0x7f0ec006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.321+0000 7f0ee4c02640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0ec006aea0 0x7f0ec006d360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800a830 tx=0x7f0ec802f000 comp rx=0 tx=0).stop 2023-10-14T10:35:48.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.321+0000 7f0ee4c02640 1 -- 172.21.15.8:0/931897321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc003f20 msgr2=0x7f0ee0154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.321+0000 7f0ee4c02640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc003f20 0x7f0ee0154570 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000e490 tx=0x7f0ed000e950 comp rx=0 tx=0).stop 2023-10-14T10:35:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.321+0000 7f0ee4c02640 1 -- 172.21.15.8:0/931897321 shutdown_connections 2023-10-14T10:35:48.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.321+0000 7f0ee4c02640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f0ec006aea0 0x7f0ec006d360 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:48.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.321+0000 7f0ee4c02640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ee0135ec0 0x7f0ee0136370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:48.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.321+0000 7f0ee4c02640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ee014c520 0x7f0ee014cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:48.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.321+0000 7f0ee4c02640 1 --2- 172.21.15.8:0/931897321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc003f20 0x7f0ee0154570 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:48.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.321+0000 7f0ee4c02640 1 -- 172.21.15.8:0/931897321 >> 172.21.15.8:0/931897321 conn(0x7f0ee00a74d0 msgr2=0x7f0ee00c0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:48.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.321+0000 7f0ee4c02640 1 -- 172.21.15.8:0/931897321 shutdown_connections 2023-10-14T10:35:48.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:48.321+0000 7f0ee4c02640 1 -- 172.21.15.8:0/931897321 wait complete. 2023-10-14T10:35:49.343 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T10:35:49.344 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T10:35:49.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.579+0000 7efeea16e640 1 Processor -- start 2023-10-14T10:35:49.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.579+0000 7efeea16e640 1 -- start start 2023-10-14T10:35:49.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.580+0000 7efeea16e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efee41515a0 0x7efee40c7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.580+0000 7efeea16e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efee41540b0 0x7efee40c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.580+0000 7efeea16e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee406be80 con 0x7efee406c310 2023-10-14T10:35:49.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.580+0000 7efeea16e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee40c5320 con 0x7efee41540b0 2023-10-14T10:35:49.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.580+0000 7efeea16e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee40c6b40 con 0x7efee41515a0 2023-10-14T10:35:49.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.581+0000 7efee3fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7efee406c310 0x7efee40c41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43556/0 (socket says 172.21.15.8:43556) 2023-10-14T10:35:49.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.581+0000 7efee3fff640 1 -- 172.21.15.8:0/1732508089 learned_addr learned my addr 172.21.15.8:0/1732508089 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:49.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.581+0000 7efee2ffd640 1 --2- 172.21.15.8:0/1732508089 >> v2:172.21.15.8:3300/0 conn(0x7efee41540b0 0x7efee40c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.581+0000 7efee37fe640 1 --2- 172.21.15.8:0/1732508089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efee41515a0 0x7efee40c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.581+0000 7efee27fc640 1 -- 172.21.15.8:0/1732508089 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203719068 0 0) 0x7efee406be80 con 0x7efee406c310 2023-10-14T10:35:49.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.581+0000 7efee2ffd640 1 -- 172.21.15.8:0/1732508089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efee41515a0 msgr2=0x7efee40c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:49.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.581+0000 7efee2ffd640 1 --2- 172.21.15.8:0/1732508089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efee41515a0 0x7efee40c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:49.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.581+0000 7efee2ffd640 1 -- 172.21.15.8:0/1732508089 >> v1:172.21.15.8:6789/0 conn(0x7efee406c310 legacy=0x7efee40c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:49.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.581+0000 7efee2ffd640 1 -- 172.21.15.8:0/1732508089 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee40c6e20 con 0x7efee41540b0 2023-10-14T10:35:49.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.582+0000 7efee2ffd640 1 --2- 172.21.15.8:0/1732508089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efee41540b0 0x7efee40c6240 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7efecc0097a0 tx=0x7efecc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6145284683cf0c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:49.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.583+0000 7efee27fc640 1 -- 172.21.15.8:0/1732508089 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc031780 con 0x7efee41540b0 2023-10-14T10:35:49.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.583+0000 7efee27fc640 1 -- 172.21.15.8:0/1732508089 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc0318e0 con 0x7efee41540b0 2023-10-14T10:35:49.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.583+0000 7efee27fc640 1 -- 172.21.15.8:0/1732508089 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc031c70 con 0x7efee41540b0 2023-10-14T10:35:49.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.583+0000 7efeea16e640 1 -- 172.21.15.8:0/1732508089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efee41540b0 msgr2=0x7efee40c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:49.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.583+0000 7efeea16e640 1 --2- 172.21.15.8:0/1732508089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efee41540b0 0x7efee40c6240 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7efecc0097a0 tx=0x7efecc02b820 comp rx=0 tx=0).stop 2023-10-14T10:35:49.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.584+0000 7efeea16e640 1 -- 172.21.15.8:0/1732508089 shutdown_connections 2023-10-14T10:35:49.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.584+0000 7efeea16e640 1 --2- 172.21.15.8:0/1732508089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efee41540b0 0x7efee40c6240 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:49.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.584+0000 7efeea16e640 1 --2- 172.21.15.8:0/1732508089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efee41515a0 0x7efee40c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:49.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.584+0000 7efeea16e640 1 -- 172.21.15.8:0/1732508089 >> 172.21.15.8:0/1732508089 conn(0x7efee40ab3c0 msgr2=0x7efee40ab7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:49.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.584+0000 7efeea16e640 1 -- 172.21.15.8:0/1732508089 shutdown_connections 2023-10-14T10:35:49.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.584+0000 7efeea16e640 1 -- 172.21.15.8:0/1732508089 wait complete. 2023-10-14T10:35:49.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.585+0000 7efeea16e640 1 Processor -- start 2023-10-14T10:35:49.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.586+0000 7efeea16e640 1 -- start start 2023-10-14T10:35:49.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.586+0000 7efeea16e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efee406c310 0x7efee40c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.586+0000 7efeea16e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efee41515a0 0x7efee41ec970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.586+0000 7efeea16e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efee41540b0 0x7efee4147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.586+0000 7efeea16e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee40bf780 con 0x7efee41540b0 2023-10-14T10:35:49.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.586+0000 7efeea16e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee40bfd40 con 0x7efee406c310 2023-10-14T10:35:49.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.587+0000 7efeea16e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee40c1400 con 0x7efee41515a0 2023-10-14T10:35:49.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.587+0000 7efee3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efee41540b0 0x7efee4147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.587+0000 7efee3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efee41540b0 0x7efee4147e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44344/0 (socket says 172.21.15.8:44344) 2023-10-14T10:35:49.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.587+0000 7efee3fff640 1 -- 172.21.15.8:0/1084713428 learned_addr learned my addr 172.21.15.8:0/1084713428 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:49.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.587+0000 7efee37fe640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efee406c310 0x7efee40c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.587+0000 7efee2ffd640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efee41515a0 0x7efee41ec970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.587+0000 7efee3fff640 1 -- 172.21.15.8:0/1084713428 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efee41515a0 msgr2=0x7efee41ec970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:49.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.587+0000 7efee3fff640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efee41515a0 0x7efee41ec970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:49.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.587+0000 7efee3fff640 1 -- 172.21.15.8:0/1084713428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efee406c310 msgr2=0x7efee40c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:49.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.587+0000 7efee3fff640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efee406c310 0x7efee40c0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:49.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.587+0000 7efee3fff640 1 -- 172.21.15.8:0/1084713428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc009400 con 0x7efee41540b0 2023-10-14T10:35:49.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.587+0000 7efee2ffd640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efee41515a0 0x7efee41ec970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:49.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.588+0000 7efee3fff640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efee41540b0 0x7efee4147e90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7efedc00c450 tx=0x7efedc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:49.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.588+0000 7efedbfff640 1 -- 172.21.15.8:0/1084713428 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc0074e0 con 0x7efee41540b0 2023-10-14T10:35:49.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.588+0000 7efedbfff640 1 -- 172.21.15.8:0/1084713428 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc007660 con 0x7efee41540b0 2023-10-14T10:35:49.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.588+0000 7efeea16e640 1 -- 172.21.15.8:0/1084713428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee40bffe0 con 0x7efee41540b0 2023-10-14T10:35:49.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.588+0000 7efedbfff640 1 -- 172.21.15.8:0/1084713428 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc004a20 con 0x7efee41540b0 2023-10-14T10:35:49.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.588+0000 7efeea16e640 1 -- 172.21.15.8:0/1084713428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee41eceb0 con 0x7efee41540b0 2023-10-14T10:35:49.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.589+0000 7efeea16e640 1 -- 172.21.15.8:0/1084713428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efee406bb10 con 0x7efee41540b0 2023-10-14T10:35:49.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.591+0000 7efedbfff640 1 -- 172.21.15.8:0/1084713428 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efedc004b80 con 0x7efee41540b0 2023-10-14T10:35:49.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.591+0000 7efedbfff640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efec406ae70 0x7efec406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.592+0000 7efedbfff640 1 -- 172.21.15.8:0/1084713428 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efedc088790 con 0x7efee41540b0 2023-10-14T10:35:49.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.592+0000 7efee37fe640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efec406ae70 0x7efec406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.592+0000 7efedbfff640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] conn(0x7efec4070cd0 0x7efec40730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.592+0000 7efedbfff640 1 -- 172.21.15.8:0/1084713428 --> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efec40737a0 con 0x7efec4070cd0 2023-10-14T10:35:49.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.592+0000 7efedbfff640 1 -- 172.21.15.8:0/1084713428 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7efedc08ad70 con 0x7efee41540b0 2023-10-14T10:35:49.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.592+0000 7efee2ffd640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] conn(0x7efec4070cd0 0x7efec40730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.593+0000 7efee37fe640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efec406ae70 0x7efec406d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efed40074a0 tx=0x7efed400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:49.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.593+0000 7efee2ffd640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] conn(0x7efec4070cd0 0x7efec40730f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:49.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.594+0000 7efedbfff640 1 -- 172.21.15.8:0/1084713428 <== osd.0 v2:172.21.15.8:6809/2227649583 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7efec40737a0 con 0x7efec4070cd0 2023-10-14T10:35:49.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.608+0000 7efeea16e640 1 -- 172.21.15.8:0/1084713428 --> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efee40c7100 con 0x7efec4070cd0 2023-10-14T10:35:49.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.608+0000 7efedbfff640 1 -- 172.21.15.8:0/1084713428 <== osd.0 v2:172.21.15.8:6809/2227649583 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efecc031ad0 con 0x7efec4070cd0 2023-10-14T10:35:49.611 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T10:35:49.612 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:49.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.609+0000 7efeea16e640 1 -- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] conn(0x7efec4070cd0 msgr2=0x7efec40730f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:49.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.609+0000 7efeea16e640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:6809/2227649583,v1:172.21.15.8:6811/2227649583] conn(0x7efec4070cd0 0x7efec40730f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:49.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.609+0000 7efeea16e640 1 -- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efec406ae70 msgr2=0x7efec406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:49.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.609+0000 7efeea16e640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7efec406ae70 0x7efec406d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efed40074a0 tx=0x7efed400b040 comp rx=0 tx=0).stop 2023-10-14T10:35:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.609+0000 7efeea16e640 1 -- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efee41540b0 msgr2=0x7efee4147e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.609+0000 7efeea16e640 1 --2- 172.21.15.8:0/1084713428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efee41540b0 0x7efee4147e90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7efedc00c450 tx=0x7efedc00c910 comp rx=0 tx=0).stop 2023-10-14T10:35:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.609+0000 7efee3fff640 1 -- 172.21.15.8:0/1084713428 reap_dead start 2023-10-14T10:35:49.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.609+0000 7efeea16e640 1 -- 172.21.15.8:0/1084713428 shutdown_connections 2023-10-14T10:35:49.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.609+0000 7efeea16e640 1 -- 172.21.15.8:0/1084713428 >> 172.21.15.8:0/1084713428 conn(0x7efee40ab3c0 msgr2=0x7efee40c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:49.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.610+0000 7efeea16e640 1 -- 172.21.15.8:0/1084713428 shutdown_connections 2023-10-14T10:35:49.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.610+0000 7efeea16e640 1 -- 172.21.15.8:0/1084713428 wait complete. 2023-10-14T10:35:49.629 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-14T10:35:49.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.843+0000 7face1239640 1 Processor -- start 2023-10-14T10:35:49.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.844+0000 7face1239640 1 -- start start 2023-10-14T10:35:49.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.845+0000 7face1239640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7facdc14e0f0 0x7facdc0719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.845+0000 7face1239640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc157640 0x7facdc157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.845+0000 7face1239640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facdc154060 con 0x7facdc0ba150 2023-10-14T10:35:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.845+0000 7face1239640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc14e4d0 con 0x7facdc14e0f0 2023-10-14T10:35:49.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.845+0000 7face1239640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc154ce0 con 0x7facdc157640 2023-10-14T10:35:49.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.846+0000 7facdbfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7facdc14e0f0 0x7facdc0719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.846+0000 7facdbfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7facdc14e0f0 0x7facdc0719f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44356/0 (socket says 172.21.15.8:44356) 2023-10-14T10:35:49.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.846+0000 7facdbfff640 1 -- 172.21.15.8:0/3587750772 learned_addr learned my addr 172.21.15.8:0/3587750772 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.846+0000 7face0a38640 1 --2- 172.21.15.8:0/3587750772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc157640 0x7facdc157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.846+0000 7facdbfff640 1 -- 172.21.15.8:0/3587750772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc157640 msgr2=0x7facdc157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.846+0000 7facdbfff640 1 --2- 172.21.15.8:0/3587750772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc157640 0x7facdc157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:49.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.846+0000 7facdbfff640 1 -- 172.21.15.8:0/3587750772 >> v1:172.21.15.92:6789/0 conn(0x7facdc0ba150 legacy=0x7facdc0c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:49.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.846+0000 7facdbfff640 1 -- 172.21.15.8:0/3587750772 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc154340 con 0x7facdc14e0f0 2023-10-14T10:35:49.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.847+0000 7facdbfff640 1 --2- 172.21.15.8:0/3587750772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc14e0f0 0x7facdc0719f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faccc009870 tx=0x7faccc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17caab7c9656a18b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.847+0000 7facdb7fe640 1 -- 172.21.15.8:0/3587750772 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc031640 con 0x7facdc14e0f0 2023-10-14T10:35:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.848+0000 7facdb7fe640 1 -- 172.21.15.8:0/3587750772 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc0317a0 con 0x7facdc14e0f0 2023-10-14T10:35:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.848+0000 7facdb7fe640 1 -- 172.21.15.8:0/3587750772 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc031b30 con 0x7facdc14e0f0 2023-10-14T10:35:49.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.848+0000 7face1239640 1 -- 172.21.15.8:0/3587750772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc14e0f0 msgr2=0x7facdc0719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:49.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.848+0000 7face1239640 1 --2- 172.21.15.8:0/3587750772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc14e0f0 0x7facdc0719f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faccc009870 tx=0x7faccc02b8f0 comp rx=0 tx=0).stop 2023-10-14T10:35:49.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.848+0000 7face1239640 1 -- 172.21.15.8:0/3587750772 shutdown_connections 2023-10-14T10:35:49.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.848+0000 7face1239640 1 --2- 172.21.15.8:0/3587750772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc157640 0x7facdc157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:49.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.848+0000 7face1239640 1 --2- 172.21.15.8:0/3587750772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc14e0f0 0x7facdc0719f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:49.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.848+0000 7face1239640 1 -- 172.21.15.8:0/3587750772 >> 172.21.15.8:0/3587750772 conn(0x7facdc06a200 msgr2=0x7facdc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:49.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.848+0000 7face1239640 1 -- 172.21.15.8:0/3587750772 shutdown_connections 2023-10-14T10:35:49.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.848+0000 7face1239640 1 -- 172.21.15.8:0/3587750772 wait complete. 2023-10-14T10:35:49.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.850+0000 7face1239640 1 Processor -- start 2023-10-14T10:35:49.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.850+0000 7face1239640 1 -- start start 2023-10-14T10:35:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.851+0000 7face1239640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc0ba150 0x7facdc14ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.851+0000 7face1239640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc14e0f0 0x7facdc0a86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.851+0000 7face1239640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc157640 0x7facdc1e8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.851+0000 7face1239640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc14fed0 con 0x7facdc14e0f0 2023-10-14T10:35:49.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.851+0000 7face1239640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc151040 con 0x7facdc0ba150 2023-10-14T10:35:49.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.851+0000 7face1239640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc14f030 con 0x7facdc157640 2023-10-14T10:35:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.851+0000 7facd3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc14e0f0 0x7facdc0a86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.851+0000 7facd3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc14e0f0 0x7facdc0a86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44368/0 (socket says 172.21.15.8:44368) 2023-10-14T10:35:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.851+0000 7facd3fff640 1 -- 172.21.15.8:0/2024763647 learned_addr learned my addr 172.21.15.8:0/2024763647 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.852+0000 7facdbfff640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc0ba150 0x7facdc14ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.852+0000 7face0a38640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc157640 0x7facdc1e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.852+0000 7facd3fff640 1 -- 172.21.15.8:0/2024763647 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc157640 msgr2=0x7facdc1e8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.852+0000 7facd3fff640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc157640 0x7facdc1e8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:49.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.852+0000 7facd3fff640 1 -- 172.21.15.8:0/2024763647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc0ba150 msgr2=0x7facdc14ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:49.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.852+0000 7facd3fff640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc0ba150 0x7facdc14ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:49.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.852+0000 7facd3fff640 1 -- 172.21.15.8:0/2024763647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc0094d0 con 0x7facdc14e0f0 2023-10-14T10:35:49.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.852+0000 7facd3fff640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc14e0f0 0x7facdc0a86d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7facc400b3f0 tx=0x7facc400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:49.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.853+0000 7facd97fa640 1 -- 172.21.15.8:0/2024763647 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc4011830 con 0x7facdc14e0f0 2023-10-14T10:35:49.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.853+0000 7facd97fa640 1 -- 172.21.15.8:0/2024763647 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc4011990 con 0x7facdc14e0f0 2023-10-14T10:35:49.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.853+0000 7facd97fa640 1 -- 172.21.15.8:0/2024763647 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc4011d40 con 0x7facdc14e0f0 2023-10-14T10:35:49.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.853+0000 7face1239640 1 -- 172.21.15.8:0/2024763647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc14f310 con 0x7facdc14e0f0 2023-10-14T10:35:49.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.853+0000 7face1239640 1 -- 172.21.15.8:0/2024763647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc150cd0 con 0x7facdc14e0f0 2023-10-14T10:35:49.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.854+0000 7face1239640 1 -- 172.21.15.8:0/2024763647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc1511b0 con 0x7facdc14e0f0 2023-10-14T10:35:49.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.855+0000 7facd97fa640 1 -- 172.21.15.8:0/2024763647 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7facc401a400 con 0x7facdc14e0f0 2023-10-14T10:35:49.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.856+0000 7facd97fa640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7facbc06aea0 0x7facbc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:49.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.856+0000 7facd97fa640 1 -- 172.21.15.8:0/2024763647 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7facc40891a0 con 0x7facdc14e0f0 2023-10-14T10:35:49.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.857+0000 7facdbfff640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7facbc06aea0 0x7facbc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:49.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.857+0000 7facdbfff640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7facbc06aea0 0x7facbc06d360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faccc036000 tx=0x7faccc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:49.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:49.861+0000 7facd97fa640 1 -- 172.21.15.8:0/2024763647 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7facc4054540 con 0x7facdc14e0f0 2023-10-14T10:35:50.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.055+0000 7face1239640 1 -- 172.21.15.8:0/2024763647 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7facdc154900 con 0x7facbc06aea0 2023-10-14T10:35:50.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.056+0000 7facd97fa640 1 -- 172.21.15.8:0/2024763647 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faccc0315e0 con 0x7facbc06aea0 2023-10-14T10:35:50.059 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 0 to deep-scrub 2023-10-14T10:35:50.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.058+0000 7face1239640 1 -- 172.21.15.8:0/2024763647 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7facbc06aea0 msgr2=0x7facbc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.058+0000 7face1239640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7facbc06aea0 0x7facbc06d360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faccc036000 tx=0x7faccc03c040 comp rx=0 tx=0).stop 2023-10-14T10:35:50.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.058+0000 7face1239640 1 -- 172.21.15.8:0/2024763647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc14e0f0 msgr2=0x7facdc0a86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.058+0000 7face1239640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc14e0f0 0x7facdc0a86d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7facc400b3f0 tx=0x7facc400b8b0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.059+0000 7face1239640 1 -- 172.21.15.8:0/2024763647 shutdown_connections 2023-10-14T10:35:50.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.059+0000 7face1239640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7facbc06aea0 0x7facbc06d360 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.059+0000 7face1239640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc157640 0x7facdc1e8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.059+0000 7face1239640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc14e0f0 0x7facdc0a86d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.059+0000 7face1239640 1 --2- 172.21.15.8:0/2024763647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc0ba150 0x7facdc14ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.059+0000 7face1239640 1 -- 172.21.15.8:0/2024763647 >> 172.21.15.8:0/2024763647 conn(0x7facdc06a200 msgr2=0x7facdc152a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.059+0000 7face1239640 1 -- 172.21.15.8:0/2024763647 shutdown_connections 2023-10-14T10:35:50.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.059+0000 7face1239640 1 -- 172.21.15.8:0/2024763647 wait complete. 2023-10-14T10:35:50.081 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T10:35:50.082 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T10:35:50.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.311+0000 7f345ac90640 1 Processor -- start 2023-10-14T10:35:50.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.311+0000 7f345ac90640 1 -- start start 2023-10-14T10:35:50.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.312+0000 7f345ac90640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f34541549a0 0x7f345406b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.312+0000 7f345ac90640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f345406b660 0x7f34540c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.312+0000 7f345ac90640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3454153f20 con 0x7f3454151540 2023-10-14T10:35:50.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.312+0000 7f345ac90640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34540c5a30 con 0x7f34541549a0 2023-10-14T10:35:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.312+0000 7f345ac90640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34540c5d10 con 0x7f345406b660 2023-10-14T10:35:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.313+0000 7f3459c8e640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3454151540 0x7f34540c7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43570/0 (socket says 172.21.15.8:43570) 2023-10-14T10:35:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.313+0000 7f3459c8e640 1 -- 172.21.15.8:0/1631365803 learned_addr learned my addr 172.21.15.8:0/1631365803 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.313+0000 7f345948d640 1 --2- 172.21.15.8:0/1631365803 >> v2:172.21.15.92:3300/0 conn(0x7f34541549a0 0x7f345406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.313+0000 7f345a48f640 1 --2- 172.21.15.8:0/1631365803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f345406b660 0x7f34540c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.313+0000 7f3458c8c640 1 -- 172.21.15.8:0/1631365803 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302691748 0 0) 0x7f3454153f20 con 0x7f3454151540 2023-10-14T10:35:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.313+0000 7f3458c8c640 1 -- 172.21.15.8:0/1631365803 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3440003520 con 0x7f3454151540 2023-10-14T10:35:50.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.314+0000 7f345948d640 1 -- 172.21.15.8:0/1631365803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f345406b660 msgr2=0x7f34540c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.314+0000 7f345948d640 1 --2- 172.21.15.8:0/1631365803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f345406b660 0x7f34540c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.314+0000 7f345948d640 1 -- 172.21.15.8:0/1631365803 >> v1:172.21.15.8:6789/0 conn(0x7f3454151540 legacy=0x7f34540c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.314+0000 7f345948d640 1 -- 172.21.15.8:0/1631365803 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34541541a0 con 0x7f34541549a0 2023-10-14T10:35:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.315+0000 7f345948d640 1 --2- 172.21.15.8:0/1631365803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34541549a0 0x7f345406b120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f34440097a0 tx=0x7f344402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf8b78985d0a4af6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.315+0000 7f3458c8c640 1 -- 172.21.15.8:0/1631365803 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444031780 con 0x7f34541549a0 2023-10-14T10:35:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.315+0000 7f3458c8c640 1 -- 172.21.15.8:0/1631365803 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34440318e0 con 0x7f34541549a0 2023-10-14T10:35:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.315+0000 7f3458c8c640 1 -- 172.21.15.8:0/1631365803 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444031c70 con 0x7f34541549a0 2023-10-14T10:35:50.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.316+0000 7f345ac90640 1 -- 172.21.15.8:0/1631365803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34541549a0 msgr2=0x7f345406b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.316+0000 7f345ac90640 1 --2- 172.21.15.8:0/1631365803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34541549a0 0x7f345406b120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f34440097a0 tx=0x7f344402b820 comp rx=0 tx=0).stop 2023-10-14T10:35:50.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.316+0000 7f345ac90640 1 -- 172.21.15.8:0/1631365803 shutdown_connections 2023-10-14T10:35:50.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.316+0000 7f345ac90640 1 --2- 172.21.15.8:0/1631365803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f345406b660 0x7f34540c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.316+0000 7f345ac90640 1 --2- 172.21.15.8:0/1631365803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34541549a0 0x7f345406b120 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.316+0000 7f345ac90640 1 -- 172.21.15.8:0/1631365803 >> 172.21.15.8:0/1631365803 conn(0x7f34540ab110 msgr2=0x7f34540ab520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:50.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.316+0000 7f345ac90640 1 -- 172.21.15.8:0/1631365803 shutdown_connections 2023-10-14T10:35:50.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.316+0000 7f345ac90640 1 -- 172.21.15.8:0/1631365803 wait complete. 2023-10-14T10:35:50.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.318+0000 7f345ac90640 1 Processor -- start 2023-10-14T10:35:50.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.318+0000 7f345ac90640 1 -- start start 2023-10-14T10:35:50.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.319+0000 7f345ac90640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345406b660 0x7f34541534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.319+0000 7f345ac90640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3454151540 0x7f34540aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.319+0000 7f345ac90640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34541549a0 0x7f3454157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.319+0000 7f345ac90640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34540c5320 con 0x7f34541549a0 2023-10-14T10:35:50.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.319+0000 7f345ac90640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34541539f0 con 0x7f345406b660 2023-10-14T10:35:50.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.319+0000 7f345ac90640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3454146540 con 0x7f3454151540 2023-10-14T10:35:50.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.319+0000 7f345a48f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34541549a0 0x7f3454157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.319+0000 7f345a48f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34541549a0 0x7f3454157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44372/0 (socket says 172.21.15.8:44372) 2023-10-14T10:35:50.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.319+0000 7f345a48f640 1 -- 172.21.15.8:0/796512249 learned_addr learned my addr 172.21.15.8:0/796512249 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:50.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.319+0000 7f3459c8e640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345406b660 0x7f34541534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.320+0000 7f345948d640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3454151540 0x7f34540aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.320+0000 7f345a48f640 1 -- 172.21.15.8:0/796512249 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3454151540 msgr2=0x7f34540aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.320+0000 7f345a48f640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3454151540 0x7f34540aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.320+0000 7f345a48f640 1 -- 172.21.15.8:0/796512249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345406b660 msgr2=0x7f34541534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.320+0000 7f345a48f640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345406b660 0x7f34541534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.320+0000 7f345a48f640 1 -- 172.21.15.8:0/796512249 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3444009400 con 0x7f34541549a0 2023-10-14T10:35:50.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.320+0000 7f345a48f640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34541549a0 0x7f3454157a60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f344c00e7f0 tx=0x7f344c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:50.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.320+0000 7f344a7fc640 1 -- 172.21.15.8:0/796512249 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c009510 con 0x7f34541549a0 2023-10-14T10:35:50.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.320+0000 7f344a7fc640 1 -- 172.21.15.8:0/796512249 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c00ee40 con 0x7f34541549a0 2023-10-14T10:35:50.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.320+0000 7f344a7fc640 1 -- 172.21.15.8:0/796512249 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c00cb20 con 0x7f34541549a0 2023-10-14T10:35:50.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.320+0000 7f345ac90640 1 -- 172.21.15.8:0/796512249 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3454153c20 con 0x7f34541549a0 2023-10-14T10:35:50.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.320+0000 7f345ac90640 1 -- 172.21.15.8:0/796512249 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34541e92e0 con 0x7f34541549a0 2023-10-14T10:35:50.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.321+0000 7f345ac90640 1 -- 172.21.15.8:0/796512249 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3454151920 con 0x7f34541549a0 2023-10-14T10:35:50.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.323+0000 7f344a7fc640 1 -- 172.21.15.8:0/796512249 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f344c00cc80 con 0x7f34541549a0 2023-10-14T10:35:50.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.323+0000 7f344a7fc640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f343806aea0 0x7f343806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.324+0000 7f344a7fc640 1 -- 172.21.15.8:0/796512249 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f344c0896f0 con 0x7f34541549a0 2023-10-14T10:35:50.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.324+0000 7f344a7fc640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] conn(0x7f3438070d00 0x7f3438073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.324+0000 7f344a7fc640 1 -- 172.21.15.8:0/796512249 --> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34380737d0 con 0x7f3438070d00 2023-10-14T10:35:50.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.324+0000 7f344a7fc640 1 -- 172.21.15.8:0/796512249 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f344c089a60 con 0x7f34541549a0 2023-10-14T10:35:50.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.324+0000 7f3459c8e640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f343806aea0 0x7f343806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.324+0000 7f345948d640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] conn(0x7f3438070d00 0x7f3438073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.325+0000 7f3459c8e640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f343806aea0 0x7f343806d360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3450001560 tx=0x7f3450009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:50.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.325+0000 7f345948d640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] conn(0x7f3438070d00 0x7f3438073120 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:50.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.326+0000 7f344a7fc640 1 -- 172.21.15.8:0/796512249 <== osd.1 v2:172.21.15.8:6800/1766897298 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f34380737d0 con 0x7f3438070d00 2023-10-14T10:35:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.340+0000 7f345ac90640 1 -- 172.21.15.8:0/796512249 --> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3454154480 con 0x7f3438070d00 2023-10-14T10:35:50.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.341+0000 7f344a7fc640 1 -- 172.21.15.8:0/796512249 <== osd.1 v2:172.21.15.8:6800/1766897298 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3444031a50 con 0x7f3438070d00 2023-10-14T10:35:50.343 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:50.343 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T10:35:50.344 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:50.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.341+0000 7f345ac90640 1 -- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] conn(0x7f3438070d00 msgr2=0x7f3438073120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.341+0000 7f345ac90640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:6800/1766897298,v1:172.21.15.8:6801/1766897298] conn(0x7f3438070d00 0x7f3438073120 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.341+0000 7f345ac90640 1 -- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f343806aea0 msgr2=0x7f343806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.341+0000 7f345ac90640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f343806aea0 0x7f343806d360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3450001560 tx=0x7f3450009040 comp rx=0 tx=0).stop 2023-10-14T10:35:50.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.341+0000 7f345ac90640 1 -- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34541549a0 msgr2=0x7f3454157a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.341+0000 7f345ac90640 1 --2- 172.21.15.8:0/796512249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34541549a0 0x7f3454157a60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f344c00e7f0 tx=0x7f344c00ebf0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.341+0000 7f345a48f640 1 -- 172.21.15.8:0/796512249 reap_dead start 2023-10-14T10:35:50.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.341+0000 7f345ac90640 1 -- 172.21.15.8:0/796512249 shutdown_connections 2023-10-14T10:35:50.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.341+0000 7f345ac90640 1 -- 172.21.15.8:0/796512249 >> 172.21.15.8:0/796512249 conn(0x7f34540ab110 msgr2=0x7f34540c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:50.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.342+0000 7f345ac90640 1 -- 172.21.15.8:0/796512249 shutdown_connections 2023-10-14T10:35:50.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.342+0000 7f345ac90640 1 -- 172.21.15.8:0/796512249 wait complete. 2023-10-14T10:35:50.364 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-14T10:35:50.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.586+0000 7f4ec9c21640 1 Processor -- start 2023-10-14T10:35:50.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.587+0000 7f4ec9c21640 1 -- start start 2023-10-14T10:35:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.588+0000 7f4ec9c21640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ec4151420 0x7f4ec40c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.588+0000 7f4ec9c21640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ec40c43a0 0x7f4ec40c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.588+0000 7f4ec9c21640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec40c4e30 con 0x7f4ec40c5610 2023-10-14T10:35:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.588+0000 7f4ec9c21640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec40c5450 con 0x7f4ec40c43a0 2023-10-14T10:35:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.588+0000 7f4ec9c21640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec4154950 con 0x7f4ec4151420 2023-10-14T10:35:50.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.589+0000 7f4ec3fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ec40c43a0 0x7f4ec40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.589+0000 7f4ec9420640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4ec40c5610 0x7f4ec406ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43574/0 (socket says 172.21.15.8:43574) 2023-10-14T10:35:50.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.589+0000 7f4ec3fff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4ec40c43a0 0x7f4ec40c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44386/0 (socket says 172.21.15.8:44386) 2023-10-14T10:35:50.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.589+0000 7f4ec9420640 1 -- 172.21.15.8:0/2681203648 learned_addr learned my addr 172.21.15.8:0/2681203648 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:50.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.589+0000 7f4ec8c1f640 1 --2- 172.21.15.8:0/2681203648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ec4151420 0x7f4ec40c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.589+0000 7f4ec3fff640 1 -- 172.21.15.8:0/2681203648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ec4151420 msgr2=0x7f4ec40c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:50.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.589+0000 7f4ec3fff640 1 --2- 172.21.15.8:0/2681203648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ec4151420 0x7f4ec40c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.589+0000 7f4ec3fff640 1 -- 172.21.15.8:0/2681203648 >> v1:172.21.15.8:6789/0 conn(0x7f4ec40c5610 legacy=0x7f4ec406ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.589+0000 7f4ec37fe640 1 -- 172.21.15.8:0/2681203648 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221781240 0 0) 0x7f4ebc001110 con 0x7f4ec40c5610 2023-10-14T10:35:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.589+0000 7f4ec3fff640 1 -- 172.21.15.8:0/2681203648 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec40c5d00 con 0x7f4ec40c43a0 2023-10-14T10:35:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.590+0000 7f4ec3fff640 1 --2- 172.21.15.8:0/2681203648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec40c43a0 0x7f4ec40c75c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80097a0 tx=0x7f4eb802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8007cc4b7fcdbd8c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.591+0000 7f4ec37fe640 1 -- 172.21.15.8:0/2681203648 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb802e070 con 0x7f4ec40c43a0 2023-10-14T10:35:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.591+0000 7f4ec37fe640 1 -- 172.21.15.8:0/2681203648 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb80315a0 con 0x7f4ec40c43a0 2023-10-14T10:35:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.591+0000 7f4ec37fe640 1 -- 172.21.15.8:0/2681203648 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8031930 con 0x7f4ec40c43a0 2023-10-14T10:35:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.591+0000 7f4ec9c21640 1 -- 172.21.15.8:0/2681203648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec40c43a0 msgr2=0x7f4ec40c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.591+0000 7f4ec9c21640 1 --2- 172.21.15.8:0/2681203648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec40c43a0 0x7f4ec40c75c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80097a0 tx=0x7f4eb802b840 comp rx=0 tx=0).stop 2023-10-14T10:35:50.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.591+0000 7f4ec9c21640 1 -- 172.21.15.8:0/2681203648 shutdown_connections 2023-10-14T10:35:50.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.591+0000 7f4ec9c21640 1 --2- 172.21.15.8:0/2681203648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec40c43a0 0x7f4ec40c75c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.591+0000 7f4ec9c21640 1 --2- 172.21.15.8:0/2681203648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ec4151420 0x7f4ec40c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.591+0000 7f4ec9c21640 1 -- 172.21.15.8:0/2681203648 >> 172.21.15.8:0/2681203648 conn(0x7f4ec40c96c0 msgr2=0x7f4ec40c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:50.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.592+0000 7f4ec9c21640 1 -- 172.21.15.8:0/2681203648 shutdown_connections 2023-10-14T10:35:50.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.592+0000 7f4ec9c21640 1 -- 172.21.15.8:0/2681203648 wait complete. 2023-10-14T10:35:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.593+0000 7f4ec9c21640 1 Processor -- start 2023-10-14T10:35:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.593+0000 7f4ec9c21640 1 -- start start 2023-10-14T10:35:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.594+0000 7f4ec9c21640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec40c43a0 0x7f4ec40aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.594+0000 7f4ec9c21640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ec40c5610 0x7f4ec40ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.594+0000 7f4ec9c21640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec4151420 0x7f4ec40ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.594+0000 7f4ec9c21640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec40acda0 con 0x7f4ec4151420 2023-10-14T10:35:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.594+0000 7f4ec9c21640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec414dc30 con 0x7f4ec40c43a0 2023-10-14T10:35:50.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.594+0000 7f4ec9c21640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec414cb90 con 0x7f4ec40c5610 2023-10-14T10:35:50.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.595+0000 7f4ec9420640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec4151420 0x7f4ec40ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.595+0000 7f4ec9420640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec4151420 0x7f4ec40ac860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44390/0 (socket says 172.21.15.8:44390) 2023-10-14T10:35:50.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.595+0000 7f4ec9420640 1 -- 172.21.15.8:0/1587127740 learned_addr learned my addr 172.21.15.8:0/1587127740 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:50.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.595+0000 7f4ec8c1f640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec40c43a0 0x7f4ec40aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.595+0000 7f4ec3fff640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ec40c5610 0x7f4ec40ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.595+0000 7f4ec9420640 1 -- 172.21.15.8:0/1587127740 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ec40c5610 msgr2=0x7f4ec40ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.595+0000 7f4ec9420640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ec40c5610 0x7f4ec40ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.595+0000 7f4ec9420640 1 -- 172.21.15.8:0/1587127740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec40c43a0 msgr2=0x7f4ec40aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.595+0000 7f4ec9420640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec40c43a0 0x7f4ec40aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.595+0000 7f4ec9420640 1 -- 172.21.15.8:0/1587127740 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb8009400 con 0x7f4ec4151420 2023-10-14T10:35:50.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.595+0000 7f4ec3fff640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ec40c5610 0x7f4ec40ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:50.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.596+0000 7f4ec9420640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec4151420 0x7f4ec40ac860 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00c780 tx=0x7f4ebc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:50.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.596+0000 7f4ec17fa640 1 -- 172.21.15.8:0/1587127740 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc0072d0 con 0x7f4ec4151420 2023-10-14T10:35:50.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.596+0000 7f4ec17fa640 1 -- 172.21.15.8:0/1587127740 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc007450 con 0x7f4ec4151420 2023-10-14T10:35:50.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.596+0000 7f4ec17fa640 1 -- 172.21.15.8:0/1587127740 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc001d10 con 0x7f4ec4151420 2023-10-14T10:35:50.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.596+0000 7f4ec9c21640 1 -- 172.21.15.8:0/1587127740 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec414ce70 con 0x7f4ec4151420 2023-10-14T10:35:50.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.596+0000 7f4ec9c21640 1 -- 172.21.15.8:0/1587127740 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec414d430 con 0x7f4ec4151420 2023-10-14T10:35:50.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.598+0000 7f4ec9c21640 1 -- 172.21.15.8:0/1587127740 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec40c6dd0 con 0x7f4ec4151420 2023-10-14T10:35:50.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.598+0000 7f4ec17fa640 1 -- 172.21.15.8:0/1587127740 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4ebc0047e0 con 0x7f4ec4151420 2023-10-14T10:35:50.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.599+0000 7f4ec17fa640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4eb006ae70 0x7f4eb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:50.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.599+0000 7f4ec17fa640 1 -- 172.21.15.8:0/1587127740 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4ebc088400 con 0x7f4ec4151420 2023-10-14T10:35:50.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.600+0000 7f4ec8c1f640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4eb006ae70 0x7f4eb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:50.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.600+0000 7f4ec8c1f640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4eb006ae70 0x7f4eb006d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40073f0 tx=0x7f4eb400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:50.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.604+0000 7f4ec17fa640 1 -- 172.21.15.8:0/1587127740 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ebc0537c0 con 0x7f4ec4151420 2023-10-14T10:35:50.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.800+0000 7f4ec9c21640 1 -- 172.21.15.8:0/1587127740 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ec4154b50 con 0x7f4eb006ae70 2023-10-14T10:35:50.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.801+0000 7f4ec17fa640 1 -- 172.21.15.8:0/1587127740 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4eb400f050 con 0x7f4eb006ae70 2023-10-14T10:35:50.803 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 1 to deep-scrub 2023-10-14T10:35:50.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.803+0000 7f4ec9c21640 1 -- 172.21.15.8:0/1587127740 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4eb006ae70 msgr2=0x7f4eb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.803+0000 7f4ec9c21640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4eb006ae70 0x7f4eb006d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40073f0 tx=0x7f4eb400b040 comp rx=0 tx=0).stop 2023-10-14T10:35:50.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.803+0000 7f4ec9c21640 1 -- 172.21.15.8:0/1587127740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec4151420 msgr2=0x7f4ec40ac860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:50.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.803+0000 7f4ec9c21640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec4151420 0x7f4ec40ac860 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00c780 tx=0x7f4ebc00cc40 comp rx=0 tx=0).stop 2023-10-14T10:35:50.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.803+0000 7f4ec9c21640 1 -- 172.21.15.8:0/1587127740 shutdown_connections 2023-10-14T10:35:50.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.803+0000 7f4ec9c21640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f4eb006ae70 0x7f4eb006d330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.803+0000 7f4ec9c21640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ec4151420 0x7f4ec40ac860 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.803+0000 7f4ec9c21640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ec40c5610 0x7f4ec40ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.803+0000 7f4ec9c21640 1 --2- 172.21.15.8:0/1587127740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ec40c43a0 0x7f4ec40aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:50.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.803+0000 7f4ec9c21640 1 -- 172.21.15.8:0/1587127740 >> 172.21.15.8:0/1587127740 conn(0x7f4ec40c96c0 msgr2=0x7f4ec414f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:50.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.803+0000 7f4ec9c21640 1 -- 172.21.15.8:0/1587127740 shutdown_connections 2023-10-14T10:35:50.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:50.803+0000 7f4ec9c21640 1 -- 172.21.15.8:0/1587127740 wait complete. 2023-10-14T10:35:50.825 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T10:35:50.826 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T10:35:51.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.058+0000 7f58c7fff640 1 Processor -- start 2023-10-14T10:35:51.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.058+0000 7f58c7fff640 1 -- start start 2023-10-14T10:35:51.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.060+0000 7f58c7fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f58c813afc0 0x7f58c8152560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.060+0000 7f58c7fff640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c813b3a0 con 0x7f58c80711c0 2023-10-14T10:35:51.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.060+0000 7f58c7fff640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c80ab060 con 0x7f58c806ff00 2023-10-14T10:35:51.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.060+0000 7f58c7fff640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c80aa4e0 con 0x7f58c813afc0 2023-10-14T10:35:51.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.060+0000 7f58c77fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f58c80711c0 0x7f58c80715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43588/0 (socket says 172.21.15.8:43588) 2023-10-14T10:35:51.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.060+0000 7f58c77fe640 1 -- 172.21.15.8:0/2298902222 learned_addr learned my addr 172.21.15.8:0/2298902222 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:51.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.060+0000 7f58c6ffd640 1 --2- 172.21.15.8:0/2298902222 >> v2:172.21.15.92:3300/0 conn(0x7f58c813afc0 0x7f58c8152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949360915 0 0) 0x7f58c813b3a0 con 0x7f58c80711c0 2023-10-14T10:35:51.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b0003520 con 0x7f58c80711c0 2023-10-14T10:35:51.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 919871462 0 0) 0x7f58b0003520 con 0x7f58c80711c0 2023-10-14T10:35:51.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 >> v2:172.21.15.92:3300/0 conn(0x7f58c813afc0 msgr2=0x7f58c8152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:51.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 --2- 172.21.15.8:0/2298902222 >> v2:172.21.15.92:3300/0 conn(0x7f58c813afc0 0x7f58c8152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 >> v1:172.21.15.92:6789/0 conn(0x7f58c806ff00 legacy=0x7f58c80a83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c80aa7c0 con 0x7f58c80711c0 2023-10-14T10:35:51.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f58c00019f0 con 0x7f58c80711c0 2023-10-14T10:35:51.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 >> v1:172.21.15.8:6789/0 conn(0x7f58c80711c0 legacy=0x7f58c80715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 --2- 172.21.15.8:0/2298902222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58b00039c0 0x7f58b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 --2- 172.21.15.8:0/2298902222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58b00047c0 0x7f58b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 --2- 172.21.15.8:0/2298902222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58b0005180 0x7f58b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80aa4e0 con 0x7f58b00039c0 2023-10-14T10:35:51.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b000c080 con 0x7f58b00047c0 2023-10-14T10:35:51.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.061+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b000c240 con 0x7f58b0005180 2023-10-14T10:35:51.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.062+0000 7f58c6ffd640 1 --2- 172.21.15.8:0/2298902222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58b00039c0 0x7f58b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.062+0000 7f58c67fc640 1 --2- 172.21.15.8:0/2298902222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58b00047c0 0x7f58b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.062+0000 7f58c6ffd640 1 -- 172.21.15.8:0/2298902222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58b0005180 msgr2=0x7f58b000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:51.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.062+0000 7f58c6ffd640 1 --2- 172.21.15.8:0/2298902222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58b0005180 0x7f58b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.062+0000 7f58c6ffd640 1 -- 172.21.15.8:0/2298902222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58b00047c0 msgr2=0x7f58b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:51.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.062+0000 7f58c6ffd640 1 --2- 172.21.15.8:0/2298902222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58b00047c0 0x7f58b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.062+0000 7f58c6ffd640 1 -- 172.21.15.8:0/2298902222 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b0003520 con 0x7f58b00039c0 2023-10-14T10:35:51.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.062+0000 7f58c77fe640 1 -- 172.21.15.8:0/2298902222 reap_dead start 2023-10-14T10:35:51.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.062+0000 7f58c67fc640 1 --2- 172.21.15.8:0/2298902222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58b00047c0 0x7f58b0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:51.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.063+0000 7f58c6ffd640 1 --2- 172.21.15.8:0/2298902222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58b00039c0 0x7f58b0003de0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009ac0 tx=0x7f58b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e686feffb82ef0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:51.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.064+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b802c6d0 con 0x7f58b00039c0 2023-10-14T10:35:51.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.064+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b802c830 con 0x7f58b00039c0 2023-10-14T10:35:51.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.064+0000 7f58c5ffb640 1 -- 172.21.15.8:0/2298902222 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b802cbc0 con 0x7f58b00039c0 2023-10-14T10:35:51.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.064+0000 7f58c7fff640 1 -- 172.21.15.8:0/2298902222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58b00039c0 msgr2=0x7f58b0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.064+0000 7f58c7fff640 1 --2- 172.21.15.8:0/2298902222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58b00039c0 0x7f58b0003de0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009ac0 tx=0x7f58b00057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.065+0000 7f58c7fff640 1 -- 172.21.15.8:0/2298902222 shutdown_connections 2023-10-14T10:35:51.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.065+0000 7f58c7fff640 1 --2- 172.21.15.8:0/2298902222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58b00039c0 0x7f58b0003de0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.065+0000 7f58c7fff640 1 -- 172.21.15.8:0/2298902222 >> 172.21.15.8:0/2298902222 conn(0x7f58c80c52a0 msgr2=0x7f58c80c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:51.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.065+0000 7f58c7fff640 1 -- 172.21.15.8:0/2298902222 shutdown_connections 2023-10-14T10:35:51.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.065+0000 7f58c7fff640 1 -- 172.21.15.8:0/2298902222 wait complete. 2023-10-14T10:35:51.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.066+0000 7f58c7fff640 1 Processor -- start 2023-10-14T10:35:51.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.067+0000 7f58c7fff640 1 -- start start 2023-10-14T10:35:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.067+0000 7f58c7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58b00039c0 0x7f58c8151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c7fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58c81eaaf0 0x7f58c81eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c7fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58c81eb4b0 0x7f58c80c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c7fff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c81ed850 con 0x7f58c81eaaf0 2023-10-14T10:35:51.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c7fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8156080 con 0x7f58b00039c0 2023-10-14T10:35:51.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c7fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c81ecc40 con 0x7f58c81eb4b0 2023-10-14T10:35:51.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c67fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58c81eaaf0 0x7f58c81eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c67fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58c81eaaf0 0x7f58c81eaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44410/0 (socket says 172.21.15.8:44410) 2023-10-14T10:35:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c67fc640 1 -- 172.21.15.8:0/1894879105 learned_addr learned my addr 172.21.15.8:0/1894879105 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c6ffd640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58b00039c0 0x7f58c8151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c77fe640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58c81eb4b0 0x7f58c80c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c67fc640 1 -- 172.21.15.8:0/1894879105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58c81eb4b0 msgr2=0x7f58c80c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c67fc640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58c81eb4b0 0x7f58c80c2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c67fc640 1 -- 172.21.15.8:0/1894879105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58b00039c0 msgr2=0x7f58c8151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c67fc640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58b00039c0 0x7f58c8151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c67fc640 1 -- 172.21.15.8:0/1894879105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c81ecf20 con 0x7f58c81eaaf0 2023-10-14T10:35:51.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.068+0000 7f58c77fe640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58c81eb4b0 0x7f58c80c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:51.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.069+0000 7f58c67fc640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58c81eaaf0 0x7f58c81eaf70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00d4a0 tx=0x7f58bc00d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:51.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.069+0000 7f58af7fe640 1 -- 172.21.15.8:0/1894879105 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc016070 con 0x7f58c81eaaf0 2023-10-14T10:35:51.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.069+0000 7f58af7fe640 1 -- 172.21.15.8:0/1894879105 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc005280 con 0x7f58c81eaaf0 2023-10-14T10:35:51.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.069+0000 7f58af7fe640 1 -- 172.21.15.8:0/1894879105 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc007020 con 0x7f58c81eaaf0 2023-10-14T10:35:51.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.069+0000 7f58c7fff640 1 -- 172.21.15.8:0/1894879105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c81ed200 con 0x7f58c81eaaf0 2023-10-14T10:35:51.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.069+0000 7f58c7fff640 1 -- 172.21.15.8:0/1894879105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c8151740 con 0x7f58c81eaaf0 2023-10-14T10:35:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.070+0000 7f58c7fff640 1 -- 172.21.15.8:0/1894879105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58c80aad80 con 0x7f58c81eaaf0 2023-10-14T10:35:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.071+0000 7f58af7fe640 1 -- 172.21.15.8:0/1894879105 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f58bc007180 con 0x7f58c81eaaf0 2023-10-14T10:35:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.072+0000 7f58af7fe640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f58b406aea0 0x7f58b406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.073+0000 7f58af7fe640 1 -- 172.21.15.8:0/1894879105 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f58bc088a70 con 0x7f58c81eaaf0 2023-10-14T10:35:51.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.073+0000 7f58c6ffd640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f58b406aea0 0x7f58b406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.073+0000 7f58af7fe640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] conn(0x7f58b4070d00 0x7f58b4073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.073+0000 7f58af7fe640 1 -- 172.21.15.8:0/1894879105 --> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58b40737d0 con 0x7f58b4070d00 2023-10-14T10:35:51.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.073+0000 7f58af7fe640 1 -- 172.21.15.8:0/1894879105 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58bc08d2a0 con 0x7f58c81eaaf0 2023-10-14T10:35:51.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.073+0000 7f58c77fe640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] conn(0x7f58b4070d00 0x7f58b4073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.074+0000 7f58c6ffd640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f58b406aea0 0x7f58b406d360 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f58b8036000 tx=0x7f58b8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:51.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.074+0000 7f58c77fe640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] conn(0x7f58b4070d00 0x7f58b4073120 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:51.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.075+0000 7f58af7fe640 1 -- 172.21.15.8:0/1894879105 <== osd.2 v2:172.21.15.8:6808/430494339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f58b40737d0 con 0x7f58b4070d00 2023-10-14T10:35:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.089+0000 7f58c7fff640 1 -- 172.21.15.8:0/1894879105 --> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f58c80aaaa0 con 0x7f58b4070d00 2023-10-14T10:35:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.089+0000 7f58af7fe640 1 -- 172.21.15.8:0/1894879105 <== osd.2 v2:172.21.15.8:6808/430494339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f58c0001fb0 con 0x7f58b4070d00 2023-10-14T10:35:51.093 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:51.093 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T10:35:51.094 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.089+0000 7f58c7fff640 1 -- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] conn(0x7f58b4070d00 msgr2=0x7f58b4073120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.089+0000 7f58c7fff640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:6808/430494339,v1:172.21.15.8:6810/430494339] conn(0x7f58b4070d00 0x7f58b4073120 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.090+0000 7f58c7fff640 1 -- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f58b406aea0 msgr2=0x7f58b406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.090+0000 7f58c7fff640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f58b406aea0 0x7f58b406d360 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f58b8036000 tx=0x7f58b8030000 comp rx=0 tx=0).stop 2023-10-14T10:35:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.090+0000 7f58c7fff640 1 -- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58c81eaaf0 msgr2=0x7f58c81eaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.090+0000 7f58c7fff640 1 --2- 172.21.15.8:0/1894879105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58c81eaaf0 0x7f58c81eaf70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00d4a0 tx=0x7f58bc00d960 comp rx=0 tx=0).stop 2023-10-14T10:35:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.090+0000 7f58c77fe640 1 -- 172.21.15.8:0/1894879105 reap_dead start 2023-10-14T10:35:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.090+0000 7f58c7fff640 1 -- 172.21.15.8:0/1894879105 shutdown_connections 2023-10-14T10:35:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.090+0000 7f58c7fff640 1 -- 172.21.15.8:0/1894879105 >> 172.21.15.8:0/1894879105 conn(0x7f58c80c52a0 msgr2=0x7f58c8138710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.090+0000 7f58c7fff640 1 -- 172.21.15.8:0/1894879105 shutdown_connections 2023-10-14T10:35:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.090+0000 7f58c7fff640 1 -- 172.21.15.8:0/1894879105 wait complete. 2023-10-14T10:35:51.111 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T10:35:51.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.333+0000 7fbeb3fff640 1 Processor -- start 2023-10-14T10:35:51.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.334+0000 7fbeb3fff640 1 -- start start 2023-10-14T10:35:51.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.335+0000 7fbeb3fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbeb4151420 0x7fbeb40c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.335+0000 7fbeb3fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbeb40c5610 0x7fbeb406ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.335+0000 7fbeb3fff640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb40c4e30 con 0x7fbeb40c43a0 2023-10-14T10:35:51.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.335+0000 7fbeb3fff640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb40c5450 con 0x7fbeb4151420 2023-10-14T10:35:51.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.335+0000 7fbeb3fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb4154950 con 0x7fbeb40c5610 2023-10-14T10:35:51.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.336+0000 7fbeb37fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbeb40c5610 0x7fbeb406ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.336+0000 7fbeb37fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbeb40c5610 0x7fbeb406ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.8:56304/0 (socket says 172.21.15.8:56304) 2023-10-14T10:35:51.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.336+0000 7fbeb37fe640 1 -- 172.21.15.8:0/2799809775 learned_addr learned my addr 172.21.15.8:0/2799809775 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:51.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.336+0000 7fbeb27fc640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fbeb40c43a0 0x7fbeb40c75c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.8:54312/0 (socket says 172.21.15.8:54312) 2023-10-14T10:35:51.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.336+0000 7fbeb2ffd640 1 --2- 172.21.15.8:0/2799809775 >> v2:172.21.15.92:3300/0 conn(0x7fbeb4151420 0x7fbeb40c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.336+0000 7fbeb1ffb640 1 -- 172.21.15.8:0/2799809775 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760738054 0 0) 0x7fbe9c001110 con 0x7fbeb40c43a0 2023-10-14T10:35:51.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.336+0000 7fbeb1ffb640 1 -- 172.21.15.8:0/2799809775 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbea0003520 con 0x7fbeb40c43a0 2023-10-14T10:35:51.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.336+0000 7fbeb2ffd640 1 -- 172.21.15.8:0/2799809775 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbeb40c5610 msgr2=0x7fbeb406ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:51.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.337+0000 7fbeb2ffd640 1 --2- 172.21.15.8:0/2799809775 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbeb40c5610 0x7fbeb406ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.337+0000 7fbeb2ffd640 1 -- 172.21.15.8:0/2799809775 >> v1:172.21.15.92:6789/0 conn(0x7fbeb40c43a0 legacy=0x7fbeb40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.337+0000 7fbeb2ffd640 1 -- 172.21.15.8:0/2799809775 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb40c5d00 con 0x7fbeb4151420 2023-10-14T10:35:51.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.338+0000 7fbeb2ffd640 1 --2- 172.21.15.8:0/2799809775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb4151420 0x7fbeb40c48f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009d90 tx=0x7fbea402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4b7cf1fec2257e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:51.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.338+0000 7fbeb1ffb640 1 -- 172.21.15.8:0/2799809775 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea402cbc0 con 0x7fbeb4151420 2023-10-14T10:35:51.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.338+0000 7fbeb1ffb640 1 -- 172.21.15.8:0/2799809775 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea402cd20 con 0x7fbeb4151420 2023-10-14T10:35:51.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.338+0000 7fbeb1ffb640 1 -- 172.21.15.8:0/2799809775 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4034660 con 0x7fbeb4151420 2023-10-14T10:35:51.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.339+0000 7fbeb3fff640 1 -- 172.21.15.8:0/2799809775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb4151420 msgr2=0x7fbeb40c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.339+0000 7fbeb3fff640 1 --2- 172.21.15.8:0/2799809775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb4151420 0x7fbeb40c48f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009d90 tx=0x7fbea402be10 comp rx=0 tx=0).stop 2023-10-14T10:35:51.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.339+0000 7fbeb3fff640 1 -- 172.21.15.8:0/2799809775 shutdown_connections 2023-10-14T10:35:51.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.339+0000 7fbeb3fff640 1 --2- 172.21.15.8:0/2799809775 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbeb40c5610 0x7fbeb406ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.339+0000 7fbeb3fff640 1 --2- 172.21.15.8:0/2799809775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb4151420 0x7fbeb40c48f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.339+0000 7fbeb3fff640 1 -- 172.21.15.8:0/2799809775 >> 172.21.15.8:0/2799809775 conn(0x7fbeb40c96c0 msgr2=0x7fbeb40c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:51.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.339+0000 7fbeb3fff640 1 -- 172.21.15.8:0/2799809775 shutdown_connections 2023-10-14T10:35:51.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.339+0000 7fbeb3fff640 1 -- 172.21.15.8:0/2799809775 wait complete. 2023-10-14T10:35:51.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.341+0000 7fbeb3fff640 1 Processor -- start 2023-10-14T10:35:51.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.341+0000 7fbeb3fff640 1 -- start start 2023-10-14T10:35:51.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.342+0000 7fbeb3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb40c43a0 0x7fbeb414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.342+0000 7fbeb3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb40c5610 0x7fbeb4146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.342+0000 7fbeb3fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbeb4151420 0x7fbeb41ec5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.342+0000 7fbeb3fff640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb414e870 con 0x7fbeb40c5610 2023-10-14T10:35:51.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.342+0000 7fbeb3fff640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb4147380 con 0x7fbeb40c43a0 2023-10-14T10:35:51.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.342+0000 7fbeb3fff640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb414c660 con 0x7fbeb4151420 2023-10-14T10:35:51.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.342+0000 7fbeb27fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb40c5610 0x7fbeb4146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.342+0000 7fbeb27fc640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb40c5610 0x7fbeb4146e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44426/0 (socket says 172.21.15.8:44426) 2023-10-14T10:35:51.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.342+0000 7fbeb27fc640 1 -- 172.21.15.8:0/3987581902 learned_addr learned my addr 172.21.15.8:0/3987581902 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:51.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.343+0000 7fbeb2ffd640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb40c43a0 0x7fbeb414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.343+0000 7fbeb37fe640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbeb4151420 0x7fbeb41ec5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.343+0000 7fbeb27fc640 1 -- 172.21.15.8:0/3987581902 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbeb4151420 msgr2=0x7fbeb41ec5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.343+0000 7fbeb27fc640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbeb4151420 0x7fbeb41ec5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.343+0000 7fbeb27fc640 1 -- 172.21.15.8:0/3987581902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb40c43a0 msgr2=0x7fbeb414d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.343+0000 7fbeb27fc640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb40c43a0 0x7fbeb414d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.343+0000 7fbeb27fc640 1 -- 172.21.15.8:0/3987581902 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4009a70 con 0x7fbeb40c5610 2023-10-14T10:35:51.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.343+0000 7fbeb37fe640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbeb4151420 0x7fbeb41ec5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:35:51.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.343+0000 7fbeb27fc640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb40c5610 0x7fbeb4146e40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00c760 tx=0x7fbe9c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:51.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.343+0000 7fbeabfff640 1 -- 172.21.15.8:0/3987581902 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c007270 con 0x7fbeb40c5610 2023-10-14T10:35:51.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.344+0000 7fbeabfff640 1 -- 172.21.15.8:0/3987581902 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c0073d0 con 0x7fbeb40c5610 2023-10-14T10:35:51.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.344+0000 7fbeb3fff640 1 -- 172.21.15.8:0/3987581902 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb4156200 con 0x7fbeb40c5610 2023-10-14T10:35:51.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.344+0000 7fbeabfff640 1 -- 172.21.15.8:0/3987581902 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c001d30 con 0x7fbeb40c5610 2023-10-14T10:35:51.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.344+0000 7fbeb3fff640 1 -- 172.21.15.8:0/3987581902 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb414cbf0 con 0x7fbeb40c5610 2023-10-14T10:35:51.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.345+0000 7fbeb3fff640 1 -- 172.21.15.8:0/3987581902 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb414cd80 con 0x7fbeb40c5610 2023-10-14T10:35:51.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.346+0000 7fbeabfff640 1 -- 172.21.15.8:0/3987581902 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbe9c0047e0 con 0x7fbeb40c5610 2023-10-14T10:35:51.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.347+0000 7fbeabfff640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fbe9406ae70 0x7fbe9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.347+0000 7fbeabfff640 1 -- 172.21.15.8:0/3987581902 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbe9c088430 con 0x7fbeb40c5610 2023-10-14T10:35:51.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.347+0000 7fbeb2ffd640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fbe9406ae70 0x7fbe9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.348+0000 7fbeb2ffd640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fbe9406ae70 0x7fbe9406d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbea4036000 tx=0x7fbea4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:51.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.351+0000 7fbeabfff640 1 -- 172.21.15.8:0/3987581902 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe9c0537f0 con 0x7fbeb40c5610 2023-10-14T10:35:51.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.548+0000 7fbeb3fff640 1 -- 172.21.15.8:0/3987581902 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbeb40c5170 con 0x7fbe9406ae70 2023-10-14T10:35:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.549+0000 7fbeabfff640 1 -- 172.21.15.8:0/3987581902 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbea4043070 con 0x7fbe9406ae70 2023-10-14T10:35:51.552 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T10:35:51.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.552+0000 7fbeb3fff640 1 -- 172.21.15.8:0/3987581902 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fbe9406ae70 msgr2=0x7fbe9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.552+0000 7fbeb3fff640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fbe9406ae70 0x7fbe9406d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbea4036000 tx=0x7fbea4030000 comp rx=0 tx=0).stop 2023-10-14T10:35:51.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.552+0000 7fbeb3fff640 1 -- 172.21.15.8:0/3987581902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb40c5610 msgr2=0x7fbeb4146e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.552+0000 7fbeb3fff640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb40c5610 0x7fbeb4146e40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00c760 tx=0x7fbe9c00cc20 comp rx=0 tx=0).stop 2023-10-14T10:35:51.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.552+0000 7fbeb3fff640 1 -- 172.21.15.8:0/3987581902 shutdown_connections 2023-10-14T10:35:51.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.553+0000 7fbeb3fff640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fbe9406ae70 0x7fbe9406d330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.553+0000 7fbeb3fff640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbeb4151420 0x7fbeb41ec5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.553+0000 7fbeb3fff640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbeb40c5610 0x7fbeb4146e40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.553+0000 7fbeb3fff640 1 --2- 172.21.15.8:0/3987581902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbeb40c43a0 0x7fbeb414d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.553+0000 7fbeb3fff640 1 -- 172.21.15.8:0/3987581902 >> 172.21.15.8:0/3987581902 conn(0x7fbeb40c96c0 msgr2=0x7fbeb414f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:51.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.553+0000 7fbeb3fff640 1 -- 172.21.15.8:0/3987581902 shutdown_connections 2023-10-14T10:35:51.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.553+0000 7fbeb3fff640 1 -- 172.21.15.8:0/3987581902 wait complete. 2023-10-14T10:35:51.574 INFO:tasks.ceph:Scrubbing osd.3 2023-10-14T10:35:51.575 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-14T10:35:51.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.805+0000 7fae35fd7640 1 Processor -- start 2023-10-14T10:35:51.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.805+0000 7fae35fd7640 1 -- start start 2023-10-14T10:35:51.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.806+0000 7fae35fd7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fae30151770 0x7fae30157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.806+0000 7fae35fd7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae300c76d0 0x7fae300c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.806+0000 7fae35fd7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fae300c3f10 0x7fae300c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.806+0000 7fae35fd7640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae300c2ca0 con 0x7fae300c3f10 2023-10-14T10:35:51.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.806+0000 7fae35fd7640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae300c3aa0 con 0x7fae30151770 2023-10-14T10:35:51.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.806+0000 7fae35fd7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3006f600 con 0x7fae300c76d0 2023-10-14T10:35:51.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.806+0000 7fae2ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fae300c3f10 0x7fae300c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.807+0000 7fae2ffff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fae300c3f10 0x7fae300c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44432/0 (socket says 172.21.15.8:44432) 2023-10-14T10:35:51.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.807+0000 7fae2ffff640 1 -- 172.21.15.8:0/2131955281 learned_addr learned my addr 172.21.15.8:0/2131955281 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:51.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.807+0000 7fae2effd640 1 --2- 172.21.15.8:0/2131955281 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae300c76d0 0x7fae300c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.807+0000 7fae2f7fe640 1 --2- 172.21.15.8:0/2131955281 >> v2:172.21.15.92:3300/0 conn(0x7fae30151770 0x7fae30157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.807+0000 7fae2ffff640 1 -- 172.21.15.8:0/2131955281 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae300c76d0 msgr2=0x7fae300c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:51.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.807+0000 7fae2ffff640 1 --2- 172.21.15.8:0/2131955281 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae300c76d0 0x7fae300c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.807+0000 7fae2ffff640 1 -- 172.21.15.8:0/2131955281 >> v2:172.21.15.92:3300/0 conn(0x7fae30151770 msgr2=0x7fae30157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:51.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.807+0000 7fae2ffff640 1 --2- 172.21.15.8:0/2131955281 >> v2:172.21.15.92:3300/0 conn(0x7fae30151770 0x7fae30157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.807+0000 7fae2ffff640 1 -- 172.21.15.8:0/2131955281 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae30158500 con 0x7fae300c3f10 2023-10-14T10:35:51.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.808+0000 7fae2ffff640 1 --2- 172.21.15.8:0/2131955281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae300c3f10 0x7fae300c43a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fae28009870 tx=0x7fae2802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e7698bbfe98bc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:51.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.808+0000 7fae2e7fc640 1 -- 172.21.15.8:0/2131955281 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28031640 con 0x7fae300c3f10 2023-10-14T10:35:51.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.809+0000 7fae2e7fc640 1 -- 172.21.15.8:0/2131955281 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280317a0 con 0x7fae300c3f10 2023-10-14T10:35:51.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.809+0000 7fae2e7fc640 1 -- 172.21.15.8:0/2131955281 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28031b30 con 0x7fae300c3f10 2023-10-14T10:35:51.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.809+0000 7fae35fd7640 1 -- 172.21.15.8:0/2131955281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae300c3f10 msgr2=0x7fae300c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.809+0000 7fae35fd7640 1 --2- 172.21.15.8:0/2131955281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae300c3f10 0x7fae300c43a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fae28009870 tx=0x7fae2802b8f0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.809+0000 7fae35fd7640 1 -- 172.21.15.8:0/2131955281 shutdown_connections 2023-10-14T10:35:51.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.809+0000 7fae35fd7640 1 --2- 172.21.15.8:0/2131955281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae300c3f10 0x7fae300c43a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.809+0000 7fae35fd7640 1 --2- 172.21.15.8:0/2131955281 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae300c76d0 0x7fae300c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.809+0000 7fae35fd7640 1 --2- 172.21.15.8:0/2131955281 >> v2:172.21.15.92:3300/0 conn(0x7fae30151770 0x7fae30157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.809+0000 7fae35fd7640 1 -- 172.21.15.8:0/2131955281 >> 172.21.15.8:0/2131955281 conn(0x7fae30065ab0 msgr2=0x7fae30065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:51.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.809+0000 7fae35fd7640 1 -- 172.21.15.8:0/2131955281 shutdown_connections 2023-10-14T10:35:51.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.809+0000 7fae35fd7640 1 -- 172.21.15.8:0/2131955281 wait complete. 2023-10-14T10:35:51.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.811+0000 7fae35fd7640 1 Processor -- start 2023-10-14T10:35:51.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.811+0000 7fae35fd7640 1 -- start start 2023-10-14T10:35:51.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.812+0000 7fae35fd7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae300c3f10 0x7fae301575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.812+0000 7fae35fd7640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae300c76d0 0x7fae300be770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.812+0000 7fae35fd7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae30151770 0x7fae30154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.812+0000 7fae35fd7640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae300c0880 con 0x7fae300c76d0 2023-10-14T10:35:51.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.812+0000 7fae35fd7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae30157af0 con 0x7fae300c3f10 2023-10-14T10:35:51.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.812+0000 7fae35fd7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae300c2140 con 0x7fae30151770 2023-10-14T10:35:51.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.813+0000 7fae2effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae300c76d0 0x7fae300be770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.813+0000 7fae2effd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae300c76d0 0x7fae300be770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44444/0 (socket says 172.21.15.8:44444) 2023-10-14T10:35:51.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.813+0000 7fae2effd640 1 -- 172.21.15.8:0/36469799 learned_addr learned my addr 172.21.15.8:0/36469799 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:51.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.813+0000 7fae2f7fe640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae300c3f10 0x7fae301575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.813+0000 7fae2ffff640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae30151770 0x7fae30154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.813+0000 7fae2effd640 1 -- 172.21.15.8:0/36469799 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae30151770 msgr2=0x7fae30154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.813+0000 7fae2effd640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fae30151770 0x7fae30154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.813+0000 7fae2effd640 1 -- 172.21.15.8:0/36469799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae300c3f10 msgr2=0x7fae301575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.813+0000 7fae2effd640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae300c3f10 0x7fae301575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.813+0000 7fae2effd640 1 -- 172.21.15.8:0/36469799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae280094d0 con 0x7fae300c76d0 2023-10-14T10:35:51.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.813+0000 7fae2effd640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae300c76d0 0x7fae300be770 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fae20007f20 tx=0x7fae2000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:51.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.814+0000 7fae27fff640 1 -- 172.21.15.8:0/36469799 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20014620 con 0x7fae300c76d0 2023-10-14T10:35:51.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.814+0000 7fae27fff640 1 -- 172.21.15.8:0/36469799 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae20014780 con 0x7fae300c76d0 2023-10-14T10:35:51.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.814+0000 7fae35fd7640 1 -- 172.21.15.8:0/36469799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae30157120 con 0x7fae300c76d0 2023-10-14T10:35:51.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.814+0000 7fae27fff640 1 -- 172.21.15.8:0/36469799 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20014b30 con 0x7fae300c76d0 2023-10-14T10:35:51.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.814+0000 7fae35fd7640 1 -- 172.21.15.8:0/36469799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae301ed200 con 0x7fae300c76d0 2023-10-14T10:35:51.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.815+0000 7fae35fd7640 1 -- 172.21.15.8:0/36469799 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae3006f850 con 0x7fae300c76d0 2023-10-14T10:35:51.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.816+0000 7fae27fff640 1 -- 172.21.15.8:0/36469799 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fae20014c90 con 0x7fae300c76d0 2023-10-14T10:35:51.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.817+0000 7fae27fff640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fae1006ae70 0x7fae1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.817+0000 7fae27fff640 1 -- 172.21.15.8:0/36469799 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fae20089d20 con 0x7fae300c76d0 2023-10-14T10:35:51.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.817+0000 7fae27fff640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] conn(0x7fae10070cd0 0x7fae100730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:51.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.817+0000 7fae27fff640 1 -- 172.21.15.8:0/36469799 --> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae100737a0 con 0x7fae10070cd0 2023-10-14T10:35:51.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.817+0000 7fae27fff640 1 -- 172.21.15.8:0/36469799 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae2008f070 con 0x7fae300c76d0 2023-10-14T10:35:51.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.817+0000 7fae2f7fe640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fae1006ae70 0x7fae1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.817+0000 7fae2ffff640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] conn(0x7fae10070cd0 0x7fae100730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:51.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.818+0000 7fae2f7fe640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fae1006ae70 0x7fae1006d330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fae18006fd0 tx=0x7fae18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:51.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.818+0000 7fae2ffff640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] conn(0x7fae10070cd0 0x7fae100730f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:51.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.819+0000 7fae27fff640 1 -- 172.21.15.8:0/36469799 <== osd.3 v2:172.21.15.8:6816/3324744175 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fae100737a0 con 0x7fae10070cd0 2023-10-14T10:35:51.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.833+0000 7fae35fd7640 1 -- 172.21.15.8:0/36469799 --> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fae300c5a10 con 0x7fae10070cd0 2023-10-14T10:35:51.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.834+0000 7fae27fff640 1 -- 172.21.15.8:0/36469799 <== osd.3 v2:172.21.15.8:6816/3324744175 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fae28004040 con 0x7fae10070cd0 2023-10-14T10:35:51.836 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:51.836 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T10:35:51.837 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:51.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.834+0000 7fae35fd7640 1 -- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] conn(0x7fae10070cd0 msgr2=0x7fae100730f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.834+0000 7fae35fd7640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:6816/3324744175,v1:172.21.15.8:6819/3324744175] conn(0x7fae10070cd0 0x7fae100730f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:51.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.834+0000 7fae35fd7640 1 -- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fae1006ae70 msgr2=0x7fae1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.834+0000 7fae35fd7640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fae1006ae70 0x7fae1006d330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fae18006fd0 tx=0x7fae18008040 comp rx=0 tx=0).stop 2023-10-14T10:35:51.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.834+0000 7fae35fd7640 1 -- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae300c76d0 msgr2=0x7fae300be770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:51.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.834+0000 7fae35fd7640 1 --2- 172.21.15.8:0/36469799 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae300c76d0 0x7fae300be770 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fae20007f20 tx=0x7fae2000e570 comp rx=0 tx=0).stop 2023-10-14T10:35:51.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.834+0000 7fae2ffff640 1 -- 172.21.15.8:0/36469799 reap_dead start 2023-10-14T10:35:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.834+0000 7fae35fd7640 1 -- 172.21.15.8:0/36469799 shutdown_connections 2023-10-14T10:35:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.834+0000 7fae35fd7640 1 -- 172.21.15.8:0/36469799 >> 172.21.15.8:0/36469799 conn(0x7fae30065ab0 msgr2=0x7fae300a8750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.835+0000 7fae35fd7640 1 -- 172.21.15.8:0/36469799 shutdown_connections 2023-10-14T10:35:51.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:51.835+0000 7fae35fd7640 1 -- 172.21.15.8:0/36469799 wait complete. 2023-10-14T10:35:51.853 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-14T10:35:52.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.066+0000 7f05f2075640 1 Processor -- start 2023-10-14T10:35:52.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.067+0000 7f05f2075640 1 -- start start 2023-10-14T10:35:52.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.068+0000 7f05f2075640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05ec0c58f0 0x7f05ec151600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.068+0000 7f05f2075640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec0c25a0 con 0x7f05ec1545a0 2023-10-14T10:35:52.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.068+0000 7f05f2075640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec151b40 con 0x7f05ec06c9b0 2023-10-14T10:35:52.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.068+0000 7f05f2075640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec1550d0 con 0x7f05ec0c58f0 2023-10-14T10:35:52.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.068+0000 7f05eb7fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f05ec1545a0 0x7f05ec06e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43592/0 (socket says 172.21.15.8:43592) 2023-10-14T10:35:52.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.069+0000 7f05eb7fe640 1 -- 172.21.15.8:0/4020161130 learned_addr learned my addr 172.21.15.8:0/4020161130 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:52.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.069+0000 7f05ebfff640 1 --2- 172.21.15.8:0/4020161130 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05ec0c58f0 0x7f05ec151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.069+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800983092 0 0) 0x7f05ec0c25a0 con 0x7f05ec1545a0 2023-10-14T10:35:52.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.069+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d4003520 con 0x7f05ec1545a0 2023-10-14T10:35:52.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.069+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2319141090 0 0) 0x7f05d4003520 con 0x7f05ec1545a0 2023-10-14T10:35:52.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05ec0c58f0 msgr2=0x7f05ec151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:52.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05ea7fc640 1 --2- 172.21.15.8:0/4020161130 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05ec0c58f0 0x7f05ec151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 >> v1:172.21.15.92:6789/0 conn(0x7f05ec06c9b0 legacy=0x7f05ec150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec06ec60 con 0x7f05ec1545a0 2023-10-14T10:35:52.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f05dc001670 con 0x7f05ec1545a0 2023-10-14T10:35:52.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 >> v1:172.21.15.8:6789/0 conn(0x7f05ec1545a0 legacy=0x7f05ec06e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05ea7fc640 1 --2- 172.21.15.8:0/4020161130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05d40039a0 0x7f05d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05ea7fc640 1 --2- 172.21.15.8:0/4020161130 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05ec0c58f0 0x7f05d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05ea7fc640 1 --2- 172.21.15.8:0/4020161130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d4004d00 0x7f05d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec1550d0 con 0x7f05d40039a0 2023-10-14T10:35:52.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d400ba90 con 0x7f05d4004d00 2023-10-14T10:35:52.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d400bc50 con 0x7f05ec0c58f0 2023-10-14T10:35:52.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05eb7fe640 1 --2- 172.21.15.8:0/4020161130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05d40039a0 0x7f05d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05eaffd640 1 --2- 172.21.15.8:0/4020161130 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05ec0c58f0 0x7f05d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05eb7fe640 1 -- 172.21.15.8:0/4020161130 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05ec0c58f0 msgr2=0x7f05d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:52.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05eb7fe640 1 --2- 172.21.15.8:0/4020161130 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05ec0c58f0 0x7f05d40047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05eb7fe640 1 -- 172.21.15.8:0/4020161130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d4004d00 msgr2=0x7f05d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05eb7fe640 1 --2- 172.21.15.8:0/4020161130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d4004d00 0x7f05d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.070+0000 7f05eb7fe640 1 -- 172.21.15.8:0/4020161130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d4003520 con 0x7f05d40039a0 2023-10-14T10:35:52.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.072+0000 7f05eb7fe640 1 --2- 172.21.15.8:0/4020161130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05d40039a0 0x7f05d4003dc0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f05dc001eb0 tx=0x7f05d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96ef2c74050bd82 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:52.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.072+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc005ad0 con 0x7f05d40039a0 2023-10-14T10:35:52.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.072+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc005c50 con 0x7f05d40039a0 2023-10-14T10:35:52.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.072+0000 7f05ea7fc640 1 -- 172.21.15.8:0/4020161130 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc02c7c0 con 0x7f05d40039a0 2023-10-14T10:35:52.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.072+0000 7f05f2075640 1 -- 172.21.15.8:0/4020161130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05d40039a0 msgr2=0x7f05d4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.072+0000 7f05f2075640 1 --2- 172.21.15.8:0/4020161130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05d40039a0 0x7f05d4003dc0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f05dc001eb0 tx=0x7f05d40057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.072+0000 7f05ebfff640 1 -- 172.21.15.8:0/4020161130 reap_dead start 2023-10-14T10:35:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.073+0000 7f05f2075640 1 -- 172.21.15.8:0/4020161130 shutdown_connections 2023-10-14T10:35:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.073+0000 7f05f2075640 1 -- 172.21.15.8:0/4020161130 >> 172.21.15.8:0/4020161130 conn(0x7f05ec0a9280 msgr2=0x7f05ec0a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:52.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.073+0000 7f05f2075640 1 -- 172.21.15.8:0/4020161130 shutdown_connections 2023-10-14T10:35:52.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.073+0000 7f05f2075640 1 -- 172.21.15.8:0/4020161130 wait complete. 2023-10-14T10:35:52.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.074+0000 7f05f2075640 1 Processor -- start 2023-10-14T10:35:52.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.075+0000 7f05f2075640 1 -- start start 2023-10-14T10:35:52.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.075+0000 7f05f2075640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40039a0 0x7f05ec1eca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05f2075640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05ec1ecfb0 0x7f05ec0a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05f2075640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05ec0a83f0 0x7f05ec0c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05f2075640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec0aa570 con 0x7f05ec1ecfb0 2023-10-14T10:35:52.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05f2075640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec155ab0 con 0x7f05d40039a0 2023-10-14T10:35:52.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05f2075640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec155fb0 con 0x7f05ec0a83f0 2023-10-14T10:35:52.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05eaffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05ec1ecfb0 0x7f05ec0a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05eaffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05ec1ecfb0 0x7f05ec0a7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44462/0 (socket says 172.21.15.8:44462) 2023-10-14T10:35:52.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05eaffd640 1 -- 172.21.15.8:0/1284067063 learned_addr learned my addr 172.21.15.8:0/1284067063 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:52.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05eb7fe640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40039a0 0x7f05ec1eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05eaffd640 1 -- 172.21.15.8:0/1284067063 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05ec0a83f0 msgr2=0x7f05ec0c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05eaffd640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05ec0a83f0 0x7f05ec0c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05eaffd640 1 -- 172.21.15.8:0/1284067063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40039a0 msgr2=0x7f05ec1eca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05eaffd640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40039a0 0x7f05ec1eca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.076+0000 7f05eaffd640 1 -- 172.21.15.8:0/1284067063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec156270 con 0x7f05ec1ecfb0 2023-10-14T10:35:52.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.077+0000 7f05eaffd640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05ec1ecfb0 0x7f05ec0a7eb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f05e0001eb0 tx=0x7f05e000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:52.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.077+0000 7f05d3fff640 1 -- 172.21.15.8:0/1284067063 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0005480 con 0x7f05ec1ecfb0 2023-10-14T10:35:52.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.077+0000 7f05d3fff640 1 -- 172.21.15.8:0/1284067063 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0003610 con 0x7f05ec1ecfb0 2023-10-14T10:35:52.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.077+0000 7f05f2075640 1 -- 172.21.15.8:0/1284067063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ec156550 con 0x7f05ec1ecfb0 2023-10-14T10:35:52.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.077+0000 7f05d3fff640 1 -- 172.21.15.8:0/1284067063 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0003980 con 0x7f05ec1ecfb0 2023-10-14T10:35:52.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.077+0000 7f05f2075640 1 -- 172.21.15.8:0/1284067063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ec155740 con 0x7f05ec1ecfb0 2023-10-14T10:35:52.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.078+0000 7f05f2075640 1 -- 172.21.15.8:0/1284067063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec04e9b0 con 0x7f05ec1ecfb0 2023-10-14T10:35:52.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.079+0000 7f05d3fff640 1 -- 172.21.15.8:0/1284067063 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f05e0003ae0 con 0x7f05ec1ecfb0 2023-10-14T10:35:52.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.080+0000 7f05d3fff640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f05d806ae70 0x7f05d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.080+0000 7f05d3fff640 1 -- 172.21.15.8:0/1284067063 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f05e00890c0 con 0x7f05ec1ecfb0 2023-10-14T10:35:52.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.081+0000 7f05eb7fe640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f05d806ae70 0x7f05d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.082+0000 7f05eb7fe640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f05d806ae70 0x7f05d806d330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f05dc034000 tx=0x7f05dc009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:52.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.085+0000 7f05d3fff640 1 -- 172.21.15.8:0/1284067063 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f05e0054500 con 0x7f05ec1ecfb0 2023-10-14T10:35:52.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.276+0000 7f05f2075640 1 -- 172.21.15.8:0/1284067063 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f05ec0c2230 con 0x7f05d806ae70 2023-10-14T10:35:52.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.277+0000 7f05d3fff640 1 -- 172.21.15.8:0/1284067063 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f05dc0058f0 con 0x7f05d806ae70 2023-10-14T10:35:52.279 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 3 to deep-scrub 2023-10-14T10:35:52.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.279+0000 7f05f2075640 1 -- 172.21.15.8:0/1284067063 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f05d806ae70 msgr2=0x7f05d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.279+0000 7f05f2075640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f05d806ae70 0x7f05d806d330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f05dc034000 tx=0x7f05dc009030 comp rx=0 tx=0).stop 2023-10-14T10:35:52.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.279+0000 7f05f2075640 1 -- 172.21.15.8:0/1284067063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05ec1ecfb0 msgr2=0x7f05ec0a7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.279+0000 7f05f2075640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05ec1ecfb0 0x7f05ec0a7eb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f05e0001eb0 tx=0x7f05e000d9d0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.280+0000 7f05f2075640 1 -- 172.21.15.8:0/1284067063 shutdown_connections 2023-10-14T10:35:52.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.280+0000 7f05f2075640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f05d806ae70 0x7f05d806d330 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.280+0000 7f05f2075640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05ec0a83f0 0x7f05ec0c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.280+0000 7f05f2075640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05ec1ecfb0 0x7f05ec0a7eb0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.280+0000 7f05f2075640 1 --2- 172.21.15.8:0/1284067063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40039a0 0x7f05ec1eca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.280+0000 7f05f2075640 1 -- 172.21.15.8:0/1284067063 >> 172.21.15.8:0/1284067063 conn(0x7f05ec0a9280 msgr2=0x7f05ec06b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:52.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.280+0000 7f05f2075640 1 -- 172.21.15.8:0/1284067063 shutdown_connections 2023-10-14T10:35:52.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.280+0000 7f05f2075640 1 -- 172.21.15.8:0/1284067063 wait complete. 2023-10-14T10:35:52.298 INFO:tasks.ceph:Scrubbing osd.4 2023-10-14T10:35:52.299 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-14T10:35:52.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.520+0000 7f026f597640 1 Processor -- start 2023-10-14T10:35:52.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.520+0000 7f026f597640 1 -- start start 2023-10-14T10:35:52.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.522+0000 7f026f597640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0268071d50 0x7f0268154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.522+0000 7f026f597640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0268150ff0 con 0x7f026806cd20 2023-10-14T10:35:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.522+0000 7f026f597640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02681542a0 con 0x7f02680bb9a0 2023-10-14T10:35:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.522+0000 7f026f597640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026814aaf0 con 0x7f0268071d50 2023-10-14T10:35:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.522+0000 7f026db34640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f026806cd20 0x7f026815aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43594/0 (socket says 172.21.15.8:43594) 2023-10-14T10:35:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.522+0000 7f026db34640 1 -- 172.21.15.8:0/536172216 learned_addr learned my addr 172.21.15.8:0/536172216 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:52.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.523+0000 7f026cb32640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0268071d50 0x7f0268154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.523+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055294696 0 0) 0x7f0268150ff0 con 0x7f026806cd20 2023-10-14T10:35:52.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.523+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0254003440 con 0x7f026806cd20 2023-10-14T10:35:52.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.523+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3985391425 0 0) 0x7f0254003440 con 0x7f026806cd20 2023-10-14T10:35:52.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.523+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0268071d50 msgr2=0x7f0268154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:52.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.523+0000 7f025ffff640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0268071d50 0x7f0268154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.523+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 >> v1:172.21.15.92:6789/0 conn(0x7f02680bb9a0 legacy=0x7f02680bfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.523+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0268151520 con 0x7f026806cd20 2023-10-14T10:35:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.523+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f02600019f0 con 0x7f026806cd20 2023-10-14T10:35:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.523+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 >> v1:172.21.15.8:6789/0 conn(0x7f026806cd20 legacy=0x7f026815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.523+0000 7f025ffff640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0254003a90 0x7f0254003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f025ffff640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02540088c0 0x7f025400ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f025ffff640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0268071d50 0x7f025400d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026814aaf0 con 0x7f02540088c0 2023-10-14T10:35:52.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025400ddd0 con 0x7f0254003a90 2023-10-14T10:35:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025400df90 con 0x7f0268071d50 2023-10-14T10:35:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f026cb32640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02540088c0 0x7f025400ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f026db34640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0268071d50 0x7f025400d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f026cb32640 1 -- 172.21.15.8:0/536172216 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0268071d50 msgr2=0x7f025400d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:52.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f026cb32640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0268071d50 0x7f025400d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f026cb32640 1 -- 172.21.15.8:0/536172216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0254003a90 msgr2=0x7f0254003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:52.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f026d333640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0254003a90 0x7f0254003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f026cb32640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0254003a90 0x7f0254003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f026cb32640 1 -- 172.21.15.8:0/536172216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0254003440 con 0x7f02540088c0 2023-10-14T10:35:52.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.524+0000 7f026d333640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0254003a90 0x7f0254003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:52.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.526+0000 7f026cb32640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02540088c0 0x7f025400ad50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0258009a90 tx=0x7f02540036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb83d6cf2b3fe7a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:52.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.526+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025802c680 con 0x7f02540088c0 2023-10-14T10:35:52.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.526+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025802c7e0 con 0x7f02540088c0 2023-10-14T10:35:52.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.526+0000 7f025ffff640 1 -- 172.21.15.8:0/536172216 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025802cb90 con 0x7f02540088c0 2023-10-14T10:35:52.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.526+0000 7f026f597640 1 -- 172.21.15.8:0/536172216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02540088c0 msgr2=0x7f025400ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.526+0000 7f026f597640 1 --2- 172.21.15.8:0/536172216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02540088c0 0x7f025400ad50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0258009a90 tx=0x7f02540036f0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.526+0000 7f026db34640 1 -- 172.21.15.8:0/536172216 reap_dead start 2023-10-14T10:35:52.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.527+0000 7f026f597640 1 -- 172.21.15.8:0/536172216 shutdown_connections 2023-10-14T10:35:52.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.527+0000 7f026f597640 1 -- 172.21.15.8:0/536172216 >> 172.21.15.8:0/536172216 conn(0x7f0268069de0 msgr2=0x7f026806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:52.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.527+0000 7f026f597640 1 -- 172.21.15.8:0/536172216 shutdown_connections 2023-10-14T10:35:52.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.527+0000 7f026f597640 1 -- 172.21.15.8:0/536172216 wait complete. 2023-10-14T10:35:52.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.529+0000 7f026f597640 1 Processor -- start 2023-10-14T10:35:52.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.529+0000 7f026f597640 1 -- start start 2023-10-14T10:35:52.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026f597640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02540088c0 0x7f026814a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026f597640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0268150020 0x7f02681dc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026f597640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02680be1a0 0x7f02680be620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026f597640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02681dcd70 con 0x7f02540088c0 2023-10-14T10:35:52.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026f597640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02681504a0 con 0x7f02680be1a0 2023-10-14T10:35:52.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026f597640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0268148100 con 0x7f0268150020 2023-10-14T10:35:52.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026d333640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02540088c0 0x7f026814a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026d333640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02540088c0 0x7f026814a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44482/0 (socket says 172.21.15.8:44482) 2023-10-14T10:35:52.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026d333640 1 -- 172.21.15.8:0/3149610616 learned_addr learned my addr 172.21.15.8:0/3149610616 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:52.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026d333640 1 -- 172.21.15.8:0/3149610616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0268150020 msgr2=0x7f02681dc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026d333640 1 --2- 172.21.15.8:0/3149610616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0268150020 0x7f02681dc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026d333640 1 -- 172.21.15.8:0/3149610616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02680be1a0 msgr2=0x7f02680be620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026d333640 1 --2- 172.21.15.8:0/3149610616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02680be1a0 0x7f02680be620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.530+0000 7f026d333640 1 -- 172.21.15.8:0/3149610616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02681483e0 con 0x7f02540088c0 2023-10-14T10:35:52.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.531+0000 7f026d333640 1 --2- 172.21.15.8:0/3149610616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02540088c0 0x7f026814a2e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f026400d5f0 tx=0x7f026400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:52.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.531+0000 7f025dffb640 1 -- 172.21.15.8:0/3149610616 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0264017070 con 0x7f02540088c0 2023-10-14T10:35:52.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.531+0000 7f025dffb640 1 -- 172.21.15.8:0/3149610616 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0264005280 con 0x7f02540088c0 2023-10-14T10:35:52.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.531+0000 7f025dffb640 1 -- 172.21.15.8:0/3149610616 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0264006820 con 0x7f02540088c0 2023-10-14T10:35:52.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.531+0000 7f026f597640 1 -- 172.21.15.8:0/3149610616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02681486c0 con 0x7f02540088c0 2023-10-14T10:35:52.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.531+0000 7f026f597640 1 -- 172.21.15.8:0/3149610616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0268148c80 con 0x7f02540088c0 2023-10-14T10:35:52.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.532+0000 7f026f597640 1 -- 172.21.15.8:0/3149610616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f02680c0550 con 0x7f02540088c0 2023-10-14T10:35:52.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.533+0000 7f025dffb640 1 -- 172.21.15.8:0/3149610616 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0264006980 con 0x7f02540088c0 2023-10-14T10:35:52.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.534+0000 7f025dffb640 1 --2- 172.21.15.8:0/3149610616 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f024c06aea0 0x7f024c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.534+0000 7f025dffb640 1 -- 172.21.15.8:0/3149610616 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0264088b60 con 0x7f02540088c0 2023-10-14T10:35:52.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.534+0000 7f025dffb640 1 --2- 172.21.15.8:0/3149610616 >> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] conn(0x7f024c070d00 0x7f024c073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.534+0000 7f025dffb640 1 -- 172.21.15.8:0/3149610616 --> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f024c0737d0 con 0x7f024c070d00 2023-10-14T10:35:52.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.534+0000 7f025dffb640 1 -- 172.21.15.8:0/3149610616 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f026408d240 con 0x7f02540088c0 2023-10-14T10:35:52.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.534+0000 7f026cb32640 1 --2- 172.21.15.8:0/3149610616 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f024c06aea0 0x7f024c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.535+0000 7f026db34640 1 --2- 172.21.15.8:0/3149610616 >> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] conn(0x7f024c070d00 0x7f024c073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.535+0000 7f026cb32640 1 --2- 172.21.15.8:0/3149610616 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f024c06aea0 0x7f024c06d360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0258036000 tx=0x7f025802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:52.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.536+0000 7f026db34640 1 --2- 172.21.15.8:0/3149610616 >> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] conn(0x7f024c070d00 0x7f024c073120 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:52.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.538+0000 7f025dffb640 1 -- 172.21.15.8:0/3149610616 <== osd.4 v2:172.21.15.92:6800/90605776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f024c0737d0 con 0x7f024c070d00 2023-10-14T10:35:52.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.552+0000 7f026f597640 1 -- 172.21.15.8:0/3149610616 --> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0268153c90 con 0x7f024c070d00 2023-10-14T10:35:52.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.553+0000 7f025dffb640 1 -- 172.21.15.8:0/3149610616 <== osd.4 v2:172.21.15.92:6800/90605776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0260002070 con 0x7f024c070d00 2023-10-14T10:35:52.555 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:52.556 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T10:35:52.556 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:52.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.554+0000 7f026f597640 1 -- 172.21.15.8:0/3149610616 >> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] conn(0x7f024c070d00 msgr2=0x7f024c073120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.554+0000 7f026f597640 1 --2- 172.21.15.8:0/3149610616 >> [v2:172.21.15.92:6800/90605776,v1:172.21.15.92:6801/90605776] conn(0x7f024c070d00 0x7f024c073120 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.554+0000 7f026f597640 1 -- 172.21.15.8:0/3149610616 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f024c06aea0 msgr2=0x7f024c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.554+0000 7f026f597640 1 --2- 172.21.15.8:0/3149610616 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f024c06aea0 0x7f024c06d360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0258036000 tx=0x7f025802e000 comp rx=0 tx=0).stop 2023-10-14T10:35:52.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.554+0000 7f026f597640 1 -- 172.21.15.8:0/3149610616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02540088c0 msgr2=0x7f026814a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.554+0000 7f026f597640 1 --2- 172.21.15.8:0/3149610616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02540088c0 0x7f026814a2e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f026400d5f0 tx=0x7f026400dab0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.554+0000 7f026db34640 1 -- 172.21.15.8:0/3149610616 reap_dead start 2023-10-14T10:35:52.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.554+0000 7f026f597640 1 -- 172.21.15.8:0/3149610616 shutdown_connections 2023-10-14T10:35:52.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.554+0000 7f026f597640 1 -- 172.21.15.8:0/3149610616 >> 172.21.15.8:0/3149610616 conn(0x7f0268069de0 msgr2=0x7f02680c5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:52.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.554+0000 7f026f597640 1 -- 172.21.15.8:0/3149610616 shutdown_connections 2023-10-14T10:35:52.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.555+0000 7f026f597640 1 -- 172.21.15.8:0/3149610616 wait complete. 2023-10-14T10:35:52.575 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-14T10:35:52.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.793+0000 7f481ee83640 1 Processor -- start 2023-10-14T10:35:52.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.794+0000 7f481ee83640 1 -- start start 2023-10-14T10:35:52.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.795+0000 7f481ee83640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4818151420 0x7f48180c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.795+0000 7f481ee83640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48180c43a0 0x7f48180c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.795+0000 7f481ee83640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48180c4e30 con 0x7f48180c5610 2023-10-14T10:35:52.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.795+0000 7f481ee83640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48180c5450 con 0x7f4818151420 2023-10-14T10:35:52.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.795+0000 7f481ee83640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4818154950 con 0x7f48180c43a0 2023-10-14T10:35:52.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.796+0000 7f481de81640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4818151420 0x7f48180c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.796+0000 7f481e682640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f48180c5610 0x7f481806ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43608/0 (socket says 172.21.15.8:43608) 2023-10-14T10:35:52.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.796+0000 7f481de81640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4818151420 0x7f48180c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44486/0 (socket says 172.21.15.8:44486) 2023-10-14T10:35:52.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.796+0000 7f481e682640 1 -- 172.21.15.8:0/2621565953 learned_addr learned my addr 172.21.15.8:0/2621565953 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.796+0000 7f481d680640 1 --2- 172.21.15.8:0/2621565953 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48180c43a0 0x7f48180c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.796+0000 7f481de81640 1 -- 172.21.15.8:0/2621565953 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48180c43a0 msgr2=0x7f48180c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.796+0000 7f481de81640 1 --2- 172.21.15.8:0/2621565953 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48180c43a0 0x7f48180c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.796+0000 7f481ce7f640 1 -- 172.21.15.8:0/2621565953 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997448684 0 0) 0x7f4810001490 con 0x7f48180c5610 2023-10-14T10:35:52.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.796+0000 7f481de81640 1 -- 172.21.15.8:0/2621565953 >> v1:172.21.15.8:6789/0 conn(0x7f48180c5610 legacy=0x7f481806ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.796+0000 7f481de81640 1 -- 172.21.15.8:0/2621565953 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48180c5d00 con 0x7f4818151420 2023-10-14T10:35:52.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.796+0000 7f481d680640 1 --2- 172.21.15.8:0/2621565953 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48180c43a0 0x7f48180c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.797+0000 7f481de81640 1 --2- 172.21.15.8:0/2621565953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4818151420 0x7f48180c48f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f48080097a0 tx=0x7f480802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664ba093450954aa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.798+0000 7f481ce7f640 1 -- 172.21.15.8:0/2621565953 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808031780 con 0x7f4818151420 2023-10-14T10:35:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.798+0000 7f481ce7f640 1 -- 172.21.15.8:0/2621565953 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48080318e0 con 0x7f4818151420 2023-10-14T10:35:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.798+0000 7f481ce7f640 1 -- 172.21.15.8:0/2621565953 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808031c70 con 0x7f4818151420 2023-10-14T10:35:52.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.798+0000 7f481ee83640 1 -- 172.21.15.8:0/2621565953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4818151420 msgr2=0x7f48180c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.798+0000 7f481ee83640 1 --2- 172.21.15.8:0/2621565953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4818151420 0x7f48180c48f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f48080097a0 tx=0x7f480802b820 comp rx=0 tx=0).stop 2023-10-14T10:35:52.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.798+0000 7f481ee83640 1 -- 172.21.15.8:0/2621565953 shutdown_connections 2023-10-14T10:35:52.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.798+0000 7f481ee83640 1 --2- 172.21.15.8:0/2621565953 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48180c43a0 0x7f48180c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.798+0000 7f481ee83640 1 --2- 172.21.15.8:0/2621565953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4818151420 0x7f48180c48f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.798+0000 7f481ee83640 1 -- 172.21.15.8:0/2621565953 >> 172.21.15.8:0/2621565953 conn(0x7f48180c96c0 msgr2=0x7f48180c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:52.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.798+0000 7f481ee83640 1 -- 172.21.15.8:0/2621565953 shutdown_connections 2023-10-14T10:35:52.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.798+0000 7f481ee83640 1 -- 172.21.15.8:0/2621565953 wait complete. 2023-10-14T10:35:52.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.800+0000 7f481ee83640 1 Processor -- start 2023-10-14T10:35:52.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.800+0000 7f481ee83640 1 -- start start 2023-10-14T10:35:52.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481ee83640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48180c43a0 0x7f481814cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481ee83640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48180c5610 0x7f48180acc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481ee83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4818151420 0x7f4818146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481ee83640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48180ac4b0 con 0x7f48180c5610 2023-10-14T10:35:52.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481ee83640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48180ae8a0 con 0x7f4818151420 2023-10-14T10:35:52.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481ee83640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48180af440 con 0x7f48180c43a0 2023-10-14T10:35:52.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481d680640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48180c5610 0x7f48180acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481d680640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48180c5610 0x7f48180acc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44498/0 (socket says 172.21.15.8:44498) 2023-10-14T10:35:52.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481d680640 1 -- 172.21.15.8:0/2658615910 learned_addr learned my addr 172.21.15.8:0/2658615910 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:52.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481d680640 1 -- 172.21.15.8:0/2658615910 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48180c43a0 msgr2=0x7f481814cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481d680640 1 --2- 172.21.15.8:0/2658615910 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48180c43a0 0x7f481814cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481d680640 1 -- 172.21.15.8:0/2658615910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4818151420 msgr2=0x7f4818146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:52.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481d680640 1 --2- 172.21.15.8:0/2658615910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4818151420 0x7f4818146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:52.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.801+0000 7f481d680640 1 -- 172.21.15.8:0/2658615910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4808009400 con 0x7f48180c5610 2023-10-14T10:35:52.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.802+0000 7f481d680640 1 --2- 172.21.15.8:0/2658615910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48180c5610 0x7f48180acc30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f480c00c7f0 tx=0x7f480c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:52.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.802+0000 7f48167fc640 1 -- 172.21.15.8:0/2658615910 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c007a30 con 0x7f48180c5610 2023-10-14T10:35:52.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.802+0000 7f48167fc640 1 -- 172.21.15.8:0/2658615910 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c007b90 con 0x7f48180c5610 2023-10-14T10:35:52.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.802+0000 7f48167fc640 1 -- 172.21.15.8:0/2658615910 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c00ce40 con 0x7f48180c5610 2023-10-14T10:35:52.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.802+0000 7f481ee83640 1 -- 172.21.15.8:0/2658615910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48180aeb10 con 0x7f48180c5610 2023-10-14T10:35:52.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.802+0000 7f481ee83640 1 -- 172.21.15.8:0/2658615910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48180af0d0 con 0x7f48180c5610 2023-10-14T10:35:52.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.803+0000 7f481ee83640 1 -- 172.21.15.8:0/2658615910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48180619f0 con 0x7f48180c5610 2023-10-14T10:35:52.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.804+0000 7f48167fc640 1 -- 172.21.15.8:0/2658615910 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f480c0113f0 con 0x7f48180c5610 2023-10-14T10:35:52.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.805+0000 7f48167fc640 1 --2- 172.21.15.8:0/2658615910 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f480406ae70 0x7f480406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:52.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.805+0000 7f48167fc640 1 -- 172.21.15.8:0/2658615910 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f480c0894c0 con 0x7f48180c5610 2023-10-14T10:35:52.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.805+0000 7f481de81640 1 --2- 172.21.15.8:0/2658615910 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f480406ae70 0x7f480406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:52.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.806+0000 7f481de81640 1 --2- 172.21.15.8:0/2658615910 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f480406ae70 0x7f480406d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4808036000 tx=0x7f4808030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:52.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:52.810+0000 7f48167fc640 1 -- 172.21.15.8:0/2658615910 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f480c054860 con 0x7f48180c5610 2023-10-14T10:35:53.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.002+0000 7f481ee83640 1 -- 172.21.15.8:0/2658615910 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4818154b50 con 0x7f480406ae70 2023-10-14T10:35:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.003+0000 7f48167fc640 1 -- 172.21.15.8:0/2658615910 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4808031a50 con 0x7f480406ae70 2023-10-14T10:35:53.005 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 4 to deep-scrub 2023-10-14T10:35:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.005+0000 7f481ee83640 1 -- 172.21.15.8:0/2658615910 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f480406ae70 msgr2=0x7f480406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.005+0000 7f481ee83640 1 --2- 172.21.15.8:0/2658615910 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f480406ae70 0x7f480406d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4808036000 tx=0x7f4808030000 comp rx=0 tx=0).stop 2023-10-14T10:35:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.005+0000 7f481ee83640 1 -- 172.21.15.8:0/2658615910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48180c5610 msgr2=0x7f48180acc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.005+0000 7f481ee83640 1 --2- 172.21.15.8:0/2658615910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48180c5610 0x7f48180acc30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f480c00c7f0 tx=0x7f480c00cbf0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.005+0000 7f481ee83640 1 -- 172.21.15.8:0/2658615910 shutdown_connections 2023-10-14T10:35:53.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.005+0000 7f481ee83640 1 --2- 172.21.15.8:0/2658615910 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f480406ae70 0x7f480406d330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.005+0000 7f481ee83640 1 --2- 172.21.15.8:0/2658615910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4818151420 0x7f4818146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.005+0000 7f481ee83640 1 --2- 172.21.15.8:0/2658615910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48180c5610 0x7f48180acc30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.005+0000 7f481ee83640 1 --2- 172.21.15.8:0/2658615910 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48180c43a0 0x7f481814cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.005+0000 7f481ee83640 1 -- 172.21.15.8:0/2658615910 >> 172.21.15.8:0/2658615910 conn(0x7f48180c96c0 msgr2=0x7f48180732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:53.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.005+0000 7f481ee83640 1 -- 172.21.15.8:0/2658615910 shutdown_connections 2023-10-14T10:35:53.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.005+0000 7f481ee83640 1 -- 172.21.15.8:0/2658615910 wait complete. 2023-10-14T10:35:53.025 INFO:tasks.ceph:Scrubbing osd.5 2023-10-14T10:35:53.026 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-14T10:35:53.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.246+0000 7f7576c56640 1 Processor -- start 2023-10-14T10:35:53.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.246+0000 7f7576c56640 1 -- start start 2023-10-14T10:35:53.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.248+0000 7f7576c56640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f75700c7040 0x7f75700bdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.248+0000 7f7576c56640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75700bc5a0 0x7f75701576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.248+0000 7f7576c56640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757006fc50 con 0x7f75701517b0 2023-10-14T10:35:53.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.248+0000 7f7576c56640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7570154e40 con 0x7f75700c7040 2023-10-14T10:35:53.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.248+0000 7f7576c56640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757006ff30 con 0x7f75700bc5a0 2023-10-14T10:35:53.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.248+0000 7f75749f2640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f75701517b0 0x7f75700a92c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43618/0 (socket says 172.21.15.8:43618) 2023-10-14T10:35:53.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.248+0000 7f75749f2640 1 -- 172.21.15.8:0/3080102423 learned_addr learned my addr 172.21.15.8:0/3080102423 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:53.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.248+0000 7f75751f3640 1 --2- 172.21.15.8:0/3080102423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75700bc5a0 0x7f75701576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.248+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983313412 0 0) 0x7f757006fc50 con 0x7f75701517b0 2023-10-14T10:35:53.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7560003520 con 0x7f75701517b0 2023-10-14T10:35:53.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756ffff640 1 --2- 172.21.15.8:0/3080102423 >> v2:172.21.15.92:3300/0 conn(0x7f75700c7040 0x7f75700bdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3912531054 0 0) 0x7f7560003520 con 0x7f75701517b0 2023-10-14T10:35:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75700bc5a0 msgr2=0x7f75701576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:53.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 --2- 172.21.15.8:0/3080102423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75700bc5a0 0x7f75701576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 >> v2:172.21.15.92:3300/0 conn(0x7f75700c7040 msgr2=0x7f75700bdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 --2- 172.21.15.8:0/3080102423 >> v2:172.21.15.92:3300/0 conn(0x7f75700c7040 0x7f75700bdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75700bca80 con 0x7f75701517b0 2023-10-14T10:35:53.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f75640019f0 con 0x7f75701517b0 2023-10-14T10:35:53.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 >> v1:172.21.15.8:6789/0 conn(0x7f75701517b0 legacy=0x7f75700a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 --2- 172.21.15.8:0/3080102423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7560003970 0x7f7560003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 --2- 172.21.15.8:0/3080102423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75600047c0 0x7f7560004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 --2- 172.21.15.8:0/3080102423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75700bc5a0 0x7f7560005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7570154e40 con 0x7f75600047c0 2023-10-14T10:35:53.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757006ff30 con 0x7f7560003970 2023-10-14T10:35:53.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756000b980 con 0x7f75700bc5a0 2023-10-14T10:35:53.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.249+0000 7f756ffff640 1 --2- 172.21.15.8:0/3080102423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75600047c0 0x7f7560004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.250+0000 7f75749f2640 1 --2- 172.21.15.8:0/3080102423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7560003970 0x7f7560003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.250+0000 7f756ffff640 1 -- 172.21.15.8:0/3080102423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75700bc5a0 msgr2=0x7f7560005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:53.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.250+0000 7f756ffff640 1 --2- 172.21.15.8:0/3080102423 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75700bc5a0 0x7f7560005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.250+0000 7f756ffff640 1 -- 172.21.15.8:0/3080102423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7560003970 msgr2=0x7f7560003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:53.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.250+0000 7f756ffff640 1 --2- 172.21.15.8:0/3080102423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7560003970 0x7f7560003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.250+0000 7f756ffff640 1 -- 172.21.15.8:0/3080102423 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7560003520 con 0x7f75600047c0 2023-10-14T10:35:53.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.250+0000 7f75749f2640 1 --2- 172.21.15.8:0/3080102423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7560003970 0x7f7560003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:53.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.251+0000 7f756ffff640 1 --2- 172.21.15.8:0/3080102423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75600047c0 0x7f7560004c40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f755c009ac0 tx=0x7f75600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fbcad421956d21 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:53.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.251+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c02c6d0 con 0x7f75600047c0 2023-10-14T10:35:53.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.252+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c02c830 con 0x7f75600047c0 2023-10-14T10:35:53.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.252+0000 7f756f7fe640 1 -- 172.21.15.8:0/3080102423 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c02cbc0 con 0x7f75600047c0 2023-10-14T10:35:53.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.252+0000 7f7576c56640 1 -- 172.21.15.8:0/3080102423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75600047c0 msgr2=0x7f7560004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.252+0000 7f7576c56640 1 --2- 172.21.15.8:0/3080102423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75600047c0 0x7f7560004c40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f755c009ac0 tx=0x7f75600057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.252+0000 7f75751f3640 1 -- 172.21.15.8:0/3080102423 reap_dead start 2023-10-14T10:35:53.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.252+0000 7f7576c56640 1 -- 172.21.15.8:0/3080102423 shutdown_connections 2023-10-14T10:35:53.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.252+0000 7f7576c56640 1 -- 172.21.15.8:0/3080102423 >> 172.21.15.8:0/3080102423 conn(0x7f75700c76e0 msgr2=0x7f75700c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:53.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.253+0000 7f7576c56640 1 -- 172.21.15.8:0/3080102423 shutdown_connections 2023-10-14T10:35:53.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.253+0000 7f7576c56640 1 -- 172.21.15.8:0/3080102423 wait complete. 2023-10-14T10:35:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.254+0000 7f7576c56640 1 Processor -- start 2023-10-14T10:35:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.255+0000 7f7576c56640 1 -- start start 2023-10-14T10:35:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.255+0000 7f7576c56640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75600047c0 0x7f75701e9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.255+0000 7f7576c56640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75700aca60 0x7f7570156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.255+0000 7f7576c56640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75701565e0 0x7f75701eca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.255+0000 7f7576c56640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7570150220 con 0x7f75600047c0 2023-10-14T10:35:53.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.255+0000 7f7576c56640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75700bea50 con 0x7f75701565e0 2023-10-14T10:35:53.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.255+0000 7f7576c56640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75700c14f0 con 0x7f75700aca60 2023-10-14T10:35:53.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.256+0000 7f75749f2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75600047c0 0x7f75701e9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.256+0000 7f75749f2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75600047c0 0x7f75701e9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44516/0 (socket says 172.21.15.8:44516) 2023-10-14T10:35:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.256+0000 7f75749f2640 1 -- 172.21.15.8:0/2461323380 learned_addr learned my addr 172.21.15.8:0/2461323380 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.256+0000 7f75749f2640 1 -- 172.21.15.8:0/2461323380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75700aca60 msgr2=0x7f7570156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.256+0000 7f75749f2640 1 --2- 172.21.15.8:0/2461323380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75700aca60 0x7f7570156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.256+0000 7f75749f2640 1 -- 172.21.15.8:0/2461323380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75701565e0 msgr2=0x7f75701eca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.256+0000 7f75749f2640 1 --2- 172.21.15.8:0/2461323380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75701565e0 0x7f75701eca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.256+0000 7f75749f2640 1 -- 172.21.15.8:0/2461323380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7570150680 con 0x7f75600047c0 2023-10-14T10:35:53.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.256+0000 7f75749f2640 1 --2- 172.21.15.8:0/2461323380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75600047c0 0x7f75701e9b10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7564001370 tx=0x7f756400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:53.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.257+0000 7f756d7fa640 1 -- 172.21.15.8:0/2461323380 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7564004b60 con 0x7f75600047c0 2023-10-14T10:35:53.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.257+0000 7f756d7fa640 1 -- 172.21.15.8:0/2461323380 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7564004cc0 con 0x7f75600047c0 2023-10-14T10:35:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.257+0000 7f7576c56640 1 -- 172.21.15.8:0/2461323380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757014f980 con 0x7f75600047c0 2023-10-14T10:35:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.257+0000 7f756d7fa640 1 -- 172.21.15.8:0/2461323380 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75640072d0 con 0x7f75600047c0 2023-10-14T10:35:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.257+0000 7f7576c56640 1 -- 172.21.15.8:0/2461323380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757014ff40 con 0x7f75600047c0 2023-10-14T10:35:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.258+0000 7f7576c56640 1 -- 172.21.15.8:0/2461323380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75701548f0 con 0x7f75600047c0 2023-10-14T10:35:53.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.259+0000 7f756d7fa640 1 -- 172.21.15.8:0/2461323380 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7564007430 con 0x7f75600047c0 2023-10-14T10:35:53.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.260+0000 7f756d7fa640 1 --2- 172.21.15.8:0/2461323380 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f755406ae70 0x7f755406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.260+0000 7f756d7fa640 1 -- 172.21.15.8:0/2461323380 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7564089670 con 0x7f75600047c0 2023-10-14T10:35:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.260+0000 7f756d7fa640 1 --2- 172.21.15.8:0/2461323380 >> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] conn(0x7f7554070cd0 0x7f75540730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.260+0000 7f756d7fa640 1 -- 172.21.15.8:0/2461323380 --> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75540737a0 con 0x7f7554070cd0 2023-10-14T10:35:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.260+0000 7f756d7fa640 1 -- 172.21.15.8:0/2461323380 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f756408bc50 con 0x7f75600047c0 2023-10-14T10:35:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.260+0000 7f756ffff640 1 --2- 172.21.15.8:0/2461323380 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f755406ae70 0x7f755406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.261+0000 7f756ffff640 1 --2- 172.21.15.8:0/2461323380 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f755406ae70 0x7f755406d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f755c036000 tx=0x7f755c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.261+0000 7f75751f3640 1 --2- 172.21.15.8:0/2461323380 >> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] conn(0x7f7554070cd0 0x7f75540730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.262+0000 7f75751f3640 1 --2- 172.21.15.8:0/2461323380 >> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] conn(0x7f7554070cd0 0x7f75540730f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:53.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.264+0000 7f756d7fa640 1 -- 172.21.15.8:0/2461323380 <== osd.5 v2:172.21.15.92:6808/995873713 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f75540737a0 con 0x7f7554070cd0 2023-10-14T10:35:53.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.278+0000 7f7576c56640 1 -- 172.21.15.8:0/2461323380 --> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7570073b50 con 0x7f7554070cd0 2023-10-14T10:35:53.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.279+0000 7f756d7fa640 1 -- 172.21.15.8:0/2461323380 <== osd.5 v2:172.21.15.92:6808/995873713 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7570073b50 con 0x7f7554070cd0 2023-10-14T10:35:53.281 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:53.282 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T10:35:53.282 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:53.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.279+0000 7f7576c56640 1 -- 172.21.15.8:0/2461323380 >> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] conn(0x7f7554070cd0 msgr2=0x7f75540730f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.279+0000 7f7576c56640 1 --2- 172.21.15.8:0/2461323380 >> [v2:172.21.15.92:6808/995873713,v1:172.21.15.92:6811/995873713] conn(0x7f7554070cd0 0x7f75540730f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.279+0000 7f7576c56640 1 -- 172.21.15.8:0/2461323380 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f755406ae70 msgr2=0x7f755406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.279+0000 7f7576c56640 1 --2- 172.21.15.8:0/2461323380 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f755406ae70 0x7f755406d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f755c036000 tx=0x7f755c02e000 comp rx=0 tx=0).stop 2023-10-14T10:35:53.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.279+0000 7f7576c56640 1 -- 172.21.15.8:0/2461323380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75600047c0 msgr2=0x7f75701e9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.279+0000 7f7576c56640 1 --2- 172.21.15.8:0/2461323380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75600047c0 0x7f75701e9b10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7564001370 tx=0x7f756400b4a0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.279+0000 7f75751f3640 1 -- 172.21.15.8:0/2461323380 reap_dead start 2023-10-14T10:35:53.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.279+0000 7f7576c56640 1 -- 172.21.15.8:0/2461323380 shutdown_connections 2023-10-14T10:35:53.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.279+0000 7f7576c56640 1 -- 172.21.15.8:0/2461323380 >> 172.21.15.8:0/2461323380 conn(0x7f75700c76e0 msgr2=0x7f75700ad0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:53.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.280+0000 7f7576c56640 1 -- 172.21.15.8:0/2461323380 shutdown_connections 2023-10-14T10:35:53.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.280+0000 7f7576c56640 1 -- 172.21.15.8:0/2461323380 wait complete. 2023-10-14T10:35:53.299 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-14T10:35:53.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.521+0000 7f8f6eada640 1 Processor -- start 2023-10-14T10:35:53.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.521+0000 7f8f6eada640 1 -- start start 2023-10-14T10:35:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.524+0000 7f8f6eada640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8f681591e0 0x7f8f681599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.524+0000 7f8f6eada640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f68159f20 0x7f8f680c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.524+0000 7f8f6eada640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f680a8a40 con 0x7f8f681559f0 2023-10-14T10:35:53.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.524+0000 7f8f6eada640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f680aaa10 con 0x7f8f681591e0 2023-10-14T10:35:53.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.524+0000 7f8f6eada640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f681584f0 con 0x7f8f68159f20 2023-10-14T10:35:53.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.525+0000 7f8f6c876640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f8f681559f0 0x7f8f680aa300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43630/0 (socket says 172.21.15.8:43630) 2023-10-14T10:35:53.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.525+0000 7f8f6c876640 1 -- 172.21.15.8:0/893212468 learned_addr learned my addr 172.21.15.8:0/893212468 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.525+0000 7f8f6d077640 1 --2- 172.21.15.8:0/893212468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f68159f20 0x7f8f680c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.525+0000 7f8f67fff640 1 --2- 172.21.15.8:0/893212468 >> v2:172.21.15.92:3300/0 conn(0x7f8f681591e0 0x7f8f681599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.526+0000 7f8f6d077640 1 -- 172.21.15.8:0/893212468 >> v2:172.21.15.92:3300/0 conn(0x7f8f681591e0 msgr2=0x7f8f681599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.526+0000 7f8f6d077640 1 --2- 172.21.15.8:0/893212468 >> v2:172.21.15.92:3300/0 conn(0x7f8f681591e0 0x7f8f681599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.526+0000 7f8f6d077640 1 -- 172.21.15.8:0/893212468 >> v1:172.21.15.8:6789/0 conn(0x7f8f681559f0 legacy=0x7f8f680aa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.526+0000 7f8f6d077640 1 -- 172.21.15.8:0/893212468 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f68158700 con 0x7f8f68159f20 2023-10-14T10:35:53.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.527+0000 7f8f6d077640 1 --2- 172.21.15.8:0/893212468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f68159f20 0x7f8f680c57a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009d90 tx=0x7f8f6002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfc5cf42c84097fb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:53.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.530+0000 7f8f677fe640 1 -- 172.21.15.8:0/893212468 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6002cbd0 con 0x7f8f68159f20 2023-10-14T10:35:53.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.530+0000 7f8f677fe640 1 -- 172.21.15.8:0/893212468 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6002cd30 con 0x7f8f68159f20 2023-10-14T10:35:53.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.530+0000 7f8f677fe640 1 -- 172.21.15.8:0/893212468 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6002cea0 con 0x7f8f68159f20 2023-10-14T10:35:53.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.531+0000 7f8f6eada640 1 -- 172.21.15.8:0/893212468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f68159f20 msgr2=0x7f8f680c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.531+0000 7f8f6eada640 1 --2- 172.21.15.8:0/893212468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f68159f20 0x7f8f680c57a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009d90 tx=0x7f8f6002be20 comp rx=0 tx=0).stop 2023-10-14T10:35:53.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.531+0000 7f8f6eada640 1 -- 172.21.15.8:0/893212468 shutdown_connections 2023-10-14T10:35:53.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.531+0000 7f8f6eada640 1 --2- 172.21.15.8:0/893212468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f68159f20 0x7f8f680c57a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.531+0000 7f8f6eada640 1 --2- 172.21.15.8:0/893212468 >> v2:172.21.15.92:3300/0 conn(0x7f8f681591e0 0x7f8f681599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.531+0000 7f8f6eada640 1 -- 172.21.15.8:0/893212468 >> 172.21.15.8:0/893212468 conn(0x7f8f680a74d0 msgr2=0x7f8f680a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:53.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.531+0000 7f8f6eada640 1 -- 172.21.15.8:0/893212468 shutdown_connections 2023-10-14T10:35:53.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.531+0000 7f8f6eada640 1 -- 172.21.15.8:0/893212468 wait complete. 2023-10-14T10:35:53.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.533+0000 7f8f6eada640 1 Processor -- start 2023-10-14T10:35:53.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.533+0000 7f8f6eada640 1 -- start start 2023-10-14T10:35:53.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.534+0000 7f8f6eada640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f681559f0 0x7f8f680bbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.534+0000 7f8f6eada640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f681591e0 0x7f8f680bee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.534+0000 7f8f6eada640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f68159f20 0x7f8f680bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.534+0000 7f8f6eada640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f681ed990 con 0x7f8f681591e0 2023-10-14T10:35:53.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.534+0000 7f8f6eada640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6806fdc0 con 0x7f8f68159f20 2023-10-14T10:35:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.534+0000 7f8f6eada640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f681ede80 con 0x7f8f681559f0 2023-10-14T10:35:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.535+0000 7f8f67fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f681591e0 0x7f8f680bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.535+0000 7f8f67fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f681591e0 0x7f8f680bee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44520/0 (socket says 172.21.15.8:44520) 2023-10-14T10:35:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.535+0000 7f8f67fff640 1 -- 172.21.15.8:0/821463072 learned_addr learned my addr 172.21.15.8:0/821463072 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.535+0000 7f8f6c876640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f681559f0 0x7f8f680bbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.535+0000 7f8f6d077640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f68159f20 0x7f8f680bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.535+0000 7f8f67fff640 1 -- 172.21.15.8:0/821463072 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f681559f0 msgr2=0x7f8f680bbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.535+0000 7f8f67fff640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f681559f0 0x7f8f680bbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.535+0000 7f8f67fff640 1 -- 172.21.15.8:0/821463072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f68159f20 msgr2=0x7f8f680bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.535+0000 7f8f67fff640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f68159f20 0x7f8f680bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.535+0000 7f8f67fff640 1 -- 172.21.15.8:0/821463072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f60009a70 con 0x7f8f681591e0 2023-10-14T10:35:53.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.535+0000 7f8f67fff640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f681591e0 0x7f8f680bee20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400e840 tx=0x7f8f5400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:53.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.536+0000 7f8f657fa640 1 -- 172.21.15.8:0/821463072 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f540094f0 con 0x7f8f681591e0 2023-10-14T10:35:53.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.536+0000 7f8f657fa640 1 -- 172.21.15.8:0/821463072 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5400c940 con 0x7f8f681591e0 2023-10-14T10:35:53.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.536+0000 7f8f657fa640 1 -- 172.21.15.8:0/821463072 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5400ccd0 con 0x7f8f681591e0 2023-10-14T10:35:53.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.536+0000 7f8f6eada640 1 -- 172.21.15.8:0/821463072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f680c29c0 con 0x7f8f681591e0 2023-10-14T10:35:53.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.536+0000 7f8f6eada640 1 -- 172.21.15.8:0/821463072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f680bc270 con 0x7f8f681591e0 2023-10-14T10:35:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.537+0000 7f8f6eada640 1 -- 172.21.15.8:0/821463072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6804e9b0 con 0x7f8f681591e0 2023-10-14T10:35:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.538+0000 7f8f657fa640 1 -- 172.21.15.8:0/821463072 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f54013470 con 0x7f8f681591e0 2023-10-14T10:35:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.539+0000 7f8f657fa640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8f4c06ae70 0x7f8f4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.539+0000 7f8f657fa640 1 -- 172.21.15.8:0/821463072 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8f54089380 con 0x7f8f681591e0 2023-10-14T10:35:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.539+0000 7f8f6c876640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8f4c06ae70 0x7f8f4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.540+0000 7f8f6c876640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8f4c06ae70 0x7f8f4c06d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c005880 tx=0x7f8f5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.543+0000 7f8f657fa640 1 -- 172.21.15.8:0/821463072 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f540547a0 con 0x7f8f681591e0 2023-10-14T10:35:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.739+0000 7f8f6eada640 1 -- 172.21.15.8:0/821463072 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f68158cc0 con 0x7f8f4c06ae70 2023-10-14T10:35:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.739+0000 7f8f657fa640 1 -- 172.21.15.8:0/821463072 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8f5c0058b0 con 0x7f8f4c06ae70 2023-10-14T10:35:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 5 to deep-scrub 2023-10-14T10:35:53.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.742+0000 7f8f6eada640 1 -- 172.21.15.8:0/821463072 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8f4c06ae70 msgr2=0x7f8f4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.742+0000 7f8f6eada640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8f4c06ae70 0x7f8f4c06d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c005880 tx=0x7f8f5c009040 comp rx=0 tx=0).stop 2023-10-14T10:35:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.742+0000 7f8f6eada640 1 -- 172.21.15.8:0/821463072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f681591e0 msgr2=0x7f8f680bee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.742+0000 7f8f6eada640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f681591e0 0x7f8f680bee20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400e840 tx=0x7f8f5400ed00 comp rx=0 tx=0).stop 2023-10-14T10:35:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.742+0000 7f8f6eada640 1 -- 172.21.15.8:0/821463072 shutdown_connections 2023-10-14T10:35:53.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.742+0000 7f8f6eada640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f8f4c06ae70 0x7f8f4c06d330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.742+0000 7f8f6eada640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f68159f20 0x7f8f680bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.742+0000 7f8f6eada640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8f681591e0 0x7f8f680bee20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.742+0000 7f8f6eada640 1 --2- 172.21.15.8:0/821463072 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f681559f0 0x7f8f680bbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:53.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.742+0000 7f8f6eada640 1 -- 172.21.15.8:0/821463072 >> 172.21.15.8:0/821463072 conn(0x7f8f680a74d0 msgr2=0x7f8f68159790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:53.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.742+0000 7f8f6eada640 1 -- 172.21.15.8:0/821463072 shutdown_connections 2023-10-14T10:35:53.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.742+0000 7f8f6eada640 1 -- 172.21.15.8:0/821463072 wait complete. 2023-10-14T10:35:53.765 INFO:tasks.ceph:Scrubbing osd.6 2023-10-14T10:35:53.765 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-14T10:35:53.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.995+0000 7f9ee993c640 1 Processor -- start 2023-10-14T10:35:53.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.995+0000 7f9ee993c640 1 -- start start 2023-10-14T10:35:54.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.996+0000 7f9ee993c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9ee40c0350 0x7f9ee4152400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.997+0000 7f9ee993c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ee406fca0 0x7f9ee4152940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.997+0000 7f9ee993c640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee4152e80 con 0x7f9ee414f420 2023-10-14T10:35:54.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.997+0000 7f9ee993c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee4151f70 con 0x7f9ee40c0350 2023-10-14T10:35:54.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.997+0000 7f9ee993c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40c1ae0 con 0x7f9ee406fca0 2023-10-14T10:35:54.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.997+0000 7f9ee2ffd640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9ee414f420 0x7f9ee40705d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43642/0 (socket says 172.21.15.8:43642) 2023-10-14T10:35:54.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.997+0000 7f9ee2ffd640 1 -- 172.21.15.8:0/1255337896 learned_addr learned my addr 172.21.15.8:0/1255337896 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:54.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.997+0000 7f9edbfff640 1 --2- 172.21.15.8:0/1255337896 >> v2:172.21.15.92:3300/0 conn(0x7f9ee40c0350 0x7f9ee4152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.997+0000 7f9ee37fe640 1 --2- 172.21.15.8:0/1255337896 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ee406fca0 0x7f9ee4152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.998+0000 7f9ee27fc640 1 -- 172.21.15.8:0/1255337896 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078094168 0 0) 0x7f9ee4152e80 con 0x7f9ee414f420 2023-10-14T10:35:54.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.998+0000 7f9ee27fc640 1 -- 172.21.15.8:0/1255337896 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ed0003520 con 0x7f9ee414f420 2023-10-14T10:35:54.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.998+0000 7f9edbfff640 1 -- 172.21.15.8:0/1255337896 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ee406fca0 msgr2=0x7f9ee4152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:54.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.998+0000 7f9edbfff640 1 --2- 172.21.15.8:0/1255337896 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ee406fca0 0x7f9ee4152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.998+0000 7f9edbfff640 1 -- 172.21.15.8:0/1255337896 >> v1:172.21.15.8:6789/0 conn(0x7f9ee414f420 legacy=0x7f9ee40705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.998+0000 7f9ee27fc640 1 -- 172.21.15.8:0/1255337896 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3281553418 0 0) 0x7f9ed0003520 con 0x7f9ee414f420 2023-10-14T10:35:54.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.998+0000 7f9edbfff640 1 -- 172.21.15.8:0/1255337896 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40c1dc0 con 0x7f9ee40c0350 2023-10-14T10:35:54.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:53.999+0000 7f9edbfff640 1 --2- 172.21.15.8:0/1255337896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee40c0350 0x7f9ee4152400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0097a0 tx=0x7f9ecc02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d3c7831e4fec148 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:54.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.000+0000 7f9ee27fc640 1 -- 172.21.15.8:0/1255337896 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40017f0 con 0x7f9ee40c0350 2023-10-14T10:35:54.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.000+0000 7f9ee27fc640 1 -- 172.21.15.8:0/1255337896 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc02e050 con 0x7f9ee40c0350 2023-10-14T10:35:54.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.000+0000 7f9ee27fc640 1 -- 172.21.15.8:0/1255337896 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc030730 con 0x7f9ee40c0350 2023-10-14T10:35:54.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.001+0000 7f9ee993c640 1 -- 172.21.15.8:0/1255337896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee40c0350 msgr2=0x7f9ee4152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.001+0000 7f9ee993c640 1 --2- 172.21.15.8:0/1255337896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee40c0350 0x7f9ee4152400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0097a0 tx=0x7f9ecc02b710 comp rx=0 tx=0).stop 2023-10-14T10:35:54.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.001+0000 7f9ee993c640 1 -- 172.21.15.8:0/1255337896 shutdown_connections 2023-10-14T10:35:54.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.001+0000 7f9ee993c640 1 --2- 172.21.15.8:0/1255337896 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ee406fca0 0x7f9ee4152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.001+0000 7f9ee993c640 1 --2- 172.21.15.8:0/1255337896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee40c0350 0x7f9ee4152400 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.001+0000 7f9ee993c640 1 -- 172.21.15.8:0/1255337896 >> 172.21.15.8:0/1255337896 conn(0x7f9ee4069de0 msgr2=0x7f9ee406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:54.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.001+0000 7f9ee993c640 1 -- 172.21.15.8:0/1255337896 shutdown_connections 2023-10-14T10:35:54.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.001+0000 7f9ee993c640 1 -- 172.21.15.8:0/1255337896 wait complete. 2023-10-14T10:35:54.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.003+0000 7f9ee993c640 1 Processor -- start 2023-10-14T10:35:54.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.004+0000 7f9ee993c640 1 -- start start 2023-10-14T10:35:54.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.005+0000 7f9ee993c640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ee406fca0 0x7f9ee4150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.005+0000 7f9ee993c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee40c0350 0x7f9ee41ea620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.005+0000 7f9ee993c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ee414f420 0x7f9ee41eab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.005+0000 7f9ee993c640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee41eb0a0 con 0x7f9ee406fca0 2023-10-14T10:35:54.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.005+0000 7f9ee993c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40c4cf0 con 0x7f9ee40c0350 2023-10-14T10:35:54.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.005+0000 7f9ee993c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40c5b00 con 0x7f9ee414f420 2023-10-14T10:35:54.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.005+0000 7f9ee2ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ee406fca0 0x7f9ee4150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.005+0000 7f9ee2ffd640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ee406fca0 0x7f9ee4150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44534/0 (socket says 172.21.15.8:44534) 2023-10-14T10:35:54.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.005+0000 7f9ee2ffd640 1 -- 172.21.15.8:0/1797622450 learned_addr learned my addr 172.21.15.8:0/1797622450 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:54.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.006+0000 7f9edbfff640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee40c0350 0x7f9ee41ea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.006+0000 7f9ee37fe640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ee414f420 0x7f9ee41eab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.006+0000 7f9ee2ffd640 1 -- 172.21.15.8:0/1797622450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ee414f420 msgr2=0x7f9ee41eab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.006+0000 7f9ee2ffd640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ee414f420 0x7f9ee41eab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.006+0000 7f9ee2ffd640 1 -- 172.21.15.8:0/1797622450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee40c0350 msgr2=0x7f9ee41ea620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.006+0000 7f9ee2ffd640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ee40c0350 0x7f9ee41ea620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.006+0000 7f9ee2ffd640 1 -- 172.21.15.8:0/1797622450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc009400 con 0x7f9ee406fca0 2023-10-14T10:35:54.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.006+0000 7f9ee2ffd640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ee406fca0 0x7f9ee4150c00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4001500 tx=0x7f9ed400c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:54.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.007+0000 7f9ee0ff9640 1 -- 172.21.15.8:0/1797622450 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4007480 con 0x7f9ee406fca0 2023-10-14T10:35:54.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.007+0000 7f9ee0ff9640 1 -- 172.21.15.8:0/1797622450 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed40075e0 con 0x7f9ee406fca0 2023-10-14T10:35:54.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.007+0000 7f9ee0ff9640 1 -- 172.21.15.8:0/1797622450 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40059e0 con 0x7f9ee406fca0 2023-10-14T10:35:54.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.007+0000 7f9ee993c640 1 -- 172.21.15.8:0/1797622450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee40c5da0 con 0x7f9ee406fca0 2023-10-14T10:35:54.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.007+0000 7f9ee993c640 1 -- 172.21.15.8:0/1797622450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee41eb280 con 0x7f9ee406fca0 2023-10-14T10:35:54.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.008+0000 7f9ee993c640 1 -- 172.21.15.8:0/1797622450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ee40c2380 con 0x7f9ee406fca0 2023-10-14T10:35:54.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.009+0000 7f9ee0ff9640 1 -- 172.21.15.8:0/1797622450 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9ed4005b40 con 0x7f9ee406fca0 2023-10-14T10:35:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.010+0000 7f9ee0ff9640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9ec406ae70 0x7f9ec406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.010+0000 7f9ee0ff9640 1 -- 172.21.15.8:0/1797622450 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9ed4088b40 con 0x7f9ee406fca0 2023-10-14T10:35:54.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.010+0000 7f9ee0ff9640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] conn(0x7f9ec4070cd0 0x7f9ec40730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.010+0000 7f9ee0ff9640 1 -- 172.21.15.8:0/1797622450 --> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ec40737a0 con 0x7f9ec4070cd0 2023-10-14T10:35:54.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.010+0000 7f9ee0ff9640 1 -- 172.21.15.8:0/1797622450 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ed408aea0 con 0x7f9ee406fca0 2023-10-14T10:35:54.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.010+0000 7f9edbfff640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9ec406ae70 0x7f9ec406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.011+0000 7f9ee37fe640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] conn(0x7f9ec4070cd0 0x7f9ec40730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.011+0000 7f9edbfff640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9ec406ae70 0x7f9ec406d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc034000 tx=0x7f9ecc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:54.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.012+0000 7f9ee37fe640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] conn(0x7f9ec4070cd0 0x7f9ec40730f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:54.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.014+0000 7f9ee0ff9640 1 -- 172.21.15.8:0/1797622450 <== osd.6 v2:172.21.15.92:6809/1491462275 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9ec40737a0 con 0x7f9ec4070cd0 2023-10-14T10:35:54.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.028+0000 7f9ee993c640 1 -- 172.21.15.8:0/1797622450 --> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ee40c20a0 con 0x7f9ec4070cd0 2023-10-14T10:35:54.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.029+0000 7f9ee0ff9640 1 -- 172.21.15.8:0/1797622450 <== osd.6 v2:172.21.15.92:6809/1491462275 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9edc00f040 con 0x7f9ec4070cd0 2023-10-14T10:35:54.032 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:54.032 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T10:35:54.032 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:54.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.030+0000 7f9ee993c640 1 -- 172.21.15.8:0/1797622450 >> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] conn(0x7f9ec4070cd0 msgr2=0x7f9ec40730f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.030+0000 7f9ee993c640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.92:6809/1491462275,v1:172.21.15.92:6810/1491462275] conn(0x7f9ec4070cd0 0x7f9ec40730f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.030+0000 7f9ee993c640 1 -- 172.21.15.8:0/1797622450 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9ec406ae70 msgr2=0x7f9ec406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.030+0000 7f9ee993c640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f9ec406ae70 0x7f9ec406d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc034000 tx=0x7f9ecc008030 comp rx=0 tx=0).stop 2023-10-14T10:35:54.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.030+0000 7f9ee993c640 1 -- 172.21.15.8:0/1797622450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ee406fca0 msgr2=0x7f9ee4150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.030+0000 7f9ee993c640 1 --2- 172.21.15.8:0/1797622450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ee406fca0 0x7f9ee4150c00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4001500 tx=0x7f9ed400c9d0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.030+0000 7f9ee37fe640 1 -- 172.21.15.8:0/1797622450 reap_dead start 2023-10-14T10:35:54.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.030+0000 7f9ee993c640 1 -- 172.21.15.8:0/1797622450 shutdown_connections 2023-10-14T10:35:54.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.030+0000 7f9ee993c640 1 -- 172.21.15.8:0/1797622450 >> 172.21.15.8:0/1797622450 conn(0x7f9ee4069de0 msgr2=0x7f9ee4152400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:54.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.031+0000 7f9ee993c640 1 -- 172.21.15.8:0/1797622450 shutdown_connections 2023-10-14T10:35:54.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.031+0000 7f9ee993c640 1 -- 172.21.15.8:0/1797622450 wait complete. 2023-10-14T10:35:54.050 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-14T10:35:54.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.266+0000 7f33823b8640 1 Processor -- start 2023-10-14T10:35:54.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.267+0000 7f33823b8640 1 -- start start 2023-10-14T10:35:54.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.268+0000 7f33823b8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f337c0c43a0 0x7f337c0c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.268+0000 7f33823b8640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f337c0c5610 0x7f337c06ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.268+0000 7f33823b8640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337c0c4e30 con 0x7f337c151420 2023-10-14T10:35:54.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.268+0000 7f33823b8640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337c0c5450 con 0x7f337c0c5610 2023-10-14T10:35:54.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.268+0000 7f33823b8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c154950 con 0x7f337c0c43a0 2023-10-14T10:35:54.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.269+0000 7f3381bb7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f337c0c5610 0x7f337c06ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.269+0000 7f3381bb7640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f337c0c5610 0x7f337c06ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44542/0 (socket says 172.21.15.8:44542) 2023-10-14T10:35:54.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.269+0000 7f33813b6640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f337c151420 0x7f337c0c75c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43646/0 (socket says 172.21.15.8:43646) 2023-10-14T10:35:54.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.269+0000 7f3381bb7640 1 -- 172.21.15.8:0/623857030 learned_addr learned my addr 172.21.15.8:0/623857030 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:54.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.269+0000 7f3380bb5640 1 --2- 172.21.15.8:0/623857030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f337c0c43a0 0x7f337c0c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.269+0000 7f3381bb7640 1 -- 172.21.15.8:0/623857030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f337c0c43a0 msgr2=0x7f337c0c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:54.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.269+0000 7f3381bb7640 1 --2- 172.21.15.8:0/623857030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f337c0c43a0 0x7f337c0c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.269+0000 7f3381bb7640 1 -- 172.21.15.8:0/623857030 >> v1:172.21.15.8:6789/0 conn(0x7f337c151420 legacy=0x7f337c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.269+0000 7f3381bb7640 1 -- 172.21.15.8:0/623857030 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0c5d00 con 0x7f337c0c5610 2023-10-14T10:35:54.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.269+0000 7f3373fff640 1 -- 172.21.15.8:0/623857030 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966734842 0 0) 0x7f3378001110 con 0x7f337c151420 2023-10-14T10:35:54.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.271+0000 7f3381bb7640 1 --2- 172.21.15.8:0/623857030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c0c5610 0x7f337c06ac30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3374009e50 tx=0x7f337402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2409af135f63fcc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:54.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.271+0000 7f3373fff640 1 -- 172.21.15.8:0/623857030 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337402ca70 con 0x7f337c0c5610 2023-10-14T10:35:54.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.271+0000 7f3373fff640 1 -- 172.21.15.8:0/623857030 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337402cbd0 con 0x7f337c0c5610 2023-10-14T10:35:54.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.271+0000 7f3373fff640 1 -- 172.21.15.8:0/623857030 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33740343f0 con 0x7f337c0c5610 2023-10-14T10:35:54.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.272+0000 7f33823b8640 1 -- 172.21.15.8:0/623857030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c0c5610 msgr2=0x7f337c06ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.272+0000 7f33823b8640 1 --2- 172.21.15.8:0/623857030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c0c5610 0x7f337c06ac30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3374009e50 tx=0x7f337402bed0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.272+0000 7f33823b8640 1 -- 172.21.15.8:0/623857030 shutdown_connections 2023-10-14T10:35:54.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.272+0000 7f33823b8640 1 --2- 172.21.15.8:0/623857030 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c0c5610 0x7f337c06ac30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.272+0000 7f33823b8640 1 --2- 172.21.15.8:0/623857030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f337c0c43a0 0x7f337c0c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.272+0000 7f33823b8640 1 -- 172.21.15.8:0/623857030 >> 172.21.15.8:0/623857030 conn(0x7f337c0c96c0 msgr2=0x7f337c0c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:54.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.272+0000 7f33823b8640 1 -- 172.21.15.8:0/623857030 shutdown_connections 2023-10-14T10:35:54.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.272+0000 7f33823b8640 1 -- 172.21.15.8:0/623857030 wait complete. 2023-10-14T10:35:54.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.274+0000 7f33823b8640 1 Processor -- start 2023-10-14T10:35:54.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.274+0000 7f33823b8640 1 -- start start 2023-10-14T10:35:54.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.275+0000 7f33823b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f337c0c43a0 0x7f337c14dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.275+0000 7f33823b8640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c0c5610 0x7f337c146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.275+0000 7f33823b8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f337c151420 0x7f337c146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.275+0000 7f33823b8640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0af440 con 0x7f337c0c5610 2023-10-14T10:35:54.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.275+0000 7f33823b8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0aef30 con 0x7f337c0c43a0 2023-10-14T10:35:54.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.275+0000 7f33823b8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0af160 con 0x7f337c151420 2023-10-14T10:35:54.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.275+0000 7f3380bb5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c0c5610 0x7f337c146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.275+0000 7f3380bb5640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c0c5610 0x7f337c146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44552/0 (socket says 172.21.15.8:44552) 2023-10-14T10:35:54.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.275+0000 7f3380bb5640 1 -- 172.21.15.8:0/3475392273 learned_addr learned my addr 172.21.15.8:0/3475392273 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:54.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.275+0000 7f33813b6640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f337c0c43a0 0x7f337c14dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.276+0000 7f3381bb7640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f337c151420 0x7f337c146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.276+0000 7f3380bb5640 1 -- 172.21.15.8:0/3475392273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f337c151420 msgr2=0x7f337c146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.276+0000 7f3380bb5640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f337c151420 0x7f337c146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.276+0000 7f3380bb5640 1 -- 172.21.15.8:0/3475392273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f337c0c43a0 msgr2=0x7f337c14dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.276+0000 7f3380bb5640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f337c0c43a0 0x7f337c14dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.276+0000 7f3380bb5640 1 -- 172.21.15.8:0/3475392273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374009b30 con 0x7f337c0c5610 2023-10-14T10:35:54.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.276+0000 7f3380bb5640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c0c5610 0x7f337c146a40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f336c00e870 tx=0x7f336c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:54.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.276+0000 7f3371ffb640 1 -- 172.21.15.8:0/3475392273 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c0094f0 con 0x7f337c0c5610 2023-10-14T10:35:54.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.276+0000 7f3371ffb640 1 -- 172.21.15.8:0/3475392273 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c00c940 con 0x7f337c0c5610 2023-10-14T10:35:54.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.276+0000 7f3371ffb640 1 -- 172.21.15.8:0/3475392273 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c00ccf0 con 0x7f337c0c5610 2023-10-14T10:35:54.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.276+0000 7f33823b8640 1 -- 172.21.15.8:0/3475392273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337c0ac4c0 con 0x7f337c0c5610 2023-10-14T10:35:54.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.277+0000 7f33823b8640 1 -- 172.21.15.8:0/3475392273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c0aca80 con 0x7f337c0c5610 2023-10-14T10:35:54.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.278+0000 7f33823b8640 1 -- 172.21.15.8:0/3475392273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337c0ac320 con 0x7f337c0c5610 2023-10-14T10:35:54.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.279+0000 7f3371ffb640 1 -- 172.21.15.8:0/3475392273 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f336c013470 con 0x7f337c0c5610 2023-10-14T10:35:54.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.280+0000 7f3371ffb640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f336006ae70 0x7f336006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.280+0000 7f3371ffb640 1 -- 172.21.15.8:0/3475392273 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f336c0894d0 con 0x7f337c0c5610 2023-10-14T10:35:54.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.280+0000 7f33813b6640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f336006ae70 0x7f336006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.281+0000 7f33813b6640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f336006ae70 0x7f336006d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3378000f60 tx=0x7f33780079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:54.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.284+0000 7f3371ffb640 1 -- 172.21.15.8:0/3475392273 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f337c0ac320 con 0x7f337c0c5610 2023-10-14T10:35:54.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.477+0000 7f33823b8640 1 -- 172.21.15.8:0/3475392273 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f337c0c5170 con 0x7f336006ae70 2023-10-14T10:35:54.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.478+0000 7f3371ffb640 1 -- 172.21.15.8:0/3475392273 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3378001440 con 0x7f336006ae70 2023-10-14T10:35:54.481 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 6 to deep-scrub 2023-10-14T10:35:54.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.481+0000 7f33823b8640 1 -- 172.21.15.8:0/3475392273 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f336006ae70 msgr2=0x7f336006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.481+0000 7f33823b8640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f336006ae70 0x7f336006d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3378000f60 tx=0x7f33780079b0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.481+0000 7f33823b8640 1 -- 172.21.15.8:0/3475392273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c0c5610 msgr2=0x7f337c146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.481+0000 7f33823b8640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c0c5610 0x7f337c146a40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f336c00e870 tx=0x7f336c00ed30 comp rx=0 tx=0).stop 2023-10-14T10:35:54.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.481+0000 7f33823b8640 1 -- 172.21.15.8:0/3475392273 shutdown_connections 2023-10-14T10:35:54.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.481+0000 7f33823b8640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f336006ae70 0x7f336006d330 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.481+0000 7f33823b8640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f337c151420 0x7f337c146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.481+0000 7f33823b8640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c0c5610 0x7f337c146a40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.481+0000 7f33823b8640 1 --2- 172.21.15.8:0/3475392273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f337c0c43a0 0x7f337c14dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.481+0000 7f33823b8640 1 -- 172.21.15.8:0/3475392273 >> 172.21.15.8:0/3475392273 conn(0x7f337c0c96c0 msgr2=0x7f337c06aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:54.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.481+0000 7f33823b8640 1 -- 172.21.15.8:0/3475392273 shutdown_connections 2023-10-14T10:35:54.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.481+0000 7f33823b8640 1 -- 172.21.15.8:0/3475392273 wait complete. 2023-10-14T10:35:54.502 INFO:tasks.ceph:Scrubbing osd.7 2023-10-14T10:35:54.503 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-14T10:35:54.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.736+0000 7fa7c1da0640 1 Processor -- start 2023-10-14T10:35:54.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.736+0000 7fa7c1da0640 1 -- start start 2023-10-14T10:35:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.738+0000 7fa7c1da0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa7bc071c50 0x7fa7bc0a7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.738+0000 7fa7c1da0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7bc157b30 0x7fa7bc069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.738+0000 7fa7c1da0640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc13d5c0 con 0x7fa7bc13d1e0 2023-10-14T10:35:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.738+0000 7fa7c1da0640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c2090 con 0x7fa7bc071c50 2023-10-14T10:35:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.738+0000 7fa7c1da0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c0d50 con 0x7fa7bc157b30 2023-10-14T10:35:54.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.738+0000 7fa7c0d9e640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa7bc13d1e0 0x7fa7bc1547c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43652/0 (socket says 172.21.15.8:43652) 2023-10-14T10:35:54.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.738+0000 7fa7c0d9e640 1 -- 172.21.15.8:0/2286791705 learned_addr learned my addr 172.21.15.8:0/2286791705 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bbfff640 1 --2- 172.21.15.8:0/2286791705 >> v2:172.21.15.92:3300/0 conn(0x7fa7bc071c50 0x7fa7bc0a7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7c159f640 1 --2- 172.21.15.8:0/2286791705 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7bc157b30 0x7fa7bc069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292280447 0 0) 0x7fa7bc13d5c0 con 0x7fa7bc13d1e0 2023-10-14T10:35:54.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7ac003520 con 0x7fa7bc13d1e0 2023-10-14T10:35:54.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1363853347 0 0) 0x7fa7ac003520 con 0x7fa7bc13d1e0 2023-10-14T10:35:54.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7bc157b30 msgr2=0x7fa7bc069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:54.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 --2- 172.21.15.8:0/2286791705 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7bc157b30 0x7fa7bc069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 >> v2:172.21.15.92:3300/0 conn(0x7fa7bc071c50 msgr2=0x7fa7bc0a7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:54.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 --2- 172.21.15.8:0/2286791705 >> v2:172.21.15.92:3300/0 conn(0x7fa7bc071c50 0x7fa7bc0a7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0c0f60 con 0x7fa7bc13d1e0 2023-10-14T10:35:54.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7fa7b0001670 con 0x7fa7bc13d1e0 2023-10-14T10:35:54.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 >> v1:172.21.15.8:6789/0 conn(0x7fa7bc13d1e0 legacy=0x7fa7bc1547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 --2- 172.21.15.8:0/2286791705 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7bc157b30 0x7fa7ac003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 --2- 172.21.15.8:0/2286791705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7ac003ef0 0x7fa7ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 --2- 172.21.15.8:0/2286791705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7ac004d00 0x7fa7ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c0d50 con 0x7fa7ac003ef0 2023-10-14T10:35:54.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac00ba30 con 0x7fa7ac004d00 2023-10-14T10:35:54.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac00bbc0 con 0x7fa7bc157b30 2023-10-14T10:35:54.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.739+0000 7fa7bbfff640 1 --2- 172.21.15.8:0/2286791705 >> v2:172.21.15.92:3300/0 conn(0x7fa7bc071c50 0x7fa7bc0a7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T10:35:54.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.740+0000 7fa7bbfff640 1 --2- 172.21.15.8:0/2286791705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7ac003ef0 0x7fa7ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.740+0000 7fa7c0d9e640 1 --2- 172.21.15.8:0/2286791705 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7bc157b30 0x7fa7ac003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.740+0000 7fa7c159f640 1 --2- 172.21.15.8:0/2286791705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7ac004d00 0x7fa7ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.740+0000 7fa7bbfff640 1 -- 172.21.15.8:0/2286791705 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7bc157b30 msgr2=0x7fa7ac003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:54.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.740+0000 7fa7bbfff640 1 --2- 172.21.15.8:0/2286791705 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7bc157b30 0x7fa7ac003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.740+0000 7fa7bbfff640 1 -- 172.21.15.8:0/2286791705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7ac004d00 msgr2=0x7fa7ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:54.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.740+0000 7fa7bbfff640 1 --2- 172.21.15.8:0/2286791705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7ac004d00 0x7fa7ac005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.740+0000 7fa7bbfff640 1 -- 172.21.15.8:0/2286791705 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac003520 con 0x7fa7ac003ef0 2023-10-14T10:35:54.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.741+0000 7fa7bbfff640 1 --2- 172.21.15.8:0/2286791705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7ac003ef0 0x7fa7ac0047c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80098d0 tx=0x7fa7ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b1dd67ebb7937c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:54.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.742+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8030680 con 0x7fa7ac003ef0 2023-10-14T10:35:54.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.742+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a80307e0 con 0x7fa7ac003ef0 2023-10-14T10:35:54.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.742+0000 7fa7bb7fe640 1 -- 172.21.15.8:0/2286791705 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8030b50 con 0x7fa7ac003ef0 2023-10-14T10:35:54.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.742+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2286791705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7ac003ef0 msgr2=0x7fa7ac0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.742+0000 7fa7c1da0640 1 --2- 172.21.15.8:0/2286791705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7ac003ef0 0x7fa7ac0047c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80098d0 tx=0x7fa7ac0057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.742+0000 7fa7c159f640 1 -- 172.21.15.8:0/2286791705 reap_dead start 2023-10-14T10:35:54.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.742+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2286791705 shutdown_connections 2023-10-14T10:35:54.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.742+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2286791705 >> 172.21.15.8:0/2286791705 conn(0x7fa7bc0c2e50 msgr2=0x7fa7bc0c3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:54.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.742+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2286791705 shutdown_connections 2023-10-14T10:35:54.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.742+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2286791705 wait complete. 2023-10-14T10:35:54.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.744+0000 7fa7c1da0640 1 Processor -- start 2023-10-14T10:35:54.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.744+0000 7fa7c1da0640 1 -- start start 2023-10-14T10:35:54.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.745+0000 7fa7c1da0640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7ac003ef0 0x7fa7bc1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.745+0000 7fa7c1da0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7bc0c5d60 0x7fa7bc136970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.745+0000 7fa7c1da0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7bc136eb0 0x7fa7bc135010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.745+0000 7fa7c1da0640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc135f40 con 0x7fa7ac003ef0 2023-10-14T10:35:54.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.745+0000 7fa7c1da0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc153cf0 con 0x7fa7bc0c5d60 2023-10-14T10:35:54.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.745+0000 7fa7c1da0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc1ecc70 con 0x7fa7bc136eb0 2023-10-14T10:35:54.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.745+0000 7fa7c0d9e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7ac003ef0 0x7fa7bc1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.745+0000 7fa7c0d9e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7ac003ef0 0x7fa7bc1569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44574/0 (socket says 172.21.15.8:44574) 2023-10-14T10:35:54.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.745+0000 7fa7c0d9e640 1 -- 172.21.15.8:0/2111108560 learned_addr learned my addr 172.21.15.8:0/2111108560 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:54.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.746+0000 7fa7bbfff640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7bc0c5d60 0x7fa7bc136970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.746+0000 7fa7c159f640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7bc136eb0 0x7fa7bc135010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.746+0000 7fa7c0d9e640 1 -- 172.21.15.8:0/2111108560 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7bc136eb0 msgr2=0x7fa7bc135010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.746+0000 7fa7c0d9e640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7bc136eb0 0x7fa7bc135010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.746+0000 7fa7c0d9e640 1 -- 172.21.15.8:0/2111108560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7bc0c5d60 msgr2=0x7fa7bc136970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.746+0000 7fa7c0d9e640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7bc0c5d60 0x7fa7bc136970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.746+0000 7fa7c0d9e640 1 -- 172.21.15.8:0/2111108560 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0c4e20 con 0x7fa7ac003ef0 2023-10-14T10:35:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.746+0000 7fa7c0d9e640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7ac003ef0 0x7fa7bc1569c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0001eb0 tx=0x7fa7b000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.746+0000 7fa7b97fa640 1 -- 172.21.15.8:0/2111108560 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000ee80 con 0x7fa7ac003ef0 2023-10-14T10:35:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.746+0000 7fa7b97fa640 1 -- 172.21.15.8:0/2111108560 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000c8d0 con 0x7fa7ac003ef0 2023-10-14T10:35:54.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.746+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2111108560 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc0c5100 con 0x7fa7ac003ef0 2023-10-14T10:35:54.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.747+0000 7fa7b97fa640 1 -- 172.21.15.8:0/2111108560 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000cc80 con 0x7fa7ac003ef0 2023-10-14T10:35:54.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.747+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2111108560 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc1ecf50 con 0x7fa7ac003ef0 2023-10-14T10:35:54.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.748+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2111108560 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7bc0c1520 con 0x7fa7ac003ef0 2023-10-14T10:35:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.749+0000 7fa7b97fa640 1 -- 172.21.15.8:0/2111108560 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa7b001d460 con 0x7fa7ac003ef0 2023-10-14T10:35:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.750+0000 7fa7b97fa640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa7a006aea0 0x7fa7a006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.750+0000 7fa7b97fa640 1 -- 172.21.15.8:0/2111108560 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa7b0089d10 con 0x7fa7ac003ef0 2023-10-14T10:35:54.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.750+0000 7fa7b97fa640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] conn(0x7fa7a0070d00 0x7fa7a0073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:54.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.750+0000 7fa7b97fa640 1 -- 172.21.15.8:0/2111108560 --> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7a00737d0 con 0x7fa7a0070d00 2023-10-14T10:35:54.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.750+0000 7fa7b97fa640 1 -- 172.21.15.8:0/2111108560 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7b008a080 con 0x7fa7ac003ef0 2023-10-14T10:35:54.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.750+0000 7fa7bbfff640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa7a006aea0 0x7fa7a006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.751+0000 7fa7c159f640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] conn(0x7fa7a0070d00 0x7fa7a0073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:54.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.751+0000 7fa7bbfff640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa7a006aea0 0x7fa7a006d360 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8036000 tx=0x7fa7a8031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:54.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.752+0000 7fa7c159f640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] conn(0x7fa7a0070d00 0x7fa7a0073120 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:54.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.754+0000 7fa7b97fa640 1 -- 172.21.15.8:0/2111108560 <== osd.7 v2:172.21.15.92:6824/3211925769 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa7a00737d0 con 0x7fa7a0070d00 2023-10-14T10:35:54.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.768+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2111108560 --> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa7bc0c1240 con 0x7fa7a0070d00 2023-10-14T10:35:54.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.770+0000 7fa7b97fa640 1 -- 172.21.15.8:0/2111108560 <== osd.7 v2:172.21.15.92:6824/3211925769 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa7b4009d70 con 0x7fa7a0070d00 2023-10-14T10:35:54.774 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T10:35:54.775 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T10:35:54.776 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T10:35:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.770+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2111108560 >> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] conn(0x7fa7a0070d00 msgr2=0x7fa7a0073120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.770+0000 7fa7c1da0640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.92:6824/3211925769,v1:172.21.15.92:6825/3211925769] conn(0x7fa7a0070d00 0x7fa7a0073120 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:54.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.770+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2111108560 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa7a006aea0 msgr2=0x7fa7a006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.770+0000 7fa7c1da0640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7fa7a006aea0 0x7fa7a006d360 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8036000 tx=0x7fa7a8031000 comp rx=0 tx=0).stop 2023-10-14T10:35:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.770+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2111108560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7ac003ef0 msgr2=0x7fa7bc1569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:54.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.770+0000 7fa7c1da0640 1 --2- 172.21.15.8:0/2111108560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa7ac003ef0 0x7fa7bc1569c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0001eb0 tx=0x7fa7b000ec30 comp rx=0 tx=0).stop 2023-10-14T10:35:54.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.770+0000 7fa7c159f640 1 -- 172.21.15.8:0/2111108560 reap_dead start 2023-10-14T10:35:54.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.770+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2111108560 shutdown_connections 2023-10-14T10:35:54.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.770+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2111108560 >> 172.21.15.8:0/2111108560 conn(0x7fa7bc0c2e50 msgr2=0x7fa7bc0c0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:54.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.770+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2111108560 shutdown_connections 2023-10-14T10:35:54.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:54.771+0000 7fa7c1da0640 1 -- 172.21.15.8:0/2111108560 wait complete. 2023-10-14T10:35:54.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-14T10:35:55.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.013+0000 7f81b8d11640 1 Processor -- start 2023-10-14T10:35:55.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.013+0000 7f81b8d11640 1 -- start start 2023-10-14T10:35:55.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.014+0000 7f81b8d11640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f81b40ba150 0x7f81b40c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.014+0000 7f81b8d11640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f81b40c2670 0x7f81b4157640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.014+0000 7f81b8d11640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b4154060 con 0x7f81b414e0f0 2023-10-14T10:35:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.014+0000 7f81b8d11640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b414e4d0 con 0x7f81b40ba150 2023-10-14T10:35:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.014+0000 7f81b8d11640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b4154ce0 con 0x7f81b40c2670 2023-10-14T10:35:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.015+0000 7f81abfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f81b40ba150 0x7f81b40c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.015+0000 7f81abfff640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f81b40ba150 0x7f81b40c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44584/0 (socket says 172.21.15.8:44584) 2023-10-14T10:35:55.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.015+0000 7f81abfff640 1 -- 172.21.15.8:0/2542322282 learned_addr learned my addr 172.21.15.8:0/2542322282 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:55.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.015+0000 7f81b37fe640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f81b414e0f0 0x7f81b40719f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43658/0 (socket says 172.21.15.8:43658) 2023-10-14T10:35:55.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.015+0000 7f81b3fff640 1 --2- 172.21.15.8:0/2542322282 >> v2:172.21.15.92:3300/0 conn(0x7f81b40c2670 0x7f81b4157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.015+0000 7f81abfff640 1 -- 172.21.15.8:0/2542322282 >> v2:172.21.15.92:3300/0 conn(0x7f81b40c2670 msgr2=0x7f81b4157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.015+0000 7f81abfff640 1 --2- 172.21.15.8:0/2542322282 >> v2:172.21.15.92:3300/0 conn(0x7f81b40c2670 0x7f81b4157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.015+0000 7f81abfff640 1 -- 172.21.15.8:0/2542322282 >> v1:172.21.15.8:6789/0 conn(0x7f81b414e0f0 legacy=0x7f81b40719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.015+0000 7f81b2ffd640 1 -- 172.21.15.8:0/2542322282 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702271404 0 0) 0x7f81b4154060 con 0x7f81b414e0f0 2023-10-14T10:35:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.015+0000 7f81abfff640 1 -- 172.21.15.8:0/2542322282 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b4154340 con 0x7f81b40ba150 2023-10-14T10:35:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.017+0000 7f81abfff640 1 --2- 172.21.15.8:0/2542322282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40ba150 0x7f81b40c2130 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f81b40c1810 tx=0x7f819c02b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f4d0461f585e68 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:55.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.017+0000 7f81b2ffd640 1 -- 172.21.15.8:0/2542322282 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c030880 con 0x7f81b40ba150 2023-10-14T10:35:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.017+0000 7f81b2ffd640 1 -- 172.21.15.8:0/2542322282 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c0309e0 con 0x7f81b40ba150 2023-10-14T10:35:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.017+0000 7f81b2ffd640 1 -- 172.21.15.8:0/2542322282 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c030d70 con 0x7f81b40ba150 2023-10-14T10:35:55.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.018+0000 7f81b8d11640 1 -- 172.21.15.8:0/2542322282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40ba150 msgr2=0x7f81b40c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.018+0000 7f81b8d11640 1 --2- 172.21.15.8:0/2542322282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40ba150 0x7f81b40c2130 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f81b40c1810 tx=0x7f819c02b9c0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.018+0000 7f81b8d11640 1 -- 172.21.15.8:0/2542322282 shutdown_connections 2023-10-14T10:35:55.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.018+0000 7f81b8d11640 1 --2- 172.21.15.8:0/2542322282 >> v2:172.21.15.92:3300/0 conn(0x7f81b40c2670 0x7f81b4157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.018+0000 7f81b8d11640 1 --2- 172.21.15.8:0/2542322282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b40ba150 0x7f81b40c2130 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.018+0000 7f81b8d11640 1 -- 172.21.15.8:0/2542322282 >> 172.21.15.8:0/2542322282 conn(0x7f81b406a200 msgr2=0x7f81b406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:55.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.018+0000 7f81b8d11640 1 -- 172.21.15.8:0/2542322282 shutdown_connections 2023-10-14T10:35:55.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.018+0000 7f81b8d11640 1 -- 172.21.15.8:0/2542322282 wait complete. 2023-10-14T10:35:55.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.020+0000 7f81b8d11640 1 Processor -- start 2023-10-14T10:35:55.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.020+0000 7f81b8d11640 1 -- start start 2023-10-14T10:35:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.021+0000 7f81b8d11640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81b40ba150 0x7f81b40a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.021+0000 7f81b8d11640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81b40c2670 0x7f81b40a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.021+0000 7f81b8d11640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b414e0f0 0x7f81b4149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.021+0000 7f81b8d11640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b40a9480 con 0x7f81b414e0f0 2023-10-14T10:35:55.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.021+0000 7f81b8d11640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b41ec300 con 0x7f81b40ba150 2023-10-14T10:35:55.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.021+0000 7f81b8d11640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b41ec5e0 con 0x7f81b40c2670 2023-10-14T10:35:55.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.021+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b414e0f0 0x7f81b4149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.021+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b414e0f0 0x7f81b4149db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44600/0 (socket says 172.21.15.8:44600) 2023-10-14T10:35:55.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.021+0000 7f81b3fff640 1 -- 172.21.15.8:0/3179543228 learned_addr learned my addr 172.21.15.8:0/3179543228 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:55.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81b37fe640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81b40ba150 0x7f81b40a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81abfff640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81b40c2670 0x7f81b40a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81b3fff640 1 -- 172.21.15.8:0/3179543228 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81b40c2670 msgr2=0x7f81b40a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81b3fff640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81b40c2670 0x7f81b40a8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81b3fff640 1 -- 172.21.15.8:0/3179543228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81b40ba150 msgr2=0x7f81b40a8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81b3fff640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81b40ba150 0x7f81b40a8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81b3fff640 1 -- 172.21.15.8:0/3179543228 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c0094d0 con 0x7f81b414e0f0 2023-10-14T10:35:55.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81b37fe640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81b40ba150 0x7f81b40a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:55.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81b3fff640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b414e0f0 0x7f81b4149db0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f81ac007e40 tx=0x7f81ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:55.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81b0ff9640 1 -- 172.21.15.8:0/3179543228 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac014620 con 0x7f81b414e0f0 2023-10-14T10:35:55.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81b0ff9640 1 -- 172.21.15.8:0/3179543228 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac00ee90 con 0x7f81b414e0f0 2023-10-14T10:35:55.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81b0ff9640 1 -- 172.21.15.8:0/3179543228 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac0149e0 con 0x7f81b414e0f0 2023-10-14T10:35:55.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.022+0000 7f81b8d11640 1 -- 172.21.15.8:0/3179543228 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b41ec8c0 con 0x7f81b414e0f0 2023-10-14T10:35:55.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.023+0000 7f81b8d11640 1 -- 172.21.15.8:0/3179543228 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b41ece80 con 0x7f81b414e0f0 2023-10-14T10:35:55.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.024+0000 7f81b8d11640 1 -- 172.21.15.8:0/3179543228 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b40619f0 con 0x7f81b414e0f0 2023-10-14T10:35:55.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.025+0000 7f81b0ff9640 1 -- 172.21.15.8:0/3179543228 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f81ac014b40 con 0x7f81b414e0f0 2023-10-14T10:35:55.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.025+0000 7f81b0ff9640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f819406ae70 0x7f819406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.026+0000 7f81b0ff9640 1 -- 172.21.15.8:0/3179543228 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f81ac089d40 con 0x7f81b414e0f0 2023-10-14T10:35:55.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.026+0000 7f81b37fe640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f819406ae70 0x7f819406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.026+0000 7f81b37fe640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f819406ae70 0x7f819406d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f81a4000f60 tx=0x7f81a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:55.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.030+0000 7f81b0ff9640 1 -- 172.21.15.8:0/3179543228 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81ac0550e0 con 0x7f81b414e0f0 2023-10-14T10:35:55.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.225+0000 7f81b8d11640 1 -- 172.21.15.8:0/3179543228 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f81b4154900 con 0x7f819406ae70 2023-10-14T10:35:55.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.226+0000 7f81b0ff9640 1 -- 172.21.15.8:0/3179543228 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f81a4001c90 con 0x7f819406ae70 2023-10-14T10:35:55.228 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 7 to deep-scrub 2023-10-14T10:35:55.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.229+0000 7f81b8d11640 1 -- 172.21.15.8:0/3179543228 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f819406ae70 msgr2=0x7f819406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.229+0000 7f81b8d11640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f819406ae70 0x7f819406d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f81a4000f60 tx=0x7f81a4009040 comp rx=0 tx=0).stop 2023-10-14T10:35:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.229+0000 7f81b8d11640 1 -- 172.21.15.8:0/3179543228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b414e0f0 msgr2=0x7f81b4149db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.229+0000 7f81b8d11640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b414e0f0 0x7f81b4149db0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f81ac007e40 tx=0x7f81ac00e4b0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.229+0000 7f81b8d11640 1 -- 172.21.15.8:0/3179543228 shutdown_connections 2023-10-14T10:35:55.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.229+0000 7f81b8d11640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f819406ae70 0x7f819406d330 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.229+0000 7f81b8d11640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81b414e0f0 0x7f81b4149db0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.229+0000 7f81b8d11640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81b40c2670 0x7f81b40a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.229+0000 7f81b8d11640 1 --2- 172.21.15.8:0/3179543228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81b40ba150 0x7f81b40a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.229+0000 7f81b8d11640 1 -- 172.21.15.8:0/3179543228 >> 172.21.15.8:0/3179543228 conn(0x7f81b406a200 msgr2=0x7f81b406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:55.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.229+0000 7f81b8d11640 1 -- 172.21.15.8:0/3179543228 shutdown_connections 2023-10-14T10:35:55.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.230+0000 7f81b8d11640 1 -- 172.21.15.8:0/3179543228 wait complete. 2023-10-14T10:35:55.250 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T10:35:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.479+0000 7f275d780640 1 Processor -- start 2023-10-14T10:35:55.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.479+0000 7f275d780640 1 -- start start 2023-10-14T10:35:55.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.480+0000 7f275d780640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f275806b5d0 0x7f27580c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.480+0000 7f275d780640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27581543b0 con 0x7f27581514c0 2023-10-14T10:35:55.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.480+0000 7f275d780640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275806ba50 con 0x7f2758154840 2023-10-14T10:35:55.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.480+0000 7f275d780640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275806c3c0 con 0x7f275806b5d0 2023-10-14T10:35:55.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.480+0000 7f2757fff640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f27581514c0 0x7f27580c7530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:43666/0 (socket says 172.21.15.8:43666) 2023-10-14T10:35:55.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.480+0000 7f2757fff640 1 -- 172.21.15.8:0/2649973426 learned_addr learned my addr 172.21.15.8:0/2649973426 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:35:55.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564664051 0 0) 0x7f27581543b0 con 0x7f27581514c0 2023-10-14T10:35:55.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2740003520 con 0x7f27581514c0 2023-10-14T10:35:55.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f27577fe640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f275806b5d0 0x7f27580c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 922286921 0 0) 0x7f2740003520 con 0x7f27581514c0 2023-10-14T10:35:55.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f275806b5d0 msgr2=0x7f27580c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:55.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f275806b5d0 0x7f27580c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 >> v1:172.21.15.92:6789/0 conn(0x7f2758154840 legacy=0x7f27580c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27580c5630 con 0x7f27581514c0 2023-10-14T10:35:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f2748001670 con 0x7f27581514c0 2023-10-14T10:35:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 >> v1:172.21.15.8:6789/0 conn(0x7f27581514c0 legacy=0x7f27580c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f275806b5d0 0x7f27400039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2740004020 0x7f27400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2740004d00 0x7f2740005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274000bc30 con 0x7f2740004d00 2023-10-14T10:35:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274000bda0 con 0x7f2740004020 2023-10-14T10:35:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.481+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274000bf60 con 0x7f275806b5d0 2023-10-14T10:35:55.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.482+0000 7f275cf7f640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2740004d00 0x7f2740005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.482+0000 7f2757fff640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f275806b5d0 0x7f27400039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.482+0000 7f27577fe640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2740004020 0x7f27400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.482+0000 7f275cf7f640 1 -- 172.21.15.8:0/2649973426 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f275806b5d0 msgr2=0x7f27400039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:55.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.482+0000 7f275cf7f640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f275806b5d0 0x7f27400039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.482+0000 7f275cf7f640 1 -- 172.21.15.8:0/2649973426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2740004020 msgr2=0x7f27400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:35:55.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.482+0000 7f275cf7f640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2740004020 0x7f27400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.482+0000 7f275cf7f640 1 -- 172.21.15.8:0/2649973426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2740003520 con 0x7f2740004d00 2023-10-14T10:35:55.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.482+0000 7f27577fe640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2740004020 0x7f27400047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.483+0000 7f275cf7f640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2740004d00 0x7f2740005180 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2750001750 tx=0x7f27400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e3089d830a613c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.484+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500052d0 con 0x7f2740004d00 2023-10-14T10:35:55.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.484+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275002e050 con 0x7f2740004d00 2023-10-14T10:35:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.484+0000 7f2756ffd640 1 -- 172.21.15.8:0/2649973426 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750003830 con 0x7f2740004d00 2023-10-14T10:35:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.484+0000 7f275d780640 1 -- 172.21.15.8:0/2649973426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2740004d00 msgr2=0x7f2740005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.484+0000 7f275d780640 1 --2- 172.21.15.8:0/2649973426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2740004d00 0x7f2740005180 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2750001750 tx=0x7f27400057f0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.484+0000 7f275cf7f640 1 -- 172.21.15.8:0/2649973426 reap_dead start 2023-10-14T10:35:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.484+0000 7f275d780640 1 -- 172.21.15.8:0/2649973426 shutdown_connections 2023-10-14T10:35:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.484+0000 7f275d780640 1 -- 172.21.15.8:0/2649973426 >> 172.21.15.8:0/2649973426 conn(0x7f27580c60b0 msgr2=0x7f27580c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.484+0000 7f275d780640 1 -- 172.21.15.8:0/2649973426 shutdown_connections 2023-10-14T10:35:55.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.484+0000 7f275d780640 1 -- 172.21.15.8:0/2649973426 wait complete. 2023-10-14T10:35:55.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.486+0000 7f275d780640 1 Processor -- start 2023-10-14T10:35:55.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.486+0000 7f275d780640 1 -- start start 2023-10-14T10:35:55.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.487+0000 7f275d780640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27580c2ab0 0x7f27581e9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.487+0000 7f275d780640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27581ed0e0 0x7f27581ea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.487+0000 7f275d780640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2758147900 0x7f2758147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.487+0000 7f275d780640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27581e9790 con 0x7f2758147900 2023-10-14T10:35:55.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.487+0000 7f275d780640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275814ea50 con 0x7f27581ed0e0 2023-10-14T10:35:55.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.487+0000 7f275d780640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27581482c0 con 0x7f27580c2ab0 2023-10-14T10:35:55.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.487+0000 7f275cf7f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2758147900 0x7f2758147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.488+0000 7f275cf7f640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2758147900 0x7f2758147d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44608/0 (socket says 172.21.15.8:44608) 2023-10-14T10:35:55.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.488+0000 7f275cf7f640 1 -- 172.21.15.8:0/2301605951 learned_addr learned my addr 172.21.15.8:0/2301605951 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:35:55.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.488+0000 7f2757fff640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27580c2ab0 0x7f27581e9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.488+0000 7f27577fe640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27581ed0e0 0x7f27581ea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.488+0000 7f275cf7f640 1 -- 172.21.15.8:0/2301605951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27580c2ab0 msgr2=0x7f27581e9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.488+0000 7f275cf7f640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27580c2ab0 0x7f27581e9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.488+0000 7f275cf7f640 1 -- 172.21.15.8:0/2301605951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27581ed0e0 msgr2=0x7f27581ea5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.488+0000 7f275cf7f640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27581ed0e0 0x7f27581ea5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.488+0000 7f275cf7f640 1 -- 172.21.15.8:0/2301605951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27581e9160 con 0x7f2758147900 2023-10-14T10:35:55.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.488+0000 7f27577fe640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27581ed0e0 0x7f27581ea5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:35:55.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.488+0000 7f275cf7f640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2758147900 0x7f2758147d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2750005040 tx=0x7f2750001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:55.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.489+0000 7f2754ff9640 1 -- 172.21.15.8:0/2301605951 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500054c0 con 0x7f2758147900 2023-10-14T10:35:55.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.489+0000 7f2754ff9640 1 -- 172.21.15.8:0/2301605951 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2750007a30 con 0x7f2758147900 2023-10-14T10:35:55.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.489+0000 7f2754ff9640 1 -- 172.21.15.8:0/2301605951 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750006a10 con 0x7f2758147900 2023-10-14T10:35:55.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.489+0000 7f275d780640 1 -- 172.21.15.8:0/2301605951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27581ed540 con 0x7f2758147900 2023-10-14T10:35:55.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.489+0000 7f275d780640 1 -- 172.21.15.8:0/2301605951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275814beb0 con 0x7f2758147900 2023-10-14T10:35:55.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.490+0000 7f275d780640 1 -- 172.21.15.8:0/2301605951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275804e9b0 con 0x7f2758147900 2023-10-14T10:35:55.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.491+0000 7f2754ff9640 1 -- 172.21.15.8:0/2301605951 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2750006b70 con 0x7f2758147900 2023-10-14T10:35:55.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.492+0000 7f2754ff9640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f274406aea0 0x7f274406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:35:55.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.492+0000 7f2754ff9640 1 -- 172.21.15.8:0/2301605951 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f27500aa980 con 0x7f2758147900 2023-10-14T10:35:55.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.492+0000 7f2757fff640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f274406aea0 0x7f274406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:35:55.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.493+0000 7f2757fff640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f274406aea0 0x7f274406d360 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2748001050 tx=0x7f2748009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:35:55.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.497+0000 7f2754ff9640 1 -- 172.21.15.8:0/2301605951 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2750075d20 con 0x7f2758147900 2023-10-14T10:35:55.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.689+0000 7f275d780640 1 -- 172.21.15.8:0/2301605951 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f275814c0a0 con 0x7f274406aea0 2023-10-14T10:35:55.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.692+0000 7f2754ff9640 1 -- 172.21.15.8:0/2301605951 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48285 (secure 0 0 0) 0x7f275814c0a0 con 0x7f274406aea0 2023-10-14T10:35:55.694 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:35:55.695 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T10:35:55.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.694+0000 7f275d780640 1 -- 172.21.15.8:0/2301605951 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f274406aea0 msgr2=0x7f274406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.694+0000 7f275d780640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f274406aea0 0x7f274406d360 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2748001050 tx=0x7f2748009040 comp rx=0 tx=0).stop 2023-10-14T10:35:55.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.694+0000 7f275d780640 1 -- 172.21.15.8:0/2301605951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2758147900 msgr2=0x7f2758147d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:35:55.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.694+0000 7f275d780640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2758147900 0x7f2758147d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2750005040 tx=0x7f2750001120 comp rx=0 tx=0).stop 2023-10-14T10:35:55.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.695+0000 7f275d780640 1 -- 172.21.15.8:0/2301605951 shutdown_connections 2023-10-14T10:35:55.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.695+0000 7f275d780640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f274406aea0 0x7f274406d360 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.695+0000 7f275d780640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2758147900 0x7f2758147d80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.695+0000 7f275d780640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27581ed0e0 0x7f27581ea5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.695+0000 7f275d780640 1 --2- 172.21.15.8:0/2301605951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27580c2ab0 0x7f27581e9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:35:55.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.695+0000 7f275d780640 1 -- 172.21.15.8:0/2301605951 >> 172.21.15.8:0/2301605951 conn(0x7f27580c60b0 msgr2=0x7f27580c81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:35:55.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.695+0000 7f275d780640 1 -- 172.21.15.8:0/2301605951 shutdown_connections 2023-10-14T10:35:55.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:35:55.695+0000 7f275d780640 1 -- 172.21.15.8:0/2301605951 wait complete. 2023-10-14T10:35:55.714 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-10-14T10:35:54.677373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237332,"kb_used_data":4520,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737388,"statfs":{"total":773094113280,"available":772851085312,"internally_reserved":0,"allocated":4628480,"data_stored":2535696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.081126"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T10:35:44.697937+0000","last_change":"2023-10-14T10:33:42.821659+0000","last_active":"2023-10-14T10:35:44.697937+0000","last_peered":"2023-10-14T10:35:44.697937+0000","last_clean":"2023-10-14T10:35:44.697937+0000","last_became_active":"2023-10-14T10:33:42.819441+0000","last_became_peered":"2023-10-14T10:33:42.819441+0000","last_unstale":"2023-10-14T10:35:44.697937+0000","last_undegraded":"2023-10-14T10:35:44.697937+0000","last_fullsized":"2023-10-14T10:35:44.697937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T10:33:41.468382+0000","last_clean_scrub_stamp":"2023-10-14T10:33:41.468382+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:59.542930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":759738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.0009999999999999,"15min":0.97999999999999998},"min":{"1min":0.68100000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.573,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.1519999999999999,"15min":1.1579999999999999},"min":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6830000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.1180000000000001}]},{"osd":1,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.137,"15min":1.1259999999999999},"min":{"1min":0.69799999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7250000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.667},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.149,"15min":1.135},"min":{"1min":0.73999999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5620000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.27}]},{"osd":2,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.119,"15min":1.121},"min":{"1min":0.753,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6419999999999999,"5min":1.784,"15min":1.784},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.2849999999999999,"15min":1.2829999999999999},"min":{"1min":1.02,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.6659999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.879}]},{"osd":3,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2509999999999999,"15min":1.256},"min":{"1min":0.871,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.593,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.377,"5min":1.3580000000000001,"15min":1.355},"min":{"1min":0.91800000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.704,"5min":1.895,"15min":1.895},"last":1.8100000000000001}]},{"osd":4,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.3380000000000001,"15min":1.3620000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.714,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.3080000000000001,"15min":1.3200000000000001},"min":{"1min":0.96299999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.548}]},{"osd":5,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.4590000000000001,"15min":1.4730000000000001},"min":{"1min":1.048,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.798,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.9390000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.502,"15min":1.518},"min":{"1min":0.96699999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8280000000000001,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.512}]},{"osd":6,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5840000000000001,"15min":1.593},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":1.778,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.554,"15min":1.5620000000000001},"min":{"1min":1.2789999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":1.873,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":1.758}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.075,"15min":1.0800000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5669999999999999,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.337},{"interface":"front","average":{"1min":1.073,"5min":1.0940000000000001,"15min":1.0980000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6319999999999999,"5min":1.722,"15min":1.722},"last":1.552}]},{"osd":1,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.163,"15min":1.169},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.655,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.52},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.165,"15min":1.159},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.681,"5min":1.821,"15min":1.821},"last":1.2210000000000001}]},{"osd":2,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1559999999999999,"15min":1.1519999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.77,"5min":3.395,"15min":3.395},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.3160000000000001,"15min":1.347},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.639,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.89900000000000002}]},{"osd":3,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3080000000000001,"15min":1.319},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.6850000000000001,"5min":1.952,"15min":1.952},"last":1.466},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.347,"15min":1.3700000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.526,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.2889999999999999}]},{"osd":4,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.4039999999999999,"15min":1.4299999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5880000000000001,"5min":1.921,"15min":1.921},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4590000000000001,"15min":1.4710000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.8640000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.7490000000000001}]},{"osd":5,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.3149999999999999,"15min":1.3320000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6140000000000001,"5min":2.234,"15min":2.234},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.4570000000000001,"15min":1.4750000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.7350000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.6339999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.474,"15min":1.484},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.8069999999999999,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.587,"15min":1.609},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.831,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.589}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0760000000000001,"15min":1.0700000000000001},"min":{"1min":0.70099999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1240000000000001,"15min":1.1200000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.694,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.222}]},{"osd":1,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.1990000000000001,"15min":1.2030000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.762,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.099,"5min":1.167,"15min":1.1779999999999999},"min":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5369999999999999,"5min":1.901,"15min":1.901},"last":1.5369999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1779999999999999,"15min":1.1799999999999999},"min":{"1min":0.74199999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5549999999999999,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.302},{"interface":"front","average":{"1min":1.27,"5min":1.262,"15min":1.26},"min":{"1min":0.90500000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.6990000000000001,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.079}]},{"osd":3,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2669999999999999,"15min":1.2589999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.593,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3879999999999999,"15min":1.393},"min":{"1min":0.97599999999999998,"5min":0.755,"15min":0.755},"max":{"1min":1.647,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":0.97599999999999998}]},{"osd":4,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.389,"15min":1.4119999999999999},"min":{"1min":0.94699999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.506,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.47,"15min":1.4850000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.718,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.4890000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.4630000000000001,"15min":1.4870000000000001},"min":{"1min":0.84299999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.714,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.173},{"interface":"front","average":{"1min":1.379,"5min":1.4710000000000001,"15min":1.486},"min":{"1min":1.099,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6819999999999999,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.4359999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.532,"15min":1.534},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.9019999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.611,"15min":1.627},"min":{"1min":0.99399999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.7629999999999999,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":1.2609999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.046,"15min":1.022},"min":{"1min":0.68500000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6160000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.48},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.177,"15min":1.155},"min":{"1min":0.79300000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.712,"5min":1.734,"15min":1.734},"last":1.6080000000000001}]},{"osd":1,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.171,"15min":1.145},"min":{"1min":0.88300000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.26},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.2130000000000001,"15min":1.196},"min":{"1min":0.97099999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.7529999999999999,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.3220000000000001}]},{"osd":2,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.1950000000000001,"15min":1.1699999999999999},"min":{"1min":0.84999999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3300000000000001,"15min":1.3260000000000001},"min":{"1min":0.88200000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.6759999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.5389999999999999}]},{"osd":3,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.296,"15min":1.3080000000000001},"min":{"1min":0.76500000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.681,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.27,"15min":1.2629999999999999},"min":{"1min":0.93600000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.575}]},{"osd":5,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.3049999999999999,"15min":1.3240000000000001},"min":{"1min":0.76800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.645,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.645},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.4239999999999999,"15min":1.4319999999999999},"min":{"1min":0.86299999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.9039999999999999,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.7969999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.379,"15min":1.387},"min":{"1min":0.93400000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.915,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.516},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.429,"15min":1.4279999999999999},"min":{"1min":1.04,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.754}]},{"osd":7,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.524,"15min":1.5249999999999999},"min":{"1min":0.91500000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5580000000000001,"15min":1.5529999999999999},"min":{"1min":1.1879999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.7}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91900000000000004,"15min":0.92800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.292,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":2.1899999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93200000000000005,"15min":0.91900000000000004},"min":{"1min":0.63700000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4450000000000001,"5min":1.619,"15min":1.619},"last":0.92400000000000004}]},{"osd":1,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94699999999999995,"15min":0.95499999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.069,"15min":1.0669999999999999},"min":{"1min":0.55400000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6519999999999999,"5min":1.679,"15min":1.679},"last":2.29}]},{"osd":2,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.2070000000000001,"15min":1.2170000000000001},"min":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6799999999999999,"5min":1.827,"15min":1.827},"last":1.153},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.24,"15min":1.242},"min":{"1min":0.63,"5min":0.628,"15min":0.628},"max":{"1min":1.6870000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":2.4380000000000002}]},{"osd":4,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.258,"15min":1.2549999999999999},"min":{"1min":0.94399999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3859999999999999,"15min":1.3919999999999999},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":1.6699999999999999,"5min":2.347,"15min":2.347},"last":1.278}]},{"osd":5,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4119999999999999,"15min":1.4199999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.9810000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":2.5830000000000002},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3660000000000001,"15min":1.3740000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.893,"5min":2.048,"15min":2.048},"last":1.339}]},{"osd":6,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.5149999999999999,"15min":1.5309999999999999},"min":{"1min":0.85899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.851,"5min":2.504,"15min":2.504},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.5409999999999999,"15min":1.5509999999999999},"min":{"1min":1.1000000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":1.8240000000000001,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":2.5230000000000001}]},{"osd":7,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.4530000000000001,"15min":1.458},"min":{"1min":1.103,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.0409999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.073},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.581,"15min":1.5900000000000001},"min":{"1min":0.92900000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.984,"5min":2.419,"15min":2.419},"last":1.401}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31604,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.92700000000000005,"15min":0.93000000000000005},"min":{"1min":0.42999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.46,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.64400000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6359999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.3180000000000001}]},{"osd":1,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.98099999999999998,"15min":0.997},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.425,"5min":1.476,"15min":1.476},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.087,"5min":1.103,"15min":1.105},"min":{"1min":0.61399999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6439999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.581}]},{"osd":3,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.1379999999999999,"15min":1.1559999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4630000000000001,"5min":1.794,"15min":1.794},"last":1.149},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1839999999999999,"15min":1.1830000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.8049999999999999}]},{"osd":4,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4139999999999999,"15min":1.417},"min":{"1min":0.92500000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.839,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.373,"15min":1.399},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.625,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.484}]},{"osd":5,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.478,"15min":1.506},"min":{"1min":0.86599999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.71,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4730000000000001,"15min":1.4770000000000001},"min":{"1min":0.878,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8879999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.8740000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.4950000000000001,"15min":1.5329999999999999},"min":{"1min":0.89000000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6910000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5780000000000001,"15min":1.6080000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.885,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.661}]},{"osd":7,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.5289999999999999,"15min":1.5529999999999999},"min":{"1min":0.81399999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.9370000000000001,"5min":2.601,"15min":2.601},"last":1.71},{"interface":"front","average":{"1min":1.486,"5min":1.641,"15min":1.667},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.9490000000000001,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.774}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.92500000000000004,"15min":0.94099999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4019999999999999,"5min":1.55,"15min":1.55},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.95799999999999996,"15min":0.94399999999999995},"min":{"1min":0.48399999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.7569999999999999,"5min":2.258,"15min":2.258},"last":1.1759999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93799999999999994,"15min":0.93600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.387,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.115},{"interface":"front","average":{"1min":1.046,"5min":1.1220000000000001,"15min":1.135},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.556,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.89900000000000002}]},{"osd":3,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.135,"15min":1.125},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.851,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.171,"5min":1.1040000000000001,"15min":1.093},"min":{"1min":0.52600000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.754,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.4019999999999999}]},{"osd":4,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.83699999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.304,"5min":1.345,"15min":1.3520000000000001},"min":{"1min":0.748,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.0680000000000001,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.845}]},{"osd":5,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4750000000000001,"15min":1.4930000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.9139999999999999,"5min":4.1150000000000002,"15min":4.1150000000000002},"last":1.742},{"interface":"front","average":{"1min":1.506,"5min":1.6259999999999999,"15min":1.6459999999999999},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.004,"5min":4.242,"15min":4.242},"last":1.946}]},{"osd":6,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4670000000000001,"15min":1.4630000000000001},"min":{"1min":0.92400000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0510000000000002,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.306},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.4870000000000001,"15min":1.504},"min":{"1min":0.89200000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.724,"5min":3.02,"15min":3.02},"last":1.5209999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5469999999999999,"15min":1.5629999999999999},"min":{"1min":0.79000000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.9490000000000001,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.5289999999999999,"15min":1.5389999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.962,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":1.5009999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":759738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88600000000000001,"15min":0.88300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.94999999999999996,"15min":0.94299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.86299999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.131,"15min":1.143},"min":{"1min":0.50700000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5229999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.077,"15min":1.091},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.552,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.72199999999999998}]},{"osd":3,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2310000000000001,"15min":1.2230000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.6839999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.131,"15min":1.141},"min":{"1min":0.54900000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5660000000000001,"5min":3.673,"15min":3.673},"last":0.68200000000000005}]},{"osd":4,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3149999999999999,"15min":1.319},"min":{"1min":0.78400000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4830000000000001,"15min":1.4890000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":1.373}]},{"osd":5,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.431,"15min":1.4390000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.274,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.506,"15min":1.5149999999999999},"min":{"1min":0.83399999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.9219999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.5469999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4910000000000001,"15min":1.4970000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.9450000000000001,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.409},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.6619999999999999,"15min":1.6899999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1349999999999998,"5min":3.3519999999999999,"15min":3.3519999999999999},"last":1.337}]},{"osd":7,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.556,"15min":1.55},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.6459999999999999,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.55,"15min":1.554},"min":{"1min":0.879,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.2360000000000002,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.6459999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T10:35:55.718 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T10:33:41.468382+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=10, tm_min=35, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T10:35:55.719 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T10:36:09.506 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:36:09.518 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:36:15.720 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T10:36:15.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.959+0000 7f77b44a2640 1 Processor -- start 2023-10-14T10:36:15.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.959+0000 7f77b44a2640 1 -- start start 2023-10-14T10:36:15.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.960+0000 7f77b44a2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac06da00 0x7f77ac0c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:15.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.960+0000 7f77b44a2640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ac0c1050 con 0x7f77ac14ac70 2023-10-14T10:36:15.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.961+0000 7f77b44a2640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ac154ee0 con 0x7f77ac0c5ce0 2023-10-14T10:36:15.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.961+0000 7f77b44a2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac1540a0 con 0x7f77ac06da00 2023-10-14T10:36:15.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.961+0000 7f77b223e640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f77ac14ac70 0x7f77ac1547d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:37414/0 (socket says 172.21.15.8:37414) 2023-10-14T10:36:15.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.961+0000 7f77b223e640 1 -- 172.21.15.8:0/2237453948 learned_addr learned my addr 172.21.15.8:0/2237453948 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:36:15.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.961+0000 7f77b1a3d640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac06da00 0x7f77ac0c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:15.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.961+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38116400 0 0) 0x7f77ac0c1050 con 0x7f77ac14ac70 2023-10-14T10:36:15.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7798003520 con 0x7f77ac14ac70 2023-10-14T10:36:15.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 181724985 0 0) 0x7f7798003520 con 0x7f77ac14ac70 2023-10-14T10:36:15.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac06da00 msgr2=0x7f77ac0c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:36:15.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac06da00 0x7f77ac0c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:15.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 >> v1:172.21.15.92:6789/0 conn(0x7f77ac0c5ce0 legacy=0x7f77ac15ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:15.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac0c0a90 con 0x7f77ac14ac70 2023-10-14T10:36:15.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1550744003 0 0) 0x7f77a8001670 con 0x7f77ac14ac70 2023-10-14T10:36:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 >> v1:172.21.15.8:6789/0 conn(0x7f77ac14ac70 legacy=0x7f77ac1547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77980039a0 0x7f7798003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac06da00 0x7f77980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:15.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7798004d00 0x7f7798005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:15.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac1540a0 con 0x7f7798004d00 2023-10-14T10:36:15.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779800bab0 con 0x7f77980039a0 2023-10-14T10:36:15.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.962+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779800bc70 con 0x7f77ac06da00 2023-10-14T10:36:15.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.963+0000 7f77b2a3f640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7798004d00 0x7f7798005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.963+0000 7f77b1a3d640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac06da00 0x7f77980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.963+0000 7f77b223e640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77980039a0 0x7f7798003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.963+0000 7f77b2a3f640 1 -- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac06da00 msgr2=0x7f77980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:36:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.963+0000 7f77b2a3f640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac06da00 0x7f77980047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:15.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.963+0000 7f77b2a3f640 1 -- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77980039a0 msgr2=0x7f7798003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:36:15.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.963+0000 7f77b2a3f640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77980039a0 0x7f7798003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:15.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.963+0000 7f77b2a3f640 1 -- 172.21.15.8:0/2237453948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798003520 con 0x7f7798004d00 2023-10-14T10:36:15.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.963+0000 7f77b1a3d640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac06da00 0x7f77980047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:36:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.963+0000 7f77b223e640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77980039a0 0x7f7798003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:36:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.964+0000 7f77b2a3f640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7798004d00 0x7f7798005180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f77a4001e50 tx=0x7f77980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225800477595100c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:36:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.965+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4003b70 con 0x7f7798004d00 2023-10-14T10:36:15.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.965+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a4003cd0 con 0x7f7798004d00 2023-10-14T10:36:15.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.965+0000 7f77b123c640 1 -- 172.21.15.8:0/2237453948 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4005310 con 0x7f7798004d00 2023-10-14T10:36:15.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.965+0000 7f77b44a2640 1 -- 172.21.15.8:0/2237453948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7798004d00 msgr2=0x7f7798005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:15.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.965+0000 7f77b44a2640 1 --2- 172.21.15.8:0/2237453948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7798004d00 0x7f7798005180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f77a4001e50 tx=0x7f77980057f0 comp rx=0 tx=0).stop 2023-10-14T10:36:15.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.965+0000 7f77b2a3f640 1 -- 172.21.15.8:0/2237453948 reap_dead start 2023-10-14T10:36:15.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.965+0000 7f77b44a2640 1 -- 172.21.15.8:0/2237453948 shutdown_connections 2023-10-14T10:36:15.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.965+0000 7f77b44a2640 1 -- 172.21.15.8:0/2237453948 >> 172.21.15.8:0/2237453948 conn(0x7f77ac0a74d0 msgr2=0x7f77ac0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:36:15.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.965+0000 7f77b44a2640 1 -- 172.21.15.8:0/2237453948 shutdown_connections 2023-10-14T10:36:15.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.965+0000 7f77b44a2640 1 -- 172.21.15.8:0/2237453948 wait complete. 2023-10-14T10:36:15.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.967+0000 7f77b44a2640 1 Processor -- start 2023-10-14T10:36:15.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.967+0000 7f77b44a2640 1 -- start start 2023-10-14T10:36:15.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.968+0000 7f77b44a2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7798004d00 0x7f77ac0c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:15.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.968+0000 7f77b44a2640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac145e40 0x7f77ac143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:15.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.968+0000 7f77b44a2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac0c3b10 0x7f77ac143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:15.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.968+0000 7f77b44a2640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac0c5410 con 0x7f77ac145e40 2023-10-14T10:36:15.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.968+0000 7f77b44a2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac071010 con 0x7f7798004d00 2023-10-14T10:36:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.968+0000 7f77b44a2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac153430 con 0x7f77ac0c3b10 2023-10-14T10:36:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.969+0000 7f77b1a3d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac145e40 0x7f77ac143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.969+0000 7f77b1a3d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac145e40 0x7f77ac143120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45276/0 (socket says 172.21.15.8:45276) 2023-10-14T10:36:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.969+0000 7f77b1a3d640 1 -- 172.21.15.8:0/1544117835 learned_addr learned my addr 172.21.15.8:0/1544117835 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:36:15.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.969+0000 7f77b1a3d640 1 -- 172.21.15.8:0/1544117835 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac0c3b10 msgr2=0x7f77ac143660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:15.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.969+0000 7f77b1a3d640 1 --2- 172.21.15.8:0/1544117835 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac0c3b10 0x7f77ac143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:15.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.969+0000 7f77b1a3d640 1 -- 172.21.15.8:0/1544117835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7798004d00 msgr2=0x7f77ac0c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:15.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.969+0000 7f77b1a3d640 1 --2- 172.21.15.8:0/1544117835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7798004d00 0x7f77ac0c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:15.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.969+0000 7f77b1a3d640 1 -- 172.21.15.8:0/1544117835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac0c4f80 con 0x7f77ac145e40 2023-10-14T10:36:15.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.969+0000 7f77b1a3d640 1 --2- 172.21.15.8:0/1544117835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac145e40 0x7f77ac143120 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f779c010860 tx=0x7f779c010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:36:15.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.970+0000 7f77a2ffd640 1 -- 172.21.15.8:0/1544117835 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c00eb60 con 0x7f77ac145e40 2023-10-14T10:36:15.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.970+0000 7f77a2ffd640 1 -- 172.21.15.8:0/1544117835 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c00ecc0 con 0x7f77ac145e40 2023-10-14T10:36:15.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.970+0000 7f77a2ffd640 1 -- 172.21.15.8:0/1544117835 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c01c400 con 0x7f77ac145e40 2023-10-14T10:36:15.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.970+0000 7f77b44a2640 1 -- 172.21.15.8:0/1544117835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ac143ba0 con 0x7f77ac145e40 2023-10-14T10:36:15.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.970+0000 7f77b44a2640 1 -- 172.21.15.8:0/1544117835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ac0c4010 con 0x7f77ac145e40 2023-10-14T10:36:15.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.971+0000 7f77b44a2640 1 -- 172.21.15.8:0/1544117835 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ac0c4250 con 0x7f77ac145e40 2023-10-14T10:36:15.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.972+0000 7f77a2ffd640 1 -- 172.21.15.8:0/1544117835 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f779c01c560 con 0x7f77ac145e40 2023-10-14T10:36:15.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.973+0000 7f77a2ffd640 1 --2- 172.21.15.8:0/1544117835 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f779006ae70 0x7f779006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:15.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.973+0000 7f77a2ffd640 1 -- 172.21.15.8:0/1544117835 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f779c089a20 con 0x7f77ac145e40 2023-10-14T10:36:15.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.973+0000 7f77b223e640 1 --2- 172.21.15.8:0/1544117835 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f779006ae70 0x7f779006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:15.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.974+0000 7f77b223e640 1 --2- 172.21.15.8:0/1544117835 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f779006ae70 0x7f779006d330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f77a8007a30 tx=0x7f77a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:36:15.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:15.977+0000 7f77a2ffd640 1 -- 172.21.15.8:0/1544117835 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f77ac0c4250 con 0x7f77ac145e40 2023-10-14T10:36:16.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.166+0000 7f77b44a2640 1 -- 172.21.15.8:0/1544117835 --> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77ac1542b0 con 0x7f779006ae70 2023-10-14T10:36:16.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.169+0000 7f77a2ffd640 1 -- 172.21.15.8:0/1544117835 <== mgr.4101 v2:172.21.15.8:6832/1591624325 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48122 (secure 0 0 0) 0x7f77a8001d60 con 0x7f779006ae70 2023-10-14T10:36:16.172 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:36:16.173 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T10:36:16.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.172+0000 7f77b44a2640 1 -- 172.21.15.8:0/1544117835 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f779006ae70 msgr2=0x7f779006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:16.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.172+0000 7f77b44a2640 1 --2- 172.21.15.8:0/1544117835 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f779006ae70 0x7f779006d330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f77a8007a30 tx=0x7f77a8009040 comp rx=0 tx=0).stop 2023-10-14T10:36:16.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.172+0000 7f77b44a2640 1 -- 172.21.15.8:0/1544117835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac145e40 msgr2=0x7f77ac143120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:16.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.172+0000 7f77b44a2640 1 --2- 172.21.15.8:0/1544117835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac145e40 0x7f77ac143120 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f779c010860 tx=0x7f779c010d20 comp rx=0 tx=0).stop 2023-10-14T10:36:16.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.172+0000 7f77b44a2640 1 -- 172.21.15.8:0/1544117835 shutdown_connections 2023-10-14T10:36:16.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.172+0000 7f77b44a2640 1 --2- 172.21.15.8:0/1544117835 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f779006ae70 0x7f779006d330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.172+0000 7f77b44a2640 1 --2- 172.21.15.8:0/1544117835 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77ac0c3b10 0x7f77ac143660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.172+0000 7f77b44a2640 1 --2- 172.21.15.8:0/1544117835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77ac145e40 0x7f77ac143120 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.172+0000 7f77b44a2640 1 --2- 172.21.15.8:0/1544117835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7798004d00 0x7f77ac0c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.172+0000 7f77b44a2640 1 -- 172.21.15.8:0/1544117835 >> 172.21.15.8:0/1544117835 conn(0x7f77ac0a74d0 msgr2=0x7f77ac073350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:36:16.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.173+0000 7f77b44a2640 1 -- 172.21.15.8:0/1544117835 shutdown_connections 2023-10-14T10:36:16.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.173+0000 7f77b44a2640 1 -- 172.21.15.8:0/1544117835 wait complete. 2023-10-14T10:36:16.194 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-10-14T10:36:14.683050+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237316,"kb_used_data":4520,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737404,"statfs":{"total":773094113280,"available":772851101696,"internally_reserved":0,"allocated":4628480,"data_stored":2535696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238276152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003456"},"pg_stats":[{"pgid":"1.0","version":"37'119","reported_seq":191,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T10:35:58.838549+0000","last_change":"2023-10-14T10:35:58.838712+0000","last_active":"2023-10-14T10:35:58.838549+0000","last_peered":"2023-10-14T10:35:58.838549+0000","last_clean":"2023-10-14T10:35:58.838549+0000","last_became_active":"2023-10-14T10:33:42.819441+0000","last_became_peered":"2023-10-14T10:33:42.819441+0000","last_unstale":"2023-10-14T10:35:58.838549+0000","last_undegraded":"2023-10-14T10:35:58.838549+0000","last_fullsized":"2023-10-14T10:35:58.838549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'119","last_scrub_stamp":"2023-10-14T10:35:58.838344+0000","last_deep_scrub":"37'119","last_deep_scrub_stamp":"2023-10-14T10:35:58.838344+0000","last_clean_scrub_stamp":"2023-10-14T10:35:58.838344+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:11:49.499159+0000","scrub_duration":0.013639833000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1024000,"data_stored":759738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.0009999999999999,"15min":0.97999999999999998},"min":{"1min":0.68100000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.573,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.117,"5min":1.1519999999999999,"15min":1.1579999999999999},"min":{"1min":0.622,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6830000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.643}]},{"osd":1,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.137,"15min":1.1259999999999999},"min":{"1min":0.69799999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7250000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.069},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.149,"15min":1.135},"min":{"1min":0.73999999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5620000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.5369999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.119,"15min":1.121},"min":{"1min":0.753,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6419999999999999,"5min":1.784,"15min":1.784},"last":1.018},{"interface":"front","average":{"1min":1.294,"5min":1.2849999999999999,"15min":1.2829999999999999},"min":{"1min":1.02,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.6659999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.4470000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2509999999999999,"15min":1.256},"min":{"1min":0.871,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.593,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.377,"5min":1.3580000000000001,"15min":1.355},"min":{"1min":0.91800000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.704,"5min":1.895,"15min":1.895},"last":1.177}]},{"osd":4,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.3380000000000001,"15min":1.3620000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.714,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.7470000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.3080000000000001,"15min":1.3200000000000001},"min":{"1min":0.96299999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.371}]},{"osd":5,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.4590000000000001,"15min":1.4730000000000001},"min":{"1min":1.048,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":1.798,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.335},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.502,"15min":1.518},"min":{"1min":0.96699999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8280000000000001,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.835}]},{"osd":6,"last update":"Sat Oct 14 10:35:44 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5840000000000001,"15min":1.593},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":1.778,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.9199999999999999},{"interface":"front","average":{"1min":1.504,"5min":1.554,"15min":1.5620000000000001},"min":{"1min":1.2789999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":1.873,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":1.1339999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.075,"15min":1.0800000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5669999999999999,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.333},{"interface":"front","average":{"1min":1.073,"5min":1.0940000000000001,"15min":1.0980000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6319999999999999,"5min":1.722,"15min":1.722},"last":1.5629999999999999}]},{"osd":1,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.163,"15min":1.169},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.655,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.165,"15min":1.159},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.681,"5min":1.821,"15min":1.821},"last":1.0409999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1559999999999999,"15min":1.1519999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.77,"5min":3.395,"15min":3.395},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.131,"5min":1.3160000000000001,"15min":1.347},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.639,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.85999999999999999}]},{"osd":3,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3080000000000001,"15min":1.319},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.6850000000000001,"5min":1.952,"15min":1.952},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.347,"15min":1.3700000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.526,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.2250000000000001}]},{"osd":4,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.4039999999999999,"15min":1.4299999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5880000000000001,"5min":1.921,"15min":1.921},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4590000000000001,"15min":1.4710000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.8640000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.71}]},{"osd":5,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.3149999999999999,"15min":1.3320000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6140000000000001,"5min":2.234,"15min":2.234},"last":1.405},{"interface":"front","average":{"1min":1.351,"5min":1.4570000000000001,"15min":1.4750000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.7350000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.6180000000000001}]},{"osd":7,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.474,"15min":1.484},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.8069999999999999,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.587,"15min":1.609},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.831,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":1.655}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0760000000000001,"15min":1.0700000000000001},"min":{"1min":0.70099999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.04},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1240000000000001,"15min":1.1200000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.694,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.083}]},{"osd":1,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.1990000000000001,"15min":1.2030000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.762,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.167,"15min":1.1779999999999999},"min":{"1min":0.65200000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5369999999999999,"5min":1.901,"15min":1.901},"last":1.423}]},{"osd":2,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1779999999999999,"15min":1.1799999999999999},"min":{"1min":0.74199999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5549999999999999,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.262,"15min":1.26},"min":{"1min":0.90500000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.6990000000000001,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.1599999999999999}]},{"osd":3,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2669999999999999,"15min":1.2589999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.593,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.208},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3879999999999999,"15min":1.393},"min":{"1min":0.97599999999999998,"5min":0.755,"15min":0.755},"max":{"1min":1.647,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":1.2829999999999999}]},{"osd":4,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.389,"15min":1.4119999999999999},"min":{"1min":0.94699999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.506,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":1.129},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.47,"15min":1.4850000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.718,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":1.55}]},{"osd":6,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.4630000000000001,"15min":1.4870000000000001},"min":{"1min":0.84299999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.714,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1},{"interface":"front","average":{"1min":1.379,"5min":1.4710000000000001,"15min":1.486},"min":{"1min":1.099,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6819999999999999,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.5960000000000001}]},{"osd":7,"last update":"Sat Oct 14 10:35:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.532,"15min":1.534},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.9019999999999999,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.637},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.611,"15min":1.627},"min":{"1min":0.99399999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.7629999999999999,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":1.377}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.046,"15min":1.022},"min":{"1min":0.68500000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6160000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.177,"15min":1.155},"min":{"1min":0.79300000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.712,"5min":1.734,"15min":1.734},"last":1.073}]},{"osd":1,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.171,"15min":1.145},"min":{"1min":0.88300000000000001,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.2130000000000001,"15min":1.196},"min":{"1min":0.97099999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.7529999999999999,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.1579999999999999}]},{"osd":2,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.1950000000000001,"15min":1.1699999999999999},"min":{"1min":0.84999999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.115},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3300000000000001,"15min":1.3260000000000001},"min":{"1min":0.88200000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.6759999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.246}]},{"osd":3,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.296,"15min":1.3080000000000001},"min":{"1min":0.76500000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.681,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.607},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.27,"15min":1.2629999999999999},"min":{"1min":0.93600000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.367}]},{"osd":5,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.3049999999999999,"15min":1.3240000000000001},"min":{"1min":0.76800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.645,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.4239999999999999,"15min":1.4319999999999999},"min":{"1min":0.86299999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.9039999999999999,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.4470000000000001}]},{"osd":6,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.379,"15min":1.387},"min":{"1min":0.93400000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.915,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.429,"15min":1.4279999999999999},"min":{"1min":1.04,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.4079999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:35:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.524,"15min":1.5249999999999999},"min":{"1min":0.91500000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.55},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5580000000000001,"15min":1.5529999999999999},"min":{"1min":1.1879999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.5109999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91900000000000004,"15min":0.92800000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.292,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93200000000000005,"15min":0.91900000000000004},"min":{"1min":0.63700000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4450000000000001,"5min":1.619,"15min":1.619},"last":1.018}]},{"osd":1,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94699999999999995,"15min":0.95499999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.069,"15min":1.0669999999999999},"min":{"1min":0.55400000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6519999999999999,"5min":1.679,"15min":1.679},"last":1.353}]},{"osd":2,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.2070000000000001,"15min":1.2170000000000001},"min":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6799999999999999,"5min":1.827,"15min":1.827},"last":1.204},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.24,"15min":1.242},"min":{"1min":0.63,"5min":0.628,"15min":0.628},"max":{"1min":1.6870000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.4419999999999999}]},{"osd":4,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.258,"15min":1.2549999999999999},"min":{"1min":0.94399999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3859999999999999,"15min":1.3919999999999999},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":1.6699999999999999,"5min":2.347,"15min":2.347},"last":1.5760000000000001}]},{"osd":5,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4119999999999999,"15min":1.4199999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.9810000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.534},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3660000000000001,"15min":1.3740000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.893,"5min":2.048,"15min":2.048},"last":1.476}]},{"osd":6,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.5149999999999999,"15min":1.5309999999999999},"min":{"1min":0.85899999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.851,"5min":2.504,"15min":2.504},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.5409999999999999,"15min":1.5509999999999999},"min":{"1min":1.1000000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":1.8240000000000001,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.7490000000000001}]},{"osd":7,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.4530000000000001,"15min":1.458},"min":{"1min":1.103,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.0409999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.778},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.581,"15min":1.5900000000000001},"min":{"1min":0.92900000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.984,"5min":2.419,"15min":2.419},"last":1.6639999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31604,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.92700000000000005,"15min":0.93000000000000005},"min":{"1min":0.42999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.46,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.232},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.64400000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6359999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.0780000000000001}]},{"osd":1,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.98099999999999998,"15min":0.997},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.425,"5min":1.476,"15min":1.476},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.103,"15min":1.105},"min":{"1min":0.61399999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6439999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.4670000000000001}]},{"osd":3,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.1379999999999999,"15min":1.1559999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4630000000000001,"5min":1.794,"15min":1.794},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1839999999999999,"15min":1.1830000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.659}]},{"osd":4,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4139999999999999,"15min":1.417},"min":{"1min":0.92500000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.839,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.823},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.373,"15min":1.399},"min":{"1min":0.76100000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.625,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.552}]},{"osd":5,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.478,"15min":1.506},"min":{"1min":0.86599999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.71,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.597},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4730000000000001,"15min":1.4770000000000001},"min":{"1min":0.878,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8879999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.9339999999999999}]},{"osd":6,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.4950000000000001,"15min":1.5329999999999999},"min":{"1min":0.89000000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6910000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.429},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5780000000000001,"15min":1.6080000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.885,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":1.702}]},{"osd":7,"last update":"Sat Oct 14 10:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.5289999999999999,"15min":1.5529999999999999},"min":{"1min":0.81399999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.9370000000000001,"5min":2.601,"15min":2.601},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.486,"5min":1.641,"15min":1.667},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.9490000000000001,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.8859999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":169370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.92500000000000004,"15min":0.94099999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4019999999999999,"5min":1.55,"15min":1.55},"last":1.042},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.95799999999999996,"15min":0.94399999999999995},"min":{"1min":0.48399999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.7569999999999999,"5min":2.258,"15min":2.258},"last":0.82599999999999996}]},{"osd":2,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93799999999999994,"15min":0.93600000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.387,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.661},{"interface":"front","average":{"1min":1.046,"5min":1.1220000000000001,"15min":1.135},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.556,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.4179999999999999}]},{"osd":3,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.135,"15min":1.125},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.851,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.1040000000000001,"15min":1.093},"min":{"1min":0.52600000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.754,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.6120000000000001}]},{"osd":4,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.83699999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.345,"15min":1.3520000000000001},"min":{"1min":0.748,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.0680000000000001,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.24}]},{"osd":5,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4750000000000001,"15min":1.4930000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.9139999999999999,"5min":4.1150000000000002,"15min":4.1150000000000002},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.506,"5min":1.6259999999999999,"15min":1.6459999999999999},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.004,"5min":4.242,"15min":4.242},"last":1.748}]},{"osd":6,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4670000000000001,"15min":1.4630000000000001},"min":{"1min":0.92400000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0510000000000002,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.4870000000000001,"15min":1.504},"min":{"1min":0.89200000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.724,"5min":3.02,"15min":3.02},"last":2.02}]},{"osd":7,"last update":"Sat Oct 14 10:35:43 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.5469999999999999,"15min":1.5629999999999999},"min":{"1min":0.79000000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.9490000000000001,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.367},{"interface":"front","average":{"1min":1.472,"5min":1.5289999999999999,"15min":1.5389999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.962,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":1.4870000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1024000,"data_stored":759738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88600000000000001,"15min":0.88300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.94999999999999996,"15min":0.94299999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.147}]},{"osd":2,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.131,"15min":1.143},"min":{"1min":0.50700000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.5229999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.077,"15min":1.091},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.552,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.85299999999999998}]},{"osd":3,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2310000000000001,"15min":1.2230000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.6839999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.488},{"interface":"front","average":{"1min":1.073,"5min":1.131,"15min":1.141},"min":{"1min":0.54900000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5660000000000001,"5min":3.673,"15min":3.673},"last":1.329}]},{"osd":4,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3149999999999999,"15min":1.319},"min":{"1min":0.78400000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4830000000000001,"15min":1.4890000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":1.292}]},{"osd":5,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.431,"15min":1.4390000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.274,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.506,"15min":1.5149999999999999},"min":{"1min":0.83399999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.9219999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.653}]},{"osd":6,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4910000000000001,"15min":1.4970000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.9450000000000001,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.444},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.6619999999999999,"15min":1.6899999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.1349999999999998,"5min":3.3519999999999999,"15min":3.3519999999999999},"last":1.7909999999999999}]},{"osd":7,"last update":"Sat Oct 14 10:35:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.556,"15min":1.55},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.6459999999999999,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.55,"15min":1.554},"min":{"1min":0.879,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.2360000000000002,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.6930000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T10:36:16.196 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-14T10:36:16.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.406+0000 7f2d50fb6640 1 Processor -- start 2023-10-14T10:36:16.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.407+0000 7f2d50fb6640 1 -- start start 2023-10-14T10:36:16.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.408+0000 7f2d50fb6640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d4c14f3a0 0x7f2d4c071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:16.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.408+0000 7f2d50fb6640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2d4c0bfee0 0x7f2d4c152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:16.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.408+0000 7f2d50fb6640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4c0c57a0 con 0x7f2d4c155440 2023-10-14T10:36:16.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.408+0000 7f2d50fb6640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4c06cee0 con 0x7f2d4c0bfee0 2023-10-14T10:36:16.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.408+0000 7f2d50fb6640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c151e50 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.409+0000 7f2d4ad9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2d4c0bfee0 0x7f2d4c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:16.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.409+0000 7f2d49d9b640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2d4c155440 0x7f2d4c06d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:37426/0 (socket says 172.21.15.8:37426) 2023-10-14T10:36:16.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.409+0000 7f2d49d9b640 1 -- 172.21.15.8:0/3478711852 learned_addr learned my addr 172.21.15.8:0/3478711852 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T10:36:16.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.409+0000 7f2d4a59c640 1 --2- 172.21.15.8:0/3478711852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d4c14f3a0 0x7f2d4c071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:16.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.409+0000 7f2d4ad9d640 1 -- 172.21.15.8:0/3478711852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d4c14f3a0 msgr2=0x7f2d4c071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:36:16.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.409+0000 7f2d4ad9d640 1 --2- 172.21.15.8:0/3478711852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d4c14f3a0 0x7f2d4c071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.409+0000 7f2d4ad9d640 1 -- 172.21.15.8:0/3478711852 >> v1:172.21.15.8:6789/0 conn(0x7f2d4c155440 legacy=0x7f2d4c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:16.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.409+0000 7f2d4ad9d640 1 -- 172.21.15.8:0/3478711852 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0c59f0 con 0x7f2d4c0bfee0 2023-10-14T10:36:16.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.409+0000 7f2d4959a640 1 -- 172.21.15.8:0/3478711852 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701125939 0 0) 0x7f2d4c0c57a0 con 0x7f2d4c155440 2023-10-14T10:36:16.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.411+0000 7f2d4ad9d640 1 --2- 172.21.15.8:0/3478711852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0bfee0 0x7f2d4c152580 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2d44009d90 tx=0x7f2d4402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4f6ada88a51d83 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:36:16.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.411+0000 7f2d4959a640 1 -- 172.21.15.8:0/3478711852 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4402cbc0 con 0x7f2d4c0bfee0 2023-10-14T10:36:16.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.411+0000 7f2d4959a640 1 -- 172.21.15.8:0/3478711852 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4402cd20 con 0x7f2d4c0bfee0 2023-10-14T10:36:16.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.411+0000 7f2d4959a640 1 -- 172.21.15.8:0/3478711852 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44034660 con 0x7f2d4c0bfee0 2023-10-14T10:36:16.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.412+0000 7f2d50fb6640 1 -- 172.21.15.8:0/3478711852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0bfee0 msgr2=0x7f2d4c152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:16.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.412+0000 7f2d50fb6640 1 --2- 172.21.15.8:0/3478711852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0bfee0 0x7f2d4c152580 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2d44009d90 tx=0x7f2d4402be10 comp rx=0 tx=0).stop 2023-10-14T10:36:16.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.412+0000 7f2d50fb6640 1 -- 172.21.15.8:0/3478711852 shutdown_connections 2023-10-14T10:36:16.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.412+0000 7f2d50fb6640 1 --2- 172.21.15.8:0/3478711852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c0bfee0 0x7f2d4c152580 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.412+0000 7f2d50fb6640 1 --2- 172.21.15.8:0/3478711852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d4c14f3a0 0x7f2d4c071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.412+0000 7f2d50fb6640 1 -- 172.21.15.8:0/3478711852 >> 172.21.15.8:0/3478711852 conn(0x7f2d4c0a74d0 msgr2=0x7f2d4c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:36:16.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.412+0000 7f2d50fb6640 1 -- 172.21.15.8:0/3478711852 shutdown_connections 2023-10-14T10:36:16.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.412+0000 7f2d50fb6640 1 -- 172.21.15.8:0/3478711852 wait complete. 2023-10-14T10:36:16.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.414+0000 7f2d50fb6640 1 Processor -- start 2023-10-14T10:36:16.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.415+0000 7f2d50fb6640 1 -- start start 2023-10-14T10:36:16.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.416+0000 7f2d50fb6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c0bfee0 0x7f2d4c1ecf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:16.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.416+0000 7f2d50fb6640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c14f3a0 0x7f2d4c14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:16.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.416+0000 7f2d50fb6640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d4c155440 0x7f2d4c149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:16.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.416+0000 7f2d50fb6640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c1ed4b0 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.416+0000 7f2d50fb6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c0a9080 con 0x7f2d4c0bfee0 2023-10-14T10:36:16.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.416+0000 7f2d50fb6640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c153680 con 0x7f2d4c155440 2023-10-14T10:36:16.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.416+0000 7f2d49d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c14f3a0 0x7f2d4c14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:16.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.416+0000 7f2d49d9b640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c14f3a0 0x7f2d4c14da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45306/0 (socket says 172.21.15.8:45306) 2023-10-14T10:36:16.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.416+0000 7f2d49d9b640 1 -- 172.21.15.8:0/1523206224 learned_addr learned my addr 172.21.15.8:0/1523206224 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:36:16.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d4ad9d640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d4c155440 0x7f2d4c149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:16.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d4a59c640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c0bfee0 0x7f2d4c1ecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:16.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d49d9b640 1 -- 172.21.15.8:0/1523206224 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d4c155440 msgr2=0x7f2d4c149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:16.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d49d9b640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d4c155440 0x7f2d4c149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d49d9b640 1 -- 172.21.15.8:0/1523206224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c0bfee0 msgr2=0x7f2d4c1ecf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:16.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d49d9b640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c0bfee0 0x7f2d4c1ecf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d49d9b640 1 -- 172.21.15.8:0/1523206224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d44009a70 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d4ad9d640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d4c155440 0x7f2d4c149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:36:16.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d4a59c640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c0bfee0 0x7f2d4c1ecf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T10:36:16.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d49d9b640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c14f3a0 0x7f2d4c14da20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000c410 tx=0x7f2d4000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:36:16.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d3affd640 1 -- 172.21.15.8:0/1523206224 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d400074e0 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d3affd640 1 -- 172.21.15.8:0/1523206224 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d40007660 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d3affd640 1 -- 172.21.15.8:0/1523206224 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40004a20 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.417+0000 7f2d50fb6640 1 -- 172.21.15.8:0/1523206224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4c153960 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.418+0000 7f2d50fb6640 1 -- 172.21.15.8:0/1523206224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c0a9360 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.419+0000 7f2d50fb6640 1 -- 172.21.15.8:0/1523206224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4c04e9b0 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.420+0000 7f2d3affd640 1 -- 172.21.15.8:0/1523206224 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2d40004b80 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.421+0000 7f2d3affd640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2d2c06aea0 0x7f2d2c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.421+0000 7f2d3affd640 1 -- 172.21.15.8:0/1523206224 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2d40089040 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.421+0000 7f2d4a59c640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2d2c06aea0 0x7f2d2c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:16.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.422+0000 7f2d4a59c640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2d2c06aea0 0x7f2d2c06d360 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c006fd0 tx=0x7f2d3c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:36:16.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.425+0000 7f2d3affd640 1 -- 172.21.15.8:0/1523206224 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d40057f10 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.623+0000 7f2d50fb6640 1 -- 172.21.15.8:0/1523206224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2d4c06d470 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.630+0000 7f2d3affd640 1 -- 172.21.15.8:0/1523206224 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v15)=0 v15) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2d40057aa0 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.632+0000 7f2d3affd640 1 -- 172.21.15.8:0/1523206224 <== mon.0 v2:172.21.15.8:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2d40057f10 con 0x7f2d4c14f3a0 2023-10-14T10:36:16.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.634+0000 7f2d50fb6640 1 -- 172.21.15.8:0/1523206224 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2d2c06aea0 msgr2=0x7f2d2c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:16.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.634+0000 7f2d50fb6640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2d2c06aea0 0x7f2d2c06d360 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c006fd0 tx=0x7f2d3c008040 comp rx=0 tx=0).stop 2023-10-14T10:36:16.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.634+0000 7f2d50fb6640 1 -- 172.21.15.8:0/1523206224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c14f3a0 msgr2=0x7f2d4c14da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:16.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.634+0000 7f2d50fb6640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c14f3a0 0x7f2d4c14da20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000c410 tx=0x7f2d4000c8d0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.634+0000 7f2d50fb6640 1 -- 172.21.15.8:0/1523206224 shutdown_connections 2023-10-14T10:36:16.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.634+0000 7f2d50fb6640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f2d2c06aea0 0x7f2d2c06d360 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.634+0000 7f2d50fb6640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d4c155440 0x7f2d4c149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.634+0000 7f2d50fb6640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d4c14f3a0 0x7f2d4c14da20 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.634+0000 7f2d50fb6640 1 --2- 172.21.15.8:0/1523206224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4c0bfee0 0x7f2d4c1ecf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.634+0000 7f2d50fb6640 1 -- 172.21.15.8:0/1523206224 >> 172.21.15.8:0/1523206224 conn(0x7f2d4c0a74d0 msgr2=0x7f2d4c0bf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:36:16.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.635+0000 7f2d50fb6640 1 -- 172.21.15.8:0/1523206224 shutdown_connections 2023-10-14T10:36:16.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.635+0000 7f2d50fb6640 1 -- 172.21.15.8:0/1523206224 wait complete. 2023-10-14T10:36:16.657 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T10:36:16.658 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T10:36:16.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.878+0000 7f354359e640 1 Processor -- start 2023-10-14T10:36:16.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.879+0000 7f354359e640 1 -- start start 2023-10-14T10:36:16.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.880+0000 7f354359e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3544151740 0x7f35440c7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:16.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.880+0000 7f354359e640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f35440c7ad0 0x7f35440c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:16.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.880+0000 7f354359e640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35440c7f60 con 0x7f35440c43a0 2023-10-14T10:36:16.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.880+0000 7f354359e640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35440c8f20 con 0x7f35440c7ad0 2023-10-14T10:36:16.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.880+0000 7f354359e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35440c4a20 con 0x7f3544151740 2023-10-14T10:36:16.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.881+0000 7f3542d9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f35440c7ad0 0x7f35440c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:16.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.881+0000 7f3542d9d640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f35440c7ad0 0x7f35440c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45318/0 (socket says 172.21.15.8:45318) 2023-10-14T10:36:16.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.881+0000 7f3542d9d640 1 -- 172.21.15.8:0/2343902993 learned_addr learned my addr 172.21.15.8:0/2343902993 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:36:16.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.881+0000 7f353bfff640 1 --1- 172.21.15.8:0/2343902993 >> v1:172.21.15.8:6789/0 conn(0x7f35440c43a0 0x7f35440c5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:37438/0 (socket says 172.21.15.8:37438) 2023-10-14T10:36:16.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.881+0000 7f354259c640 1 --2- 172.21.15.8:0/2343902993 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3544151740 0x7f35440c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:16.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.881+0000 7f3542d9d640 1 -- 172.21.15.8:0/2343902993 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3544151740 msgr2=0x7f35440c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T10:36:16.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.881+0000 7f3542d9d640 1 --2- 172.21.15.8:0/2343902993 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3544151740 0x7f35440c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.881+0000 7f3542d9d640 1 -- 172.21.15.8:0/2343902993 >> v1:172.21.15.8:6789/0 conn(0x7f35440c43a0 legacy=0x7f35440c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:16.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.881+0000 7f3542d9d640 1 -- 172.21.15.8:0/2343902993 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3544151b20 con 0x7f35440c7ad0 2023-10-14T10:36:16.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.882+0000 7f3542d9d640 1 --2- 172.21.15.8:0/2343902993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35440c7ad0 0x7f35440c5910 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f353c009e50 tx=0x7f353c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a86684d7267d13 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:36:16.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.883+0000 7f3541d9b640 1 -- 172.21.15.8:0/2343902993 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c02ca80 con 0x7f35440c7ad0 2023-10-14T10:36:16.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.883+0000 7f3541d9b640 1 -- 172.21.15.8:0/2343902993 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f353c02cbe0 con 0x7f35440c7ad0 2023-10-14T10:36:16.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.883+0000 7f3541d9b640 1 -- 172.21.15.8:0/2343902993 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0343f0 con 0x7f35440c7ad0 2023-10-14T10:36:16.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.883+0000 7f354359e640 1 -- 172.21.15.8:0/2343902993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35440c7ad0 msgr2=0x7f35440c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:16.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.883+0000 7f354359e640 1 --2- 172.21.15.8:0/2343902993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35440c7ad0 0x7f35440c5910 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f353c009e50 tx=0x7f353c02bee0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.884+0000 7f354359e640 1 -- 172.21.15.8:0/2343902993 shutdown_connections 2023-10-14T10:36:16.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.884+0000 7f354359e640 1 --2- 172.21.15.8:0/2343902993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35440c7ad0 0x7f35440c5910 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.884+0000 7f354359e640 1 --2- 172.21.15.8:0/2343902993 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3544151740 0x7f35440c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.884+0000 7f354359e640 1 -- 172.21.15.8:0/2343902993 >> 172.21.15.8:0/2343902993 conn(0x7f35440c9690 msgr2=0x7f35440c9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:36:16.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.884+0000 7f354359e640 1 -- 172.21.15.8:0/2343902993 shutdown_connections 2023-10-14T10:36:16.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.884+0000 7f354359e640 1 -- 172.21.15.8:0/2343902993 wait complete. 2023-10-14T10:36:16.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.885+0000 7f354359e640 1 Processor -- start 2023-10-14T10:36:16.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.885+0000 7f354359e640 1 -- start start 2023-10-14T10:36:16.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.886+0000 7f354359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35440c43a0 0x7f35440c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:16.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.886+0000 7f354359e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35440c7ad0 0x7f35440bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:16.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.886+0000 7f354359e640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3544151740 0x7f35440bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:16.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.886+0000 7f354359e640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35440be210 con 0x7f3544151740 2023-10-14T10:36:16.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.886+0000 7f354359e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354414a7a0 con 0x7f35440c43a0 2023-10-14T10:36:16.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.886+0000 7f354359e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35440be3f0 con 0x7f35440c7ad0 2023-10-14T10:36:16.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.887+0000 7f3542d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3544151740 0x7f35440bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:16.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.887+0000 7f3542d9d640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3544151740 0x7f35440bf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45332/0 (socket says 172.21.15.8:45332) 2023-10-14T10:36:16.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.887+0000 7f3542d9d640 1 -- 172.21.15.8:0/1473250617 learned_addr learned my addr 172.21.15.8:0/1473250617 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T10:36:16.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.887+0000 7f3542d9d640 1 -- 172.21.15.8:0/1473250617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35440c7ad0 msgr2=0x7f35440bf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:16.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.887+0000 7f3542d9d640 1 --2- 172.21.15.8:0/1473250617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35440c7ad0 0x7f35440bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.887+0000 7f3542d9d640 1 -- 172.21.15.8:0/1473250617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35440c43a0 msgr2=0x7f35440c0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:16.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.887+0000 7f3542d9d640 1 --2- 172.21.15.8:0/1473250617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35440c43a0 0x7f35440c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:16.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.887+0000 7f3542d9d640 1 -- 172.21.15.8:0/1473250617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c009b30 con 0x7f3544151740 2023-10-14T10:36:16.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.887+0000 7f3542d9d640 1 --2- 172.21.15.8:0/1473250617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3544151740 0x7f35440bf6f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f353c02bf20 tx=0x7f353c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:36:16.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.888+0000 7f353affd640 1 -- 172.21.15.8:0/1473250617 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c009510 con 0x7f3544151740 2023-10-14T10:36:16.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.888+0000 7f353affd640 1 -- 172.21.15.8:0/1473250617 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f353c03e450 con 0x7f3544151740 2023-10-14T10:36:16.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.888+0000 7f353affd640 1 -- 172.21.15.8:0/1473250617 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c03e820 con 0x7f3544151740 2023-10-14T10:36:16.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.888+0000 7f354359e640 1 -- 172.21.15.8:0/1473250617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35440be6d0 con 0x7f3544151740 2023-10-14T10:36:16.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.888+0000 7f354359e640 1 -- 172.21.15.8:0/1473250617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35440bec90 con 0x7f3544151740 2023-10-14T10:36:16.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.889+0000 7f354359e640 1 -- 172.21.15.8:0/1473250617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354406c0d0 con 0x7f3544151740 2023-10-14T10:36:16.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.890+0000 7f353affd640 1 -- 172.21.15.8:0/1473250617 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f353c02cd50 con 0x7f3544151740 2023-10-14T10:36:16.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.891+0000 7f353affd640 1 --2- 172.21.15.8:0/1473250617 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f352406ae70 0x7f352406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T10:36:16.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.891+0000 7f353affd640 1 -- 172.21.15.8:0/1473250617 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f353c0abfe0 con 0x7f3544151740 2023-10-14T10:36:16.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.891+0000 7f354259c640 1 --2- 172.21.15.8:0/1473250617 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f352406ae70 0x7f352406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T10:36:16.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.892+0000 7f354259c640 1 --2- 172.21.15.8:0/1473250617 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f352406ae70 0x7f352406d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3534006fd0 tx=0x7f3534008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T10:36:16.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:16.895+0000 7f353affd640 1 -- 172.21.15.8:0/1473250617 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f353c0773a0 con 0x7f3544151740 2023-10-14T10:36:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.131+0000 7f354359e640 1 -- 172.21.15.8:0/1473250617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35440bee80 con 0x7f3544151740 2023-10-14T10:36:17.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.132+0000 7f353affd640 1 -- 172.21.15.8:0/1473250617 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3687 (secure 0 0 0) 0x7f353c07a9c0 con 0x7f3544151740 2023-10-14T10:36:17.134 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T10:36:17.134 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1474692193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1474692193},{"type":"v1","addr":"172.21.15.8:6835","nonce":1474692193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045070429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045070429},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045070429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/337485030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":337485030},{"type":"v1","addr":"172.21.15.92:6834","nonce":337485030}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/131845705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":131845705},{"type":"v1","addr":"172.21.15.8:6837","nonce":131845705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-10-14T10:36:17.135 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 19 2023-10-14T10:36:17.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.134+0000 7f354359e640 1 -- 172.21.15.8:0/1473250617 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f352406ae70 msgr2=0x7f352406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.134+0000 7f354359e640 1 --2- 172.21.15.8:0/1473250617 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f352406ae70 0x7f352406d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3534006fd0 tx=0x7f3534008040 comp rx=0 tx=0).stop 2023-10-14T10:36:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.134+0000 7f354359e640 1 -- 172.21.15.8:0/1473250617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3544151740 msgr2=0x7f35440bf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T10:36:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.134+0000 7f354359e640 1 --2- 172.21.15.8:0/1473250617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3544151740 0x7f35440bf6f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f353c02bf20 tx=0x7f353c004a40 comp rx=0 tx=0).stop 2023-10-14T10:36:17.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.134+0000 7f354359e640 1 -- 172.21.15.8:0/1473250617 shutdown_connections 2023-10-14T10:36:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.134+0000 7f354359e640 1 --2- 172.21.15.8:0/1473250617 >> [v2:172.21.15.8:6832/1591624325,v1:172.21.15.8:6833/1591624325] conn(0x7f352406ae70 0x7f352406d330 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.134+0000 7f354359e640 1 --2- 172.21.15.8:0/1473250617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3544151740 0x7f35440bf6f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:17.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.134+0000 7f354359e640 1 --2- 172.21.15.8:0/1473250617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35440c7ad0 0x7f35440bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.134+0000 7f354359e640 1 --2- 172.21.15.8:0/1473250617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35440c43a0 0x7f35440c0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T10:36:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.134+0000 7f354359e640 1 -- 172.21.15.8:0/1473250617 >> 172.21.15.8:0/1473250617 conn(0x7f35440c9690 msgr2=0x7f35440c5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T10:36:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.134+0000 7f354359e640 1 -- 172.21.15.8:0/1473250617 shutdown_connections 2023-10-14T10:36:17.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T10:36:17.135+0000 7f354359e640 1 -- 172.21.15.8:0/1473250617 wait complete. 2023-10-14T10:36:17.156 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-14T10:36:17.157 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T10:36:17.157 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T10:36:17.158 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.173 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T10:36:17.174 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T10:36:17.174 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.236 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T10:36:17.237 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T10:36:17.238 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.260 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T10:36:17.260 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T10:36:17.261 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.323 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T10:36:17.323 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T10:36:17.324 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T10:36:17.324 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.369 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T10:36:17.370 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T10:36:17.370 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.433 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T10:36:17.434 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T10:36:17.434 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.492 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T10:36:17.493 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-14T10:36:17.493 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.568 INFO:tasks.ceph.osd.3:Stopped 2023-10-14T10:36:17.569 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-14T10:36:17.569 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.641 INFO:tasks.ceph.osd.4:Stopped 2023-10-14T10:36:17.642 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-14T10:36:17.642 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.688 INFO:tasks.ceph.osd.5:Stopped 2023-10-14T10:36:17.688 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-14T10:36:17.689 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.744 INFO:tasks.ceph.osd.6:Stopped 2023-10-14T10:36:17.745 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-14T10:36:17.745 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.806 INFO:tasks.ceph.osd.7:Stopped 2023-10-14T10:36:17.807 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T10:36:17.808 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-14T10:36:17.808 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.891 INFO:tasks.ceph.mgr.y:Stopped 2023-10-14T10:36:17.892 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T10:36:17.893 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:17.981 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T10:36:17.982 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T10:36:17.982 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T10:36:17.982 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:18.032 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T10:36:18.033 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-14T10:36:18.033 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:18.065 INFO:tasks.ceph.mon.b:Stopped 2023-10-14T10:36:18.066 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-14T10:36:18.066 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T10:36:18.141 INFO:tasks.ceph.mon.c:Stopped 2023-10-14T10:36:18.142 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T10:36:18.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v '\(MDS_INSUFFICIENT_STANDBY\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(FS_DEGRADED\)' | head -n 1 2023-10-14T10:36:18.263 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:36:18.264 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T10:36:18.513 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:36:18.513 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T10:36:18.678 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:36:18.679 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T10:36:18.837 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:36:18.838 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-14T10:36:18.997 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T10:36:18.997 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-14T10:36:19.256 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T10:36:19.257 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-14T10:36:19.412 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T10:36:19.413 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-14T10:36:19.572 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T10:36:19.573 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-14T10:36:19.742 INFO:tasks.ceph:Archiving mon data... 2023-10-14T10:36:19.746 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217/data/mon.a.tgz 2023-10-14T10:36:19.747 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-10-14T10:36:19.811 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.ml1FWvkM4G 2023-10-14T10:36:19.812 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ml1FWvkM4G 2023-10-14T10:36:19.999 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.ml1FWvkM4G 2023-10-14T10:36:20.168 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.ml1FWvkM4G is 289KB 2023-10-14T10:36:20.280 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.ml1FWvkM4G 2023-10-14T10:36:20.342 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217/data/mon.b.tgz 2023-10-14T10:36:20.343 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2023-10-14T10:36:20.403 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.K5sBzZPz8j 2023-10-14T10:36:20.404 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.K5sBzZPz8j 2023-10-14T10:36:20.603 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.K5sBzZPz8j 2023-10-14T10:36:20.758 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.K5sBzZPz8j is 391KB 2023-10-14T10:36:20.868 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.K5sBzZPz8j 2023-10-14T10:36:20.930 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217/data/mon.c.tgz 2023-10-14T10:36:20.930 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2023-10-14T10:36:20.985 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.J3N2L9n0du 2023-10-14T10:36:20.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.J3N2L9n0du 2023-10-14T10:36:21.169 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.J3N2L9n0du 2023-10-14T10:36:21.324 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.J3N2L9n0du is 391KB 2023-10-14T10:36:21.429 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.J3N2L9n0du 2023-10-14T10:36:21.489 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T10:36:21.489 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T10:36:21.498 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T10:36:21.597 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T10:36:21.598 DEBUG:teuthology.orchestra.run.smithi008:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T10:36:21.606 DEBUG:teuthology.orchestra.run.smithi092:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T10:36:21.705 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T10:36:21.711 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T10:36:21.725 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T10:36:21.727 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217/remote/smithi008/crash 2023-10-14T10:36:21.728 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T10:36:21.812 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217/remote/smithi092/crash 2023-10-14T10:36:21.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T10:36:21.913 INFO:tasks.ceph:Shutting down logrotate 2023-10-14T10:36:21.913 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:36:21.922 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T10:36:22.052 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T10:36:22.162 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T10:36:22.265 INFO:tasks.ceph:Compressing logs... 2023-10-14T10:36:22.266 DEBUG:teuthology.orchestra.run.smithi008:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T10:36:22.275 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T10:36:22.369 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-14T10:36:22.370 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87485.log 2023-10-14T10:36:22.371 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T10:36:22.372 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.87485.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87485.log.gz 2023-10-14T10:36:22.373 INFO:teuthology.orchestra.run.smithi092.stderr: -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-14T10:36:22.373 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87405.log 2023-10-14T10:36:22.374 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99653.log 2023-10-14T10:36:22.375 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87645.log 2023-10-14T10:36:22.375 INFO:teuthology.orchestra.run.smithi092.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-14T10:36:22.376 INFO:teuthology.orchestra.run.smithi092.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T10:36:22.378 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98866.log 2023-10-14T10:36:22.378 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93657.log 2023-10-14T10:36:22.378 INFO:teuthology.orchestra.run.smithi008.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99653.log.gz 2023-10-14T10:36:22.379 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91977.log 2023-10-14T10:36:22.379 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.87405.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87405.log.gz 2023-10-14T10:36:22.379 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-14T10:36:22.379 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.87645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92893.log 2023-10-14T10:36:22.380 INFO:teuthology.orchestra.run.smithi092.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87645.log.gz 2023-10-14T10:36:22.382 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-14T10:36:22.382 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.1.92893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92893.log.gz 2023-10-14T10:36:22.383 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-14T10:36:22.383 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87445.log 2023-10-14T10:36:22.384 INFO:teuthology.orchestra.run.smithi008.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98866.log.gz 2023-10-14T10:36:22.385 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93657.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93657.log.gz 2023-10-14T10:36:22.385 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98571.log 2023-10-14T10:36:22.385 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91977.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91977.log.gz 2023-10-14T10:36:22.386 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93125.log 2023-10-14T10:36:22.386 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92448.log 2023-10-14T10:36:22.386 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93125.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.98571.log.gz 2023-10-14T10:36:22.387 INFO:teuthology.orchestra.run.smithi008.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93125.log.gz 2023-10-14T10:36:22.387 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T10:36:22.387 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92448.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92448.log.gz 2023-10-14T10:36:22.387 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96082.log 2023-10-14T10:36:22.390 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99407.log 2023-10-14T10:36:22.390 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91548.log 2023-10-14T10:36:22.391 INFO:teuthology.orchestra.run.smithi008.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96082.log.gz 2023-10-14T10:36:22.391 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99407.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99407.log.gz 2023-10-14T10:36:22.391 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97483.log 2023-10-14T10:36:22.392 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91548.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91548.log.gzgzip 2023-10-14T10:36:22.392 INFO:teuthology.orchestra.run.smithi008.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96250.log 2023-10-14T10:36:22.393 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92902.log 2023-10-14T10:36:22.393 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.87445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87685.log 2023-10-14T10:36:22.394 INFO:teuthology.orchestra.run.smithi092.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87445.log.gz 2023-10-14T10:36:22.394 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.1.92902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92902.log.gz 2023-10-14T10:36:22.394 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87605.log 2023-10-14T10:36:22.395 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.87685.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.87685.log.gz 2023-10-14T10:36:22.395 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T10:36:22.395 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.87605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87525.log 2023-10-14T10:36:22.395 INFO:teuthology.orchestra.run.smithi092.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87605.log.gz 2023-10-14T10:36:22.396 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T10:36:22.396 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.87525.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87525.log.gz 2023-10-14T10:36:22.396 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-14T10:36:22.399 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87565.log 2023-10-14T10:36:22.399 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mon.b.log: 91.7% 92.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T10:36:22.399 INFO:teuthology.orchestra.run.smithi092.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T10:36:22.400 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-14T10:36:22.400 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.87565.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87565.log.gz 2023-10-14T10:36:22.402 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92788.log 2023-10-14T10:36:22.402 INFO:teuthology.orchestra.run.smithi008.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97483.log.gz 2023-10-14T10:36:22.402 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96250.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96250.log.gz 2023-10-14T10:36:22.403 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99118.log 2023-10-14T10:36:22.403 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92788.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92788.log.gzgzip 2023-10-14T10:36:22.403 INFO:teuthology.orchestra.run.smithi008.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.99034.log 2023-10-14T10:36:22.404 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99118.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99118.log.gz 2023-10-14T10:36:22.404 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93531.log 2023-10-14T10:36:22.404 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99034.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99034.log.gz 2023-10-14T10:36:22.404 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98187.log 2023-10-14T10:36:22.405 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96334.log 2023-10-14T10:36:22.405 INFO:teuthology.orchestra.run.smithi008.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93531.log.gz 2023-10-14T10:36:22.405 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98187.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98187.log.gz 2023-10-14T10:36:22.406 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94801.log 2023-10-14T10:36:22.406 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96334.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96334.log.gz 2023-10-14T10:36:22.406 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94843.log 2023-10-14T10:36:22.406 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.94801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96292.log 2023-10-14T10:36:22.407 INFO:teuthology.orchestra.run.smithi008.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94801.log.gz 2023-10-14T10:36:22.410 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-14T10:36:22.410 INFO:teuthology.orchestra.run.smithi092.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-14T10:36:22.413 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.94843.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94843.log.gz 2023-10-14T10:36:22.413 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91492.log 2023-10-14T10:36:22.414 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99611.log 2023-10-14T10:36:22.414 INFO:teuthology.orchestra.run.smithi008.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96292.log.gz 2023-10-14T10:36:22.414 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94551.log 2023-10-14T10:36:22.415 INFO:teuthology.orchestra.run.smithi008.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91492.log.gz 2023-10-14T10:36:22.415 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99611.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99611.log.gz 2023-10-14T10:36:22.415 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99280.log 2023-10-14T10:36:22.415 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.94551.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94551.log.gz 2023-10-14T10:36:22.416 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96955.log 2023-10-14T10:36:22.416 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99280.log: gzip -5 87.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.99280.log.gz -- 2023-10-14T10:36:22.416 INFO:teuthology.orchestra.run.smithi008.stderr: /var/log/ceph/ceph-client.admin.98463.log 2023-10-14T10:36:22.416 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96955.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96955.log.gz 2023-10-14T10:36:22.417 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96420.log 2023-10-14T10:36:22.417 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87364.log 2023-10-14T10:36:22.417 INFO:teuthology.orchestra.run.smithi008.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.98463.log.gz 2023-10-14T10:36:22.419 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92229.log 2023-10-14T10:36:22.420 INFO:teuthology.orchestra.run.smithi008.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96420.log.gz 2023-10-14T10:36:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.87364.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87364.log.gz 2023-10-14T10:36:22.420 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97887.log 2023-10-14T10:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92229.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92229.log.gz 2023-10-14T10:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93363.log 2023-10-14T10:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95431.log 2023-10-14T10:36:22.421 INFO:teuthology.orchestra.run.smithi008.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97887.log.gz 2023-10-14T10:36:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93363.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93363.log.gz 2023-10-14T10:36:22.422 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92450.log 2023-10-14T10:36:22.423 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93615.log 2023-10-14T10:36:22.423 INFO:teuthology.orchestra.run.smithi008.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95431.log.gz 2023-10-14T10:36:22.424 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92785.log 2023-10-14T10:36:22.424 INFO:teuthology.orchestra.run.smithi008.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92450.log.gz 2023-10-14T10:36:22.424 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93615.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93615.log.gz 2023-10-14T10:36:22.425 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95752.log 2023-10-14T10:36:22.425 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92785.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92785.log.gz -5 2023-10-14T10:36:22.426 INFO:teuthology.orchestra.run.smithi008.stderr: --verbose -- /var/log/ceph/ceph-client.admin.93951.log 2023-10-14T10:36:22.426 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92453.log 2023-10-14T10:36:22.427 INFO:teuthology.orchestra.run.smithi008.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95752.log.gz 2023-10-14T10:36:22.427 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100367.log 2023-10-14T10:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.93951.log.gz 2023-10-14T10:36:22.428 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95137.log 2023-10-14T10:36:22.429 INFO:teuthology.orchestra.run.smithi008.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92453.log.gz 2023-10-14T10:36:22.430 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93113.log 2023-10-14T10:36:22.430 INFO:teuthology.orchestra.run.smithi008.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100367.log.gz 2023-10-14T10:36:22.431 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95137.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95137.log.gz 2023-10-14T10:36:22.431 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96504.log 2023-10-14T10:36:22.432 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93113.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93113.log.gz 2023-10-14T10:36:22.433 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95626.log 2023-10-14T10:36:22.434 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100031.log 2023-10-14T10:36:22.434 INFO:teuthology.orchestra.run.smithi008.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96504.log.gz 2023-10-14T10:36:22.435 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95626.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95626.log.gz 2023-10-14T10:36:22.435 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99220.log 2023-10-14T10:36:22.436 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92435.log 2023-10-14T10:36:22.436 INFO:teuthology.orchestra.run.smithi008.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100031.log.gz 2023-10-14T10:36:22.437 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95095.log 2023-10-14T10:36:22.438 INFO:teuthology.orchestra.run.smithi008.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99220.log.gz 2023-10-14T10:36:22.439 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92435.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92435.log.gz 2023-10-14T10:36:22.439 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92271.log 2023-10-14T10:36:22.440 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95095.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95095.log.gz 2023-10-14T10:36:22.440 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93124.log 2023-10-14T10:36:22.441 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92271.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92271.log.gz 2023-10-14T10:36:22.442 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92187.log 2023-10-14T10:36:22.443 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97929.log 2023-10-14T10:36:22.443 INFO:teuthology.orchestra.run.smithi008.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93124.log.gz 2023-10-14T10:36:22.444 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98637.log 2023-10-14T10:36:22.444 INFO:teuthology.orchestra.run.smithi008.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92187.log.gz 2023-10-14T10:36:22.445 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97929.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97929.log.gz 2023-10-14T10:36:22.445 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95473.log 2023-10-14T10:36:22.447 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98637.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98637.log.gz 2023-10-14T10:36:22.447 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96040.log 2023-10-14T10:36:22.448 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98529.log 2023-10-14T10:36:22.448 INFO:teuthology.orchestra.run.smithi008.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95473.log.gz 2023-10-14T10:36:22.449 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96040.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96040.log.gz 2023-10-14T10:36:22.449 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97779.log 2023-10-14T10:36:22.450 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98529.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98529.log.gz 2023-10-14T10:36:22.451 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96747.log 2023-10-14T10:36:22.452 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97293.log 2023-10-14T10:36:22.452 INFO:teuthology.orchestra.run.smithi008.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97779.log.gz 2023-10-14T10:36:22.453 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96747.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96747.log.gz 2023-10-14T10:36:22.453 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93111.log 2023-10-14T10:36:22.454 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97293.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97293.log.gz 2023-10-14T10:36:22.455 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95347.log 2023-10-14T10:36:22.456 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100511.log 2023-10-14T10:36:22.456 INFO:teuthology.orchestra.run.smithi008.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.93111.log.gz 2023-10-14T10:36:22.457 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95347.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95347.log.gz 2023-10-14T10:36:22.457 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95179.log 2023-10-14T10:36:22.458 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100511.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T10:36:22.459 INFO:teuthology.orchestra.run.smithi008.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100511.log.gz 2023-10-14T10:36:22.459 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95179.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95179.log.gz 2023-10-14T10:36:22.460 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94053.log 2023-10-14T10:36:22.461 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99449.log 2023-10-14T10:36:22.462 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.94053.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T10:36:22.463 INFO:teuthology.orchestra.run.smithi008.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94053.log.gz 2023-10-14T10:36:22.463 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99178.log 2023-10-14T10:36:22.464 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99449.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99449.log.gz 2023-10-14T10:36:22.464 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91657.log 2023-10-14T10:36:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99178.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99178.log.gz 2023-10-14T10:36:22.465 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99491.log 2023-10-14T10:36:22.466 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91657.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91657.log.gz 2023-10-14T10:36:22.466 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93573.log 2023-10-14T10:36:22.467 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99491.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99491.log.gz 2023-10-14T10:36:22.467 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99076.log 2023-10-14T10:36:22.468 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93094.log 2023-10-14T10:36:22.469 INFO:teuthology.orchestra.run.smithi008.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93573.log.gz 2023-10-14T10:36:22.470 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99076.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99076.log.gz 2023-10-14T10:36:22.470 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93123.log 2023-10-14T10:36:22.471 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93094.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93094.log.gz 2023-10-14T10:36:22.471 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92787.log 2023-10-14T10:36:22.472 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93489.log 2023-10-14T10:36:22.473 INFO:teuthology.orchestra.run.smithi008.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93123.log.gz 2023-10-14T10:36:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92787.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92787.log.gz 2023-10-14T10:36:22.474 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93447.log 2023-10-14T10:36:22.475 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94591.log 2023-10-14T10:36:22.475 INFO:teuthology.orchestra.run.smithi008.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93489.log.gz 2023-10-14T10:36:22.476 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93447.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93447.log.gz 2023-10-14T10:36:22.476 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95263.log 2023-10-14T10:36:22.477 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mon.c.log: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-14T10:36:22.478 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.94591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96870.log 2023-10-14T10:36:22.478 INFO:teuthology.orchestra.run.smithi008.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94591.log.gz 2023-10-14T10:36:22.479 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95263.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95263.log.gz 2023-10-14T10:36:22.479 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100115.log 2023-10-14T10:36:22.480 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96870.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.96870.log.gz /var/log/ceph/ceph-client.admin.92019.log 2023-10-14T10:36:22.480 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-14T10:36:22.481 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100115.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100115.log.gz 2023-10-14T10:36:22.482 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96913.log 2023-10-14T10:36:22.482 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92019.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.92019.log.gz 2023-10-14T10:36:22.483 INFO:teuthology.orchestra.run.smithi008.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.100325.log 2023-10-14T10:36:22.484 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96913.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96913.log.gz 2023-10-14T10:36:22.484 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100157.log 2023-10-14T10:36:22.485 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100325.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100325.log.gz 2023-10-14T10:36:22.485 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92145.log 2023-10-14T10:36:22.486 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100157.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100157.log.gz 2023-10-14T10:36:22.487 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98313.log 2023-10-14T10:36:22.488 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92145.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92145.log.gz 2023-10-14T10:36:22.488 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98992.log 2023-10-14T10:36:22.489 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98313.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98313.log.gz 2023-10-14T10:36:22.489 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91447.log 2023-10-14T10:36:22.490 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98992.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98992.log.gz 2023-10-14T10:36:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95710.log 2023-10-14T10:36:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91447.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91447.log.gz 2023-10-14T10:36:22.492 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98824.log 2023-10-14T10:36:22.493 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95710.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95710.log.gz 2023-10-14T10:36:22.493 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95998.log 2023-10-14T10:36:22.494 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96166.log 2023-10-14T10:36:22.494 INFO:teuthology.orchestra.run.smithi008.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98824.log.gz 2023-10-14T10:36:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95998.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95998.log.gz 2023-10-14T10:36:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93825.log 2023-10-14T10:36:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96166.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96166.log.gz 2023-10-14T10:36:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91366.log 2023-10-14T10:36:22.498 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97527.log 2023-10-14T10:36:22.498 INFO:teuthology.orchestra.run.smithi008.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93825.log.gz 2023-10-14T10:36:22.499 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91366.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91366.log.gz 2023-10-14T10:36:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93909.log 2023-10-14T10:36:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97527.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97527.log.gz 2023-10-14T10:36:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93699.log 2023-10-14T10:36:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100283.log 2023-10-14T10:36:22.502 INFO:teuthology.orchestra.run.smithi008.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93909.log.gz 2023-10-14T10:36:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93699.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93699.log.gz 2023-10-14T10:36:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94885.log 2023-10-14T10:36:22.504 INFO:teuthology.orchestra.run.smithi092.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-14T10:36:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100283.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100283.log.gz 2023-10-14T10:36:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T10:36:22.506 INFO:teuthology.orchestra.run.smithi092.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-14T10:36:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.94885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94927.log 2023-10-14T10:36:22.507 INFO:teuthology.orchestra.run.smithi008.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94885.log.gz 2023-10-14T10:36:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93321.log 2023-10-14T10:36:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.94927.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94927.log.gz 2023-10-14T10:36:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96564.log 2023-10-14T10:36:22.510 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96828.log 2023-10-14T10:36:22.510 INFO:teuthology.orchestra.run.smithi008.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93321.log.gz 2023-10-14T10:36:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96564.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96564.log.gz 2023-10-14T10:36:22.511 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92775.log 2023-10-14T10:36:22.512 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96828.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96828.log.gz 2023-10-14T10:36:22.512 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97821.log 2023-10-14T10:36:22.513 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92775.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92775.log.gz 2023-10-14T10:36:22.514 INFO:teuthology.orchestra.run.smithi008.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95956.log 2023-10-14T10:36:22.515 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92452.log 2023-10-14T10:36:22.515 INFO:teuthology.orchestra.run.smithi008.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.97821.log.gz 2023-10-14T10:36:22.516 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95956.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95956.log.gz 2023-10-14T10:36:22.516 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91891.log 2023-10-14T10:36:22.517 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92452.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92452.log.gz 2023-10-14T10:36:22.517 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95389.log 2023-10-14T10:36:22.518 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91891.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.91891.log.gz /var/log/ceph/ceph-client.admin.92789.log 2023-10-14T10:36:22.519 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-14T10:36:22.520 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95389.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95389.log.gz 2023-10-14T10:36:22.520 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92783.log 2023-10-14T10:36:22.521 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92789.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.92789.log.gz 2023-10-14T10:36:22.521 INFO:teuthology.orchestra.run.smithi008.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.97441.log 2023-10-14T10:36:22.522 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92783.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92783.log.gz 2023-10-14T10:36:22.522 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98421.log 2023-10-14T10:36:22.523 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97441.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97441.log.gz 2023-10-14T10:36:22.524 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87108.log 2023-10-14T10:36:22.525 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98421.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98421.log.gz 2023-10-14T10:36:22.525 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98782.log 2023-10-14T10:36:22.526 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.87108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94395.log 2023-10-14T10:36:22.526 INFO:teuthology.orchestra.run.smithi008.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.87108.log.gz 2023-10-14T10:36:22.527 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98782.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98782.log.gz 2023-10-14T10:36:22.527 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99779.log 2023-10-14T10:36:22.528 INFO:teuthology.orchestra.run.smithi092.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-14T10:36:22.529 INFO:teuthology.orchestra.run.smithi092.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-14T10:36:22.529 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.0.94395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.94395.log.gz 2023-10-14T10:36:22.530 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100241.log 2023-10-14T10:36:22.530 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99779.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99779.log.gz 2023-10-14T10:36:22.531 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94633.log 2023-10-14T10:36:22.531 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100241.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100241.log.gz 2023-10-14T10:36:22.532 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99365.log 2023-10-14T10:36:22.532 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.94633.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94633.log.gz 2023-10-14T10:36:22.533 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91270.log 2023-10-14T10:36:22.534 INFO:teuthology.orchestra.run.smithi092.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-14T10:36:22.535 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99365.log: gzip -5 --verbose 89.1% -- -- replaced with /var/log/ceph/ceph-client.admin.99365.log.gz /var/log/ceph/ceph-client.admin.93405.log 2023-10-14T10:36:22.535 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-14T10:36:22.536 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91270.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91270.log.gz 2023-10-14T10:36:22.536 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98355.log 2023-10-14T10:36:22.537 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93405.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93405.log.gz 2023-10-14T10:36:22.538 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95668.log 2023-10-14T10:36:22.539 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96607.log 2023-10-14T10:36:22.539 INFO:teuthology.orchestra.run.smithi008.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.98355.log.gz 2023-10-14T10:36:22.540 INFO:teuthology.orchestra.run.smithi092.stderr: 2023-10-14T10:36:22.540 INFO:teuthology.orchestra.run.smithi092.stderr:real 0m0.210s 2023-10-14T10:36:22.540 INFO:teuthology.orchestra.run.smithi092.stderr:user 0m0.730s 2023-10-14T10:36:22.541 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m0.198s 2023-10-14T10:36:22.542 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95668.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95668.log.gz 2023-10-14T10:36:22.542 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91601.log 2023-10-14T10:36:22.543 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96607.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96607.log.gz 2023-10-14T10:36:22.543 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91799.log 2023-10-14T10:36:22.543 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91601.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91601.log.gz 2023-10-14T10:36:22.544 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93783.log 2023-10-14T10:36:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91799.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91799.log.gz 2023-10-14T10:36:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97737.log 2023-10-14T10:36:22.545 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93783.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.93783.log.gz 2023-10-14T10:36:22.546 INFO:teuthology.orchestra.run.smithi008.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.97123.log 2023-10-14T10:36:22.547 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97737.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97737.log.gz 2023-10-14T10:36:22.547 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93867.log 2023-10-14T10:36:22.548 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97123.log: gzip -5 89.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.97123.log.gz -- 2023-10-14T10:36:22.548 INFO:teuthology.orchestra.run.smithi008.stderr: /var/log/ceph/ceph-osd.3.log 2023-10-14T10:36:22.549 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93867.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93867.log.gz 2023-10-14T10:36:22.549 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95053.log 2023-10-14T10:36:22.550 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97398.log 2023-10-14T10:36:22.551 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95053.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95053.log.gz 2023-10-14T10:36:22.552 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97695.log 2023-10-14T10:36:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97398.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97398.log.gz 2023-10-14T10:36:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91849.log 2023-10-14T10:36:22.554 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100073.log 2023-10-14T10:36:22.555 INFO:teuthology.orchestra.run.smithi008.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97695.log.gz 2023-10-14T10:36:22.556 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91849.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91849.log.gz 2023-10-14T10:36:22.557 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92780.log 2023-10-14T10:36:22.559 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100073.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100073.log.gz 2023-10-14T10:36:22.559 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97207.log 2023-10-14T10:36:22.561 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92780.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92780.log.gz 2023-10-14T10:36:22.561 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99695.log 2023-10-14T10:36:22.563 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97207.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.81119.log 2023-10-14T10:36:22.563 INFO:teuthology.orchestra.run.smithi008.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97207.log.gz 2023-10-14T10:36:22.564 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99695.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99695.log.gz 2023-10-14T10:36:22.564 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95794.log 2023-10-14T10:36:22.565 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph.tmp-client.admin.81119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100409.log 2023-10-14T10:36:22.566 INFO:teuthology.orchestra.run.smithi008.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.81119.log.gz 2023-10-14T10:36:22.567 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95794.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.95794.log.gz 2023-10-14T10:36:22.567 INFO:teuthology.orchestra.run.smithi008.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.100593.log 2023-10-14T10:36:22.569 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97039.log 2023-10-14T10:36:22.569 INFO:teuthology.orchestra.run.smithi008.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100409.log.gz 2023-10-14T10:36:22.570 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94717.log 2023-10-14T10:36:22.571 INFO:teuthology.orchestra.run.smithi008.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100593.log.gz 2023-10-14T10:36:22.571 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97039.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.97039.log.gz 2023-10-14T10:36:22.572 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97081.log 2023-10-14T10:36:22.573 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.94717.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94717.log.gz 2023-10-14T10:36:22.573 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91933.log 2023-10-14T10:36:22.574 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95011.log 2023-10-14T10:36:22.575 INFO:teuthology.orchestra.run.smithi008.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97081.log.gz 2023-10-14T10:36:22.576 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91933.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91933.log.gz 2023-10-14T10:36:22.576 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97249.log 2023-10-14T10:36:22.577 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98908.log 2023-10-14T10:36:22.578 INFO:teuthology.orchestra.run.smithi008.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95011.log.gz 2023-10-14T10:36:22.579 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97249.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97249.log.gz 2023-10-14T10:36:22.580 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98079.log 2023-10-14T10:36:22.581 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96208.log 2023-10-14T10:36:22.581 INFO:teuthology.orchestra.run.smithi008.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98908.log.gz 2023-10-14T10:36:22.582 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98079.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98079.log.gz 2023-10-14T10:36:22.582 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92103.log 2023-10-14T10:36:22.584 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96208.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-14T10:36:22.584 INFO:teuthology.orchestra.run.smithi008.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96208.log.gz 2023-10-14T10:36:22.585 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92103.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92103.log.gz 2023-10-14T10:36:22.586 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87492.log 2023-10-14T10:36:22.587 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96649.log 2023-10-14T10:36:22.588 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.87492.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87492.log.gz 2023-10-14T10:36:22.589 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97653.log 2023-10-14T10:36:22.591 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96462.log 2023-10-14T10:36:22.591 INFO:teuthology.orchestra.run.smithi008.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96649.log.gz 2023-10-14T10:36:22.592 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96377.log 2023-10-14T10:36:22.593 INFO:teuthology.orchestra.run.smithi008.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97653.log.gz 2023-10-14T10:36:22.593 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99821.log 2023-10-14T10:36:22.594 INFO:teuthology.orchestra.run.smithi008.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96462.log.gz 2023-10-14T10:36:22.595 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98121.log 2023-10-14T10:36:22.595 INFO:teuthology.orchestra.run.smithi008.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96377.log.gz 2023-10-14T10:36:22.596 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99821.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99821.log.gz -5 2023-10-14T10:36:22.597 INFO:teuthology.orchestra.run.smithi008.stderr: --verbose -- /var/log/ceph/ceph-client.admin.99323.log 2023-10-14T10:36:22.598 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93741.log 2023-10-14T10:36:22.598 INFO:teuthology.orchestra.run.smithi008.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.98121.log.gz 2023-10-14T10:36:22.599 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99323.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99323.log.gz 2023-10-14T10:36:22.600 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94969.log 2023-10-14T10:36:22.601 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100451.log 2023-10-14T10:36:22.602 INFO:teuthology.orchestra.run.smithi008.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93741.log.gz 2023-10-14T10:36:22.603 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.94969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98679.log 2023-10-14T10:36:22.603 INFO:teuthology.orchestra.run.smithi008.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94969.log.gz 2023-10-14T10:36:22.605 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96997.log 2023-10-14T10:36:22.605 INFO:teuthology.orchestra.run.smithi008.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100451.log.gz 2023-10-14T10:36:22.606 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99863.log 2023-10-14T10:36:22.607 INFO:teuthology.orchestra.run.smithi008.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.98679.log.gz 2023-10-14T10:36:22.608 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96997.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T10:36:22.608 INFO:teuthology.orchestra.run.smithi008.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96997.log.gz 2023-10-14T10:36:22.609 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98950.log 2023-10-14T10:36:22.609 INFO:teuthology.orchestra.run.smithi008.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99863.log.gz 2023-10-14T10:36:22.610 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95914.log 2023-10-14T10:36:22.612 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92445.log 2023-10-14T10:36:22.613 INFO:teuthology.orchestra.run.smithi008.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98950.log.gz 2023-10-14T10:36:22.614 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92438.log 2023-10-14T10:36:22.614 INFO:teuthology.orchestra.run.smithi008.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95914.log.gz 2023-10-14T10:36:22.616 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98247.log 2023-10-14T10:36:22.616 INFO:teuthology.orchestra.run.smithi008.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92445.log.gz 2023-10-14T10:36:22.617 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97165.log 2023-10-14T10:36:22.618 INFO:teuthology.orchestra.run.smithi008.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92438.log.gz 2023-10-14T10:36:22.619 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98247.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T10:36:22.619 INFO:teuthology.orchestra.run.smithi008.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.98247.log.gz 2023-10-14T10:36:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93121.log 2023-10-14T10:36:22.621 INFO:teuthology.orchestra.run.smithi008.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97165.log.gz 2023-10-14T10:36:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98013.log 2023-10-14T10:36:22.623 INFO:teuthology.orchestra.run.smithi008.stderr: 84.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T10:36:22.624 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93121.log: gzip -5 --verbose -- 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93121.log.gz 2023-10-14T10:36:22.624 INFO:teuthology.orchestra.run.smithi008.stderr: /var/log/ceph/ceph-client.admin.100199.log 2023-10-14T10:36:22.625 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.98013.log: gzip -5 --verbose 90.9% -- replaced with /var/log/ceph/ceph-client.admin.98013.log.gz 2023-10-14T10:36:22.626 INFO:teuthology.orchestra.run.smithi008.stderr: -- /var/log/ceph/ceph-client.admin.95515.log 2023-10-14T10:36:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100199.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100199.log.gz 2023-10-14T10:36:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T10:36:22.629 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95515.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-14T10:36:22.629 INFO:teuthology.orchestra.run.smithi008.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95515.log.gz 2023-10-14T10:36:22.631 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99947.log 2023-10-14T10:36:22.634 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-mds.c.log: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T10:36:22.634 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99947.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99947.log.gz 2023-10-14T10:36:22.635 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94675.log 2023-10-14T10:36:22.636 INFO:teuthology.orchestra.run.smithi008.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-14T10:36:22.636 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91755.log 2023-10-14T10:36:22.638 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.94675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94759.log 2023-10-14T10:36:22.638 INFO:teuthology.orchestra.run.smithi008.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94675.log.gz 2023-10-14T10:36:22.639 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95872.log 2023-10-14T10:36:22.639 INFO:teuthology.orchestra.run.smithi008.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.91755.log.gz 2023-10-14T10:36:22.640 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.94759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96124.log 2023-10-14T10:36:22.641 INFO:teuthology.orchestra.run.smithi008.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94759.log.gz 2023-10-14T10:36:22.641 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95872.log: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T10:36:22.642 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97971.log 2023-10-14T10:36:22.642 INFO:teuthology.orchestra.run.smithi008.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95872.log.gz 2023-10-14T10:36:22.643 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.96124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92771.log 2023-10-14T10:36:22.644 INFO:teuthology.orchestra.run.smithi008.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96124.log.gz 2023-10-14T10:36:22.645 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97971.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97971.log.gz 2023-10-14T10:36:22.645 INFO:teuthology.orchestra.run.smithi008.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-14T10:36:22.646 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94422.log 2023-10-14T10:36:22.648 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97337.log 2023-10-14T10:36:22.649 INFO:teuthology.orchestra.run.smithi008.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92771.log.gz 2023-10-14T10:36:22.650 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.0.94422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.94422.log.gz 2023-10-14T10:36:22.650 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97611.log 2023-10-14T10:36:22.650 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97337.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97337.log.gz 2023-10-14T10:36:22.651 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91703.log 2023-10-14T10:36:22.652 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95305.log 2023-10-14T10:36:22.653 INFO:teuthology.orchestra.run.smithi008.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97611.log.gz 2023-10-14T10:36:22.653 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91703.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91703.log.gz 2023-10-14T10:36:22.653 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95221.log 2023-10-14T10:36:22.654 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95305.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95305.log.gz 2023-10-14T10:36:22.655 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99737.log 2023-10-14T10:36:22.655 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.95221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99989.log 2023-10-14T10:36:22.656 INFO:teuthology.orchestra.run.smithi008.stderr: 88.4%/var/log/ceph/ceph-client.admin.99737.log: -- replaced with /var/log/ceph/ceph-client.admin.95221.log.gz 2023-10-14T10:36:22.657 INFO:teuthology.orchestra.run.smithi008.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99737.log.gz 2023-10-14T10:36:22.657 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99905.log 2023-10-14T10:36:22.658 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99989.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99989.log.gz 2023-10-14T10:36:22.659 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-14T10:36:22.660 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.99905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100551.log 2023-10-14T10:36:22.660 INFO:teuthology.orchestra.run.smithi008.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99905.log.gz 2023-10-14T10:36:22.661 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97569.log 2023-10-14T10:36:22.663 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.100551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92061.log 2023-10-14T10:36:22.663 INFO:teuthology.orchestra.run.smithi008.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100551.log.gz 2023-10-14T10:36:22.665 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.97569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93116.log 2023-10-14T10:36:22.665 INFO:teuthology.orchestra.run.smithi008.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97569.log.gz 2023-10-14T10:36:22.666 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92444.log 2023-10-14T10:36:22.666 INFO:teuthology.orchestra.run.smithi008.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92061.log.gz 2023-10-14T10:36:22.667 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93116.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93116.log.gz 2023-10-14T10:36:22.669 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92444.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92444.log.gz 2023-10-14T10:36:22.690 INFO:teuthology.orchestra.run.smithi008.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-14T10:36:22.697 INFO:teuthology.orchestra.run.smithi008.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-14T10:36:22.724 INFO:teuthology.orchestra.run.smithi008.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T10:36:22.738 INFO:teuthology.orchestra.run.smithi008.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T10:36:22.741 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-14T10:36:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:real 0m0.413s 2023-10-14T10:36:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:user 0m0.862s 2023-10-14T10:36:22.742 INFO:teuthology.orchestra.run.smithi008.stderr:sys 0m0.714s 2023-10-14T10:36:22.744 INFO:tasks.ceph:Archiving logs... 2023-10-14T10:36:22.744 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217/remote/smithi008/log 2023-10-14T10:36:22.745 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T10:36:23.121 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217/remote/smithi092/log 2023-10-14T10:36:23.123 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T10:36:23.326 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T10:36:23.350 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T10:36:23.350 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T10:36:23.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T10:36:23.511 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T10:36:23.521 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T10:36:23.521 DEBUG:teuthology.orchestra.run.smithi008:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T10:36:23.531 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T10:36:23.583 INFO:teuthology.orchestra.run.smithi008.stderr:bash: line 1: ntpq: command not found 2023-10-14T10:36:23.588 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2023-10-14T10:36:23.594 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T10:36:23.595 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-10-14T10:36:23.595 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 7 +4242us[+4242us] +/- 88ms 2023-10-14T10:36:23.595 INFO:teuthology.orchestra.run.smithi008.stdout:^* hv02.front.sepia.ceph.com 3 6 377 8 -1655us[-1666us] +/- 57ms 2023-10-14T10:36:23.596 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -1338us[-1349us] +/- 73ms 2023-10-14T10:36:23.596 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T10:36:23.598 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T10:36:23.598 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-10-14T10:36:23.598 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 8 +4253us[+4253us] +/- 88ms 2023-10-14T10:36:23.599 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv02.front.sepia.ceph.com 3 6 377 9 -1646us[-1637us] +/- 57ms 2023-10-14T10:36:23.599 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -1343us[-1343us] +/- 73ms 2023-10-14T10:36:23.599 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T10:36:23.600 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T10:36:23.610 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T10:36:23.610 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T10:36:23.655 DEBUG:teuthology.orchestra.run.smithi008:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T10:36:23.944 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T10:36:24.207 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T10:36:24.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T10:36:24.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T10:36:24.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T10:36:24.436 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T10:36:24.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T10:36:24.472 INFO:teuthology.task.internal:Duration was 955.709573 seconds 2023-10-14T10:36:24.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T10:36:24.506 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T10:36:24.507 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T10:36:24.516 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T10:36:24.678 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T10:36:24.690 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T10:36:25.014 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T10:36:25.015 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T10:36:25.015 DEBUG:teuthology.orchestra.run.smithi008:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T10:36:25.086 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2023-10-14T10:36:25.087 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T10:36:25.165 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T10:36:25.166 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T10:36:25.176 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T10:36:25.276 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T10:36:25.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T10:36:25.283 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T10:36:25.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T10:36:25.477 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T10:36:25.478 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T10:36:25.580 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T10:36:25.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T10:36:25.695 DEBUG:teuthology.orchestra.run.smithi008:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T10:36:25.704 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T10:36:25.814 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2023-10-14T10:36:25.816 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = core 2023-10-14T10:36:25.874 DEBUG:teuthology.orchestra.run.smithi008:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T10:36:25.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T10:36:25.928 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T10:36:25.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T10:36:25.986 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T10:36:25.997 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T10:36:25.999 DEBUG:teuthology.misc:Transferring archived files from smithi008:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217/remote/smithi008 2023-10-14T10:36:25.999 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T10:36:26.121 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217/remote/smithi092 2023-10-14T10:36:26.121 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T10:36:26.233 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T10:36:26.234 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T10:36:26.243 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T10:36:26.301 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T10:36:26.315 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T10:36:26.315 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T10:36:26.336 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T10:36:26.337 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T10:36:26.346 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T10:36:26.401 INFO:teuthology.orchestra.run.smithi008.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 10:36 /home/ubuntu/cephtest 2023-10-14T10:36:26.406 INFO:teuthology.orchestra.run.smithi092.stdout: 525016 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 10:36 /home/ubuntu/cephtest 2023-10-14T10:36:26.409 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T10:36:26.420 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T10:36:26.520 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T10:36:26.545 DEBUG:teuthology.nuke:shortname: smithi008 2023-10-14T10:36:26.545 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T10:36:26.570 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 10:11:18.781621', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJbRN2m1thcVQpCsyuQTL+DCHe2isdRV4ohjSBmxB0doGHf17+4IZ0ht7e0NgjIsgT9FyQkaFgKWHMHohu6xqw='} 2023-10-14T10:36:26.575 DEBUG:teuthology.nuke:shortname: smithi092 2023-10-14T10:36:26.575 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T10:36:26.600 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425217', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 10:11:18.780135', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP/EQYXPQOGDDCHO62xogl3UH0iFPEqytp/CH5wRYoLQcchSx2clehL0xvQEnNdUUG6t4dD4BqQE0xb7MlREKPE='} 2023-10-14T10:36:26.628 INFO:teuthology.orchestra.console.smithi008:Power off 2023-10-14T10:36:26.629 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T10:36:26.652 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-10-14T10:36:26.653 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T10:36:26.671 INFO:teuthology.orchestra.console.smithi092:Power off 2023-10-14T10:36:26.672 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T10:36:26.681 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-10-14T10:36:26.694 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-10-14T10:36:26.694 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T10:36:26.717 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-14T10:36:30.683 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T10:36:30.719 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T10:36:30.794 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-10-14T10:36:30.832 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-14T10:36:34.798 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T10:36:34.833 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T10:36:34.910 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-10-14T10:36:34.945 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-14T10:36:35.012 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-10-14T10:36:35.047 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-10-14T10:36:35.152 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 client.1-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} duration: 955.7095730304718 failure_reason: 'Test failure: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=f210bf890761411bb01c60df0d299398 status: fail success: false 2023-10-14T10:36:35.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T10:36:35.273 INFO:teuthology.run:FAIL